2024-03-20T13:24:01.450 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-20T13:24:01.451 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305 --verbose --owner scheduled_amaredia@teuthology --name amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi --description rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/orig.config.yaml 2024-03-20T13:24:01.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T13:24:01.574 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305 branch: wip_thotz_update_attrs_from_state_setattrs description: rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7612305' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip_thotz_update_attrs_from_state_setattrs ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 12fa452f60a20733b42c92efd8302af373c366e6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 12fa452f60a20733b42c92efd8302af373c366e6 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip_thotz_update_attrs_from_state_setattrs sha1: 12fa452f60a20733b42c92efd8302af373c366e6 owner: scheduled_amaredia@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 4446 sha1: 12fa452f60a20733b42c92efd8302af373c366e6 sleep_before_teardown: 0 suite: rgw:singleton suite_branch: wip_thotz_update_attrs_from_state_setattrs suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 12fa452f60a20733b42c92efd8302af373c366e6 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKOSN6JHb/n65YoBGNHUGf8IQTTm58xCM0bYcw6Q83rJH3LwybxnqCEHlnPiL/ZT/Bw8Ix1Go/OTIPeVBhJTz8= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQkSkDgw+Ua/Y5BwKIeHuRzQVFHqxkFwqvyQRRnWyQimem8q3XyJugDl8P31woQxNEF+xC+FEgVJk4U13z/mH4= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-20_13:11:42 tube: smithi user: amaredia verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-20T13:24:01.574 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa; will attempt to use it 2024-03-20T13:24:01.575 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa/tasks 2024-03-20T13:24:01.575 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-20T13:24:01.577 INFO:teuthology.task.internal:Checking packages... 2024-03-20T13:24:01.598 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '12fa452f60a20733b42c92efd8302af373c366e6' 2024-03-20T13:24:01.598 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-20T13:24:01.598 INFO:teuthology.packaging:ref: None 2024-03-20T13:24:01.599 INFO:teuthology.packaging:tag: None 2024-03-20T13:24:01.599 INFO:teuthology.packaging:branch: wip_thotz_update_attrs_from_state_setattrs 2024-03-20T13:24:01.599 INFO:teuthology.packaging:sha1: 12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:24:01.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip_thotz_update_attrs_from_state_setattrs 2024-03-20T13:24:01.814 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:24:01.815 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-20T13:24:01.821 INFO:teuthology.task.internal:no buildpackages task found 2024-03-20T13:24:01.822 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-20T13:24:01.849 INFO:teuthology.task.internal:Saving configuration 2024-03-20T13:24:01.861 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-20T13:24:01.885 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-20T13:24:01.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:22.413876', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOBia8YzBCJJm2uRf0ilJyUNFmzGGwn8YsQZ2ZROXaZ7'} 2024-03-20T13:24:01.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:22.415020', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEiaTSbHgjAVoFKX55ggAJ5SG5UE6jKDDNXVSls4ni9O'} 2024-03-20T13:24:01.932 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-20T13:24:01.939 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-03-20T13:24:01.939 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-03-20T13:24:01.939 INFO:teuthology.run_tasks:Running task console_log... 2024-03-20T13:24:02.030 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f16715280>, signals=[15]) 2024-03-20T13:24:02.030 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-20T13:24:02.036 INFO:teuthology.task.internal:Opening connections... 2024-03-20T13:24:02.036 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-03-20T13:24:02.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:24:02.123 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:24:02.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:24:02.199 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-20T13:24:02.206 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-03-20T13:24:02.211 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-03-20T13:24:02.211 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-20T13:24:02.260 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-20T13:24:02.261 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-20T13:24:02.261 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-20T13:24:02.261 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2024-03-20T13:24:02.261 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-03-20T13:24:02.284 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-03-20T13:24:02.289 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-03-20T13:24:02.289 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-03-20T13:24:02.336 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-20T13:24:02.336 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2024-03-20T13:24:02.336 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2024-03-20T13:24:02.336 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-20T13:24:02.337 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2024-03-20T13:24:02.337 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-03-20T13:24:02.358 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-20T13:24:02.367 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-20T13:24:02.392 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-20T13:24:02.392 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-03-20T13:24:02.395 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-03-20T13:24:02.399 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-20T13:24:02.416 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-20T13:24:02.416 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-03-20T13:24:02.442 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-03-20T13:24:02.455 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-20T13:24:02.508 INFO:teuthology.run_tasks:Running task kernel... 2024-03-20T13:24:02.524 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-20T13:24:02.525 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-20T13:24:02.525 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-20T13:24:02.525 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-20T13:24:02.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:24:02.530 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-03-20T13:24:02.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:24:02.531 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-03-20T13:24:02.577 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-56-generic 2024-03-20T13:24:02.577 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.15.0-56-generic 2024-03-20T13:24:02.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2024-03-20T13:24:02.578 INFO:teuthology.orchestra.run.smithi123.stdout:5.15.0-56-generic 2024-03-20T13:24:02.578 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.15.0-56-generic 2024-03-20T13:24:02.578 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get clean 2024-03-20T13:24:02.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-03-20T13:24:02.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-03-20T13:24:02.826 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-20T13:24:02.846 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-20T13:24:02.851 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-20T13:24:02.881 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-20T13:24:02.942 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-20T13:24:02.978 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-20T13:24:02.984 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-20T13:24:02.984 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-20T13:24:03.067 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,502 kB] 2024-03-20T13:24:03.087 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [594 kB] 2024-03-20T13:24:03.197 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,502 kB] 2024-03-20T13:24:03.212 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [594 kB] 2024-03-20T13:24:03.224 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [289 kB] 2024-03-20T13:24:03.229 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-20T13:24:03.230 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,619 kB] 2024-03-20T13:24:03.261 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [289 kB] 2024-03-20T13:24:03.267 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-20T13:24:03.269 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [271 kB] 2024-03-20T13:24:03.269 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-20T13:24:03.270 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-20T13:24:03.271 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,619 kB] 2024-03-20T13:24:03.275 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-20T13:24:03.275 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,059 kB] 2024-03-20T13:24:03.300 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [697 kB] 2024-03-20T13:24:03.324 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [271 kB] 2024-03-20T13:24:03.326 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-20T13:24:03.326 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [697 kB] 2024-03-20T13:24:03.331 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [240 kB] 2024-03-20T13:24:03.333 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-20T13:24:03.333 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-20T13:24:03.333 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-20T13:24:03.337 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,059 kB] 2024-03-20T13:24:03.359 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-20T13:24:03.359 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-20T13:24:03.359 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-20T13:24:03.359 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-20T13:24:03.363 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-20T13:24:03.377 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [240 kB] 2024-03-20T13:24:03.379 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-20T13:24:03.379 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-20T13:24:03.380 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-20T13:24:03.380 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-20T13:24:03.380 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-20T13:24:03.381 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-20T13:24:03.381 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-20T13:24:03.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-20T13:24:03.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [428 kB] 2024-03-20T13:24:03.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-20T13:24:03.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-20T13:24:03.409 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-20T13:24:03.410 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-20T13:24:03.411 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-20T13:24:03.411 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-20T13:24:03.428 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-20T13:24:03.429 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-20T13:24:03.438 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [428 kB] 2024-03-20T13:24:03.448 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-20T13:24:03.449 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-20T13:24:03.685 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,286 kB] 2024-03-20T13:24:03.718 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,286 kB] 2024-03-20T13:24:03.851 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [229 kB] 2024-03-20T13:24:03.863 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-20T13:24:03.864 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,591 kB] 2024-03-20T13:24:03.885 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [229 kB] 2024-03-20T13:24:03.897 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-20T13:24:03.898 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,591 kB] 2024-03-20T13:24:03.944 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-20T13:24:03.945 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [267 kB] 2024-03-20T13:24:03.953 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-20T13:24:03.954 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [851 kB] 2024-03-20T13:24:03.977 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-20T13:24:03.978 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-20T13:24:03.979 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [267 kB] 2024-03-20T13:24:03.987 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-20T13:24:03.988 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [851 kB] 2024-03-20T13:24:04.011 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-20T13:24:04.155 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-20T13:24:04.189 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-20T13:24:04.554 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-20T13:24:04.560 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-20T13:24:04.574 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-20T13:24:04.574 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-20T13:24:04.577 INFO:teuthology.orchestra.run.smithi123.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-20T13:24:04.596 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-20T13:24:04.602 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-20T13:24:04.616 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-20T13:24:04.616 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-20T13:24:04.619 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-20T13:24:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 12.5 MB in 2s (6,655 kB/s) 2024-03-20T13:24:09.066 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 12.5 MB in 2s (6,919 kB/s) 2024-03-20T13:24:10.343 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-03-20T13:24:10.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-20T13:24:10.405 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-03-20T13:24:10.418 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-03-20T13:24:10.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-20T13:24:10.483 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-03-20T13:24:10.616 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-03-20T13:24:10.616 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-03-20T13:24:10.660 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-03-20T13:24:10.660 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-03-20T13:24:10.787 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-03-20T13:24:10.787 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-20T13:24:10.787 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-20T13:24:10.788 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-20T13:24:10.788 INFO:teuthology.orchestra.run.smithi089.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-20T13:24:10.788 INFO:teuthology.orchestra.run.smithi089.stdout: python2.7-minimal 2024-03-20T13:24:10.788 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-20T13:24:10.789 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-03-20T13:24:10.789 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-20T13:24:10.789 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-20T13:24:10.790 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-20T13:24:10.791 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-03-20T13:24:10.791 INFO:teuthology.orchestra.run.smithi089.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-20T13:24:10.791 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2024-03-20T13:24:10.791 INFO:teuthology.orchestra.run.smithi089.stdout: thermald 2024-03-20T13:24:10.812 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-03-20T13:24:10.812 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-20T13:24:10.812 INFO:teuthology.orchestra.run.smithi123.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-20T13:24:10.813 INFO:teuthology.orchestra.run.smithi123.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-20T13:24:10.813 INFO:teuthology.orchestra.run.smithi123.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-20T13:24:10.813 INFO:teuthology.orchestra.run.smithi123.stdout: python2.7-minimal 2024-03-20T13:24:10.813 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-20T13:24:10.814 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-03-20T13:24:10.814 INFO:teuthology.orchestra.run.smithi123.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-20T13:24:10.814 INFO:teuthology.orchestra.run.smithi123.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-20T13:24:10.814 INFO:teuthology.orchestra.run.smithi123.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-20T13:24:10.815 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-03-20T13:24:10.815 INFO:teuthology.orchestra.run.smithi123.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-20T13:24:10.816 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2024-03-20T13:24:10.816 INFO:teuthology.orchestra.run.smithi123.stdout: thermald 2024-03-20T13:24:10.836 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-03-20T13:24:10.836 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-20T13:24:10.836 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-20T13:24:10.836 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-20T13:24:10.838 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2024-03-20T13:24:10.838 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-20T13:24:10.862 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-03-20T13:24:10.862 INFO:teuthology.orchestra.run.smithi123.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-20T13:24:10.862 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-20T13:24:10.862 INFO:teuthology.orchestra.run.smithi123.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-20T13:24:10.864 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2024-03-20T13:24:10.864 INFO:teuthology.orchestra.run.smithi123.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-20T13:24:10.921 INFO:teuthology.orchestra.run.smithi123.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-03-20T13:24:10.921 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 113 MB of archives. 2024-03-20T13:24:10.921 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-20T13:24:10.921 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-20T13:24:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-03-20T13:24:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 113 MB of archives. 2024-03-20T13:24:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-20T13:24:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-20T13:24:11.438 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-20T13:24:11.603 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-20T13:24:12.431 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-20T13:24:12.699 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-20T13:24:12.699 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-20T13:24:12.699 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-20T13:24:12.777 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-20T13:24:12.901 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-20T13:24:12.934 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-20T13:24:13.317 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 113 MB in 2s (54.8 MB/s) 2024-03-20T13:24:13.520 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-20T13:24:15.004 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-20T13:24:15.005 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-20T13:24:15.005 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-20T13:24:15.432 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-20T13:24:15.517 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-20T13:24:15.679 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-20T13:24:15.686 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:15.901 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:15.937 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-03-20T13:24:16.123 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-20T13:24:18.159 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-20T13:24:18.163 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:18.186 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-20T13:24:18.208 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:18.263 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:18.294 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:18.714 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-20T13:24:18.735 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:18.772 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:20.781 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-20T13:24:20.802 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:20.873 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:21.409 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-20T13:24:21.429 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:21.467 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:25.195 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-20T13:24:25.305 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-20T13:24:25.664 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-20T13:24:25.775 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-20T13:24:26.036 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-20T13:24:26.048 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-20T13:24:26.086 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-20T13:24:28.170 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-20T13:24:28.295 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-20T13:24:28.662 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-20T13:24:28.799 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-20T13:24:29.060 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-20T13:24:29.082 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-20T13:24:29.141 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-20T13:24:31.606 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-20T13:24:31.643 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:32.076 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:34.760 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-20T13:24:34.882 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-20T13:24:35.224 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-20T13:24:35.242 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-20T13:24:35.279 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-20T13:24:35.317 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:35.345 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:35.463 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-20T13:24:35.592 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:36.901 INFO:teuthology.orchestra.run.smithi123.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-20T13:24:36.901 INFO:teuthology.orchestra.run.smithi123.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-20T13:24:36.902 INFO:teuthology.orchestra.run.smithi123.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-20T13:24:36.902 INFO:teuthology.orchestra.run.smithi123.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-20T13:24:37.061 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:38.098 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-20T13:24:38.248 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-20T13:24:39.053 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:39.349 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-20T13:24:39.488 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:39.614 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-20T13:24:39.776 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:40.463 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-20T13:24:40.588 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-20T13:24:40.715 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-20T13:24:40.772 INFO:teuthology.orchestra.run.smithi123.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-20T13:24:41.112 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-20T13:24:41.112 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-20T13:24:41.112 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-20T13:24:41.112 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-20T13:24:41.296 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:42.705 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:44.082 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-20T13:24:44.183 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-20T13:24:45.118 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-20T13:24:45.179 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-20T13:24:45.179 INFO:teuthology.orchestra.run.smithi089.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-20T13:24:55.645 INFO:teuthology.orchestra.run.smithi123.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-20T13:24:55.645 INFO:teuthology.orchestra.run.smithi123.stdout:Sourcing file `/etc/default/grub' 2024-03-20T13:24:55.663 INFO:teuthology.orchestra.run.smithi123.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-20T13:24:55.680 INFO:teuthology.orchestra.run.smithi123.stdout:Generating grub configuration file ... 2024-03-20T13:24:55.973 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-20T13:24:55.989 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-20T13:24:56.287 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-20T13:24:56.292 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-20T13:24:56.363 INFO:teuthology.orchestra.run.smithi123.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-20T13:24:56.368 INFO:teuthology.orchestra.run.smithi123.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-20T13:24:56.515 INFO:teuthology.orchestra.run.smithi123.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-20T13:24:56.515 INFO:teuthology.orchestra.run.smithi123.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-20T13:24:56.515 INFO:teuthology.orchestra.run.smithi123.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-20T13:24:56.568 INFO:teuthology.orchestra.run.smithi123.stdout:done 2024-03-20T13:24:57.048 DEBUG:teuthology.orchestra.run.smithi123:> dpkg -s linux-image-generic 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Package: linux-image-generic 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Status: install ok installed 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Priority: optional 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Section: kernel 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Installed-Size: 21 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Maintainer: Ubuntu Kernel Team 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: amd64 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Source: linux-meta 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Version: 5.15.0.101.98 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Recommends: thermald 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout:Description: Generic Linux kernel image 2024-03-20T13:24:57.084 INFO:teuthology.orchestra.run.smithi123.stdout: This package will always depend on the latest generic kernel image 2024-03-20T13:24:57.085 INFO:teuthology.orchestra.run.smithi123.stdout: available. 2024-03-20T13:24:57.085 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-20T13:24:57.085 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-20T13:24:57.085 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-20T13:24:57.085 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-03-20T13:24:57.085 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2024-03-20T13:24:57.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get clean 2024-03-20T13:24:57.230 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-03-20T13:24:57.357 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-20T13:24:57.462 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-20T13:24:57.550 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-20T13:24:57.626 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-20T13:24:58.756 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-03-20T13:24:58.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-20T13:24:58.834 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-03-20T13:24:59.030 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-03-20T13:24:59.030 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-03-20T13:24:59.205 INFO:teuthology.orchestra.run.smithi123.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-20T13:24:59.205 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-03-20T13:24:59.205 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-20T13:24:59.206 INFO:teuthology.orchestra.run.smithi123.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-20T13:24:59.206 INFO:teuthology.orchestra.run.smithi123.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-20T13:24:59.206 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-20T13:24:59.206 INFO:teuthology.orchestra.run.smithi123.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-20T13:24:59.206 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-20T13:24:59.249 INFO:teuthology.orchestra.run.smithi123.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-03-20T13:24:59.251 DEBUG:teuthology.orchestra.run.smithi123:> dpkg -s linux-image-generic 2024-03-20T13:24:59.266 INFO:teuthology.orchestra.run.smithi123.stdout:Package: linux-image-generic 2024-03-20T13:24:59.266 INFO:teuthology.orchestra.run.smithi123.stdout:Status: install ok installed 2024-03-20T13:24:59.266 INFO:teuthology.orchestra.run.smithi123.stdout:Priority: optional 2024-03-20T13:24:59.266 INFO:teuthology.orchestra.run.smithi123.stdout:Section: kernel 2024-03-20T13:24:59.266 INFO:teuthology.orchestra.run.smithi123.stdout:Installed-Size: 21 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Maintainer: Ubuntu Kernel Team 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: amd64 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Source: linux-meta 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Version: 5.15.0.101.98 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Recommends: thermald 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout:Description: Generic Linux kernel image 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout: This package will always depend on the latest generic kernel image 2024-03-20T13:24:59.267 INFO:teuthology.orchestra.run.smithi123.stdout: available. 2024-03-20T13:24:59.267 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-03-20T13:24:59.315 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.OZKwl0pQqj 2024-03-20T13:24:59.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub/grub.cfg /tmp/tmp.OZKwl0pQqj 2024-03-20T13:24:59.362 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-20T13:24:59.362 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub' 2024-03-20T13:24:59.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.OZKwl0pQqj 2024-03-20T13:24:59.386 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-20T13:24:59.405 INFO:teuthology.orchestra.run.smithi089.stdout:Generating grub configuration file ... 2024-03-20T13:24:59.495 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.OZKwl0pQqj is 10KB 2024-03-20T13:24:59.508 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.OZKwl0pQqj 2024-03-20T13:24:59.514 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-20T13:24:59.567 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:24:59.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-20T13:24:59.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-20T13:24:59.631 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-20T13:24:59.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo update-grub 2024-03-20T13:24:59.691 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-20T13:24:59.718 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-20T13:25:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-20T13:25:00.076 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-20T13:25:00.150 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-20T13:25:00.156 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-20T13:25:00.326 INFO:teuthology.orchestra.run.smithi089.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-20T13:25:00.326 INFO:teuthology.orchestra.run.smithi089.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-20T13:25:00.326 INFO:teuthology.orchestra.run.smithi089.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-20T13:25:00.366 INFO:teuthology.orchestra.run.smithi089.stdout:done 2024-03-20T13:25:00.809 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2024-03-20T13:25:00.810 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-20T13:25:00.814 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-03-20T13:25:00.828 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2024-03-20T13:25:00.851 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 21 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.15.0.101.98 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2024-03-20T13:25:00.852 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2024-03-20T13:25:00.853 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-20T13:25:00.853 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-20T13:25:00.853 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-20T13:25:00.853 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-20T13:25:00.853 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-03-20T13:25:00.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2024-03-20T13:25:00.992 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-20T13:25:00.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-03-20T13:25:00.999 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-20T13:25:01.168 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-20T13:25:01.168 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-20T13:25:01.181 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-20T13:25:01.206 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-20T13:25:01.488 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-20T13:25:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-20T13:25:01.538 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-20T13:25:01.543 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-20T13:25:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-20T13:25:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-20T13:25:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-20T13:25:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-03-20T13:25:01.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-03-20T13:25:02.552 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-03-20T13:25:02.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-20T13:25:02.634 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-03-20T13:25:02.825 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-03-20T13:25:02.825 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-03-20T13:25:02.998 INFO:teuthology.orchestra.run.smithi089.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-20T13:25:02.998 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-03-20T13:25:02.998 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-20T13:25:02.998 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-20T13:25:02.999 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-20T13:25:02.999 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-20T13:25:02.999 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-20T13:25:02.999 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-20T13:25:03.042 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-03-20T13:25:03.044 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 21 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2024-03-20T13:25:03.059 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.15.0.101.98 2024-03-20T13:25:03.060 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-20T13:25:03.060 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-20T13:25:03.060 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2024-03-20T13:25:03.060 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2024-03-20T13:25:03.060 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2024-03-20T13:25:03.060 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2024-03-20T13:25:03.060 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-03-20T13:25:03.107 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.jlzJp7R7Yj 2024-03-20T13:25:03.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jlzJp7R7Yj 2024-03-20T13:25:03.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.jlzJp7R7Yj 2024-03-20T13:25:03.275 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.jlzJp7R7Yj is 10KB 2024-03-20T13:25:03.288 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.jlzJp7R7Yj 2024-03-20T13:25:03.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-20T13:25:03.346 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:25:03.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-20T13:25:03.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-20T13:25:03.430 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-20T13:25:03.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo update-grub 2024-03-20T13:25:04.875 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2024-03-20T13:25:04.885 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-20T13:25:04.889 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-03-20T13:25:05.101 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-20T13:25:05.106 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-20T13:25:05.348 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-20T13:25:05.354 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-20T13:25:05.390 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-20T13:25:05.395 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-20T13:25:05.497 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-20T13:25:05.497 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-20T13:25:05.497 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-20T13:25:05.519 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-03-20T13:25:05.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-03-20T13:25:31.700 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-03-20T13:25:31.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:25:31.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:25:35.578 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-20T13:25:35.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:25:35.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:25:50.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-03-20T13:25:54.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-03-20T13:25:59.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:25:59.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:02.302 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-03-20T13:26:03.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:26:03.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:06.143 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-03-20T13:26:14.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:26:14.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:18.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:26:18.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:32.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-03-20T13:26:36.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-03-20T13:26:47.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:26:47.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:48.106 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-03-20T13:26:48.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:26:48.714 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-101-generic"... 2024-03-20T13:26:48.714 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-03-20T13:26:48.761 INFO:teuthology.orchestra.run.smithi123.stdout:5.15.0-101-generic 2024-03-20T13:26:48.761 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-20T13:26:48.761 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-20T13:26:48.761 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-20T13:26:49.762 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-03-20T13:26:49.762 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-20T13:26:49.820 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2024-03-20T13:26:49.858 DEBUG:teuthology.parallel:result is None 2024-03-20T13:26:51.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:26:51.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:52.448 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-03-20T13:26:53.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:26:53.408 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-101-generic"... 2024-03-20T13:26:53.408 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-03-20T13:26:53.454 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-101-generic 2024-03-20T13:26:53.454 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-20T13:26:53.455 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-20T13:26:53.455 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-20T13:26:54.455 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-20T13:26:54.456 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-20T13:26:54.861 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-03-20T13:26:54.893 DEBUG:teuthology.parallel:result is None 2024-03-20T13:26:54.893 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-20T13:26:54.899 INFO:teuthology.task.internal:Creating test directory... 2024-03-20T13:26:54.900 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-20T13:26:54.902 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-20T13:26:54.907 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-20T13:26:54.935 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-20T13:26:54.968 INFO:teuthology.task.internal:Creating archive directory... 2024-03-20T13:26:54.968 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-20T13:26:54.971 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-20T13:26:55.079 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-20T13:26:55.085 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-20T13:26:55.085 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-20T13:26:55.088 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-20T13:26:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:26:55.112 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:26:55.114 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:26:55.121 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:26:55.122 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-20T13:26:55.129 INFO:teuthology.task.internal:Configuring sudo... 2024-03-20T13:26:55.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-20T13:26:55.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-20T13:26:55.186 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-20T13:26:55.194 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-20T13:26:55.195 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-20T13:26:55.232 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-20T13:26:55.237 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-20T13:26:55.282 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-20T13:26:55.331 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:26:55.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-20T13:26:55.394 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-20T13:26:55.399 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-20T13:26:55.449 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:26:55.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-20T13:26:55.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-03-20T13:26:55.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-03-20T13:26:55.612 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-20T13:26:55.619 INFO:teuthology.task.internal:Starting timer... 2024-03-20T13:26:55.619 INFO:teuthology.run_tasks:Running task pcp... 2024-03-20T13:26:55.663 INFO:teuthology.run_tasks:Running task selinux... 2024-03-20T13:26:55.695 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2024-03-20T13:26:55.695 DEBUG:teuthology.task.selinux:Excluding smithi123: OS 'ubuntu' does not support SELinux 2024-03-20T13:26:55.695 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-20T13:26:55.695 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-20T13:26:55.695 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-20T13:26:55.695 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-20T13:26:55.730 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-20T13:26:55.736 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-20T13:26:55.864 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-20T13:26:55.879 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-20T13:26:55.880 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi123.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-20T13:33:55.131 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com')] 2024-03-20T13:33:55.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:33:55.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:33:55.217 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-03-20T13:33:55.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-03-20T13:33:55.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:33:55.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:33:55.377 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-03-20T13:33:55.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-03-20T13:33:55.451 INFO:teuthology.run_tasks:Running task clock... 2024-03-20T13:33:55.471 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-20T13:33:55.471 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-20T13:33:55.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:33:55.474 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-20T13:33:55.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:33:55.500 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Command line: ntpd -gq 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: ---------------------------------------------------- 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: ntp-4 is maintained by Network Time Foundation, 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: corporation. Support and training for ntp-4 are 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: available at https://www.nwtime.org/support 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: ---------------------------------------------------- 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: proto: precision = 0.043 usec (-24) 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: basedate set to 2022-02-04 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: gps base set to 2022-02-06 (week 2196) 2024-03-20T13:33:55.501 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-20T13:33:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-20T13:33:55.502 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: restrict ::: KOD does nothing without LIMITED. 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listen and drop on 0 v6wildcard [::]:123 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listen normally on 2 lo 127.0.0.1:123 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listen normally on 4 lo [::1]:123 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2024-03-20T13:33:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:33:55 ntpd[17155]: Listening on routing socket on fd #22 for interface updates 2024-03-20T13:33:55.521 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Command line: ntpd -gq 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: ---------------------------------------------------- 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: ntp-4 is maintained by Network Time Foundation, 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: corporation. Support and training for ntp-4 are 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: available at https://www.nwtime.org/support 2024-03-20T13:33:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: ---------------------------------------------------- 2024-03-20T13:33:55.523 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: proto: precision = 0.062 usec (-24) 2024-03-20T13:33:55.523 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: basedate set to 2022-02-04 2024-03-20T13:33:55.523 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: gps base set to 2022-02-06 (week 2196) 2024-03-20T13:33:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-20T13:33:55.523 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-20T13:33:55.524 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: restrict ::: KOD does nothing without LIMITED. 2024-03-20T13:33:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listen and drop on 0 v6wildcard [::]:123 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listen normally on 2 lo 127.0.0.1:123 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listen normally on 3 enp3s0f1 172.21.15.123:123 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listen normally on 4 lo [::1]:123 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3f1%5]:123 2024-03-20T13:33:55.525 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:33:55 ntpd[17158]: Listening on routing socket on fd #22 for interface updates 2024-03-20T13:33:56.500 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:56 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:56.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:56 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:56.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:56 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:56.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:56 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:56.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:56 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:56.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:56 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:33:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:56 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:56 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:56 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:56 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:56 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:56 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:33:58.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.501 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:58.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:33:58 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:58 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:33:59.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:33:59.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:33:59 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:00.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:00 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:00.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:00 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:01 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:01 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:01.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:01 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:01 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:01 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:01.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:01 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.502 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stdout:20 Mar 13:34:02 ntpd[17155]: ntpd: time slew +0.000424 s 2024-03-20T13:34:02.503 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew +0.000424s 2024-03-20T13:34:02.504 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-20T13:34:02.504 INFO:teuthology.orchestra.run.smithi089.stderr:20 Mar 13:34:02 ntpd[17155]: can't open /var/log/ntpstats/loopstats.20240320: Permission denied 2024-03-20T13:34:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: can't open /var/log/ntpstats/rawstats.20240320: Permission denied 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: can't open /var/log/ntpstats/peerstats.20240320: Permission denied 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stdout:20 Mar 13:34:02 ntpd[17158]: ntpd: time slew -0.006124 s 2024-03-20T13:34:02.523 INFO:teuthology.orchestra.run.smithi123.stdout:ntpd: time slew -0.006124s 2024-03-20T13:34:02.524 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-20T13:34:02.524 INFO:teuthology.orchestra.run.smithi123.stderr:20 Mar 13:34:02 ntpd[17158]: can't open /var/log/ntpstats/loopstats.20240320: Permission denied 2024-03-20T13:34:02.587 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2024-03-20T13:34:02.587 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2024-03-20T13:34:02.587 INFO:teuthology.orchestra.run.smithi123.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.588 INFO:teuthology.orchestra.run.smithi123.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.588 INFO:teuthology.orchestra.run.smithi123.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.588 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.614 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-03-20T13:34:02.615 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-03-20T13:34:02.615 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.615 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.615 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.615 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:34:02.615 INFO:teuthology.run_tasks:Running task install... 2024-03-20T13:34:02.624 DEBUG:teuthology.task.install:project ceph 2024-03-20T13:34:02.624 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}} 2024-03-20T13:34:02.624 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'} 2024-03-20T13:34:02.624 INFO:teuthology.task.install:Using flavor: default 2024-03-20T13:34:02.629 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-20T13:34:02.629 INFO:teuthology.task.install:extra packages: [] 2024-03-20T13:34:02.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2024-03-20T13:34:02.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-key list | grep Ceph 2024-03-20T13:34:02.692 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-20T13:34:02.715 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-20T13:34:02.722 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-20T13:34:02.722 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph.com (release key) 2024-03-20T13:34:02.722 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-20T13:34:02.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:34:02.745 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-20T13:34:02.745 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2024-03-20T13:34:02.746 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-20T13:34:02.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:34:02.943 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default/ 2024-03-20T13:34:02.943 INFO:teuthology.task.install.deb:Package version is 19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:34:02.960 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default/ 2024-03-20T13:34:02.961 INFO:teuthology.task.install.deb:Package version is 19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:34:03.054 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:34:03.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-20T13:34:03.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-03-20T13:34:03.076 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:34:03.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-20T13:34:03.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-03-20T13:34:03.260 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-20T13:34:03.260 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-20T13:34:03.261 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-20T13:34:03.262 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-20T13:34:03.274 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-20T13:34:03.274 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-20T13:34:03.293 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-20T13:34:03.295 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-20T13:34:03.411 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy InRelease 2024-03-20T13:34:03.433 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy InRelease 2024-03-20T13:34:03.448 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-20T13:34:03.469 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-20T13:34:03.485 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-20T13:34:03.506 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-20T13:34:03.522 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-20T13:34:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-20T13:34:03.567 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,402 B] 2024-03-20T13:34:03.584 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,402 B] 2024-03-20T13:34:03.642 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 28.9 kB in 0s (72.8 kB/s) 2024-03-20T13:34:03.659 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 28.9 kB in 0s (74.1 kB/s) 2024-03-20T13:34:04.532 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-03-20T13:34:04.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1426-g12fa452f-1jammy cephadm=19.0.0-1426-g12fa452f-1jammy ceph-mds=19.0.0-1426-g12fa452f-1jammy ceph-mgr=19.0.0-1426-g12fa452f-1jammy ceph-common=19.0.0-1426-g12fa452f-1jammy ceph-fuse=19.0.0-1426-g12fa452f-1jammy ceph-test=19.0.0-1426-g12fa452f-1jammy ceph-volume=19.0.0-1426-g12fa452f-1jammy radosgw=19.0.0-1426-g12fa452f-1jammy python3-rados=19.0.0-1426-g12fa452f-1jammy python3-rgw=19.0.0-1426-g12fa452f-1jammy python3-cephfs=19.0.0-1426-g12fa452f-1jammy python3-rbd=19.0.0-1426-g12fa452f-1jammy libcephfs2=19.0.0-1426-g12fa452f-1jammy libcephfs-dev=19.0.0-1426-g12fa452f-1jammy librados2=19.0.0-1426-g12fa452f-1jammy librbd1=19.0.0-1426-g12fa452f-1jammy rbd-fuse=19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:34:04.604 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-03-20T13:34:04.608 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-03-20T13:34:04.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1426-g12fa452f-1jammy cephadm=19.0.0-1426-g12fa452f-1jammy ceph-mds=19.0.0-1426-g12fa452f-1jammy ceph-mgr=19.0.0-1426-g12fa452f-1jammy ceph-common=19.0.0-1426-g12fa452f-1jammy ceph-fuse=19.0.0-1426-g12fa452f-1jammy ceph-test=19.0.0-1426-g12fa452f-1jammy ceph-volume=19.0.0-1426-g12fa452f-1jammy radosgw=19.0.0-1426-g12fa452f-1jammy python3-rados=19.0.0-1426-g12fa452f-1jammy python3-rgw=19.0.0-1426-g12fa452f-1jammy python3-cephfs=19.0.0-1426-g12fa452f-1jammy python3-rbd=19.0.0-1426-g12fa452f-1jammy libcephfs2=19.0.0-1426-g12fa452f-1jammy libcephfs-dev=19.0.0-1426-g12fa452f-1jammy librados2=19.0.0-1426-g12fa452f-1jammy librbd1=19.0.0-1426-g12fa452f-1jammy rbd-fuse=19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:34:04.672 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-03-20T13:34:04.808 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-03-20T13:34:04.808 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-03-20T13:34:04.844 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-03-20T13:34:04.844 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-20T13:34:04.991 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-20T13:34:04.993 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-03-20T13:34:04.993 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-20T13:34:04.993 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-20T13:34:04.994 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet zip 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-03-20T13:34:04.995 INFO:teuthology.orchestra.run.smithi123.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2024-03-20T13:34:04.996 INFO:teuthology.orchestra.run.smithi123.stdout: btrfs-tools 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-20T13:34:05.003 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-20T13:34:05.004 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-03-20T13:34:05.004 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-20T13:34:05.004 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-20T13:34:05.004 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-20T13:34:05.004 INFO:teuthology.orchestra.run.smithi089.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-20T13:34:05.004 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-20T13:34:05.005 INFO:teuthology.orchestra.run.smithi089.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-20T13:34:05.005 INFO:teuthology.orchestra.run.smithi089.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-20T13:34:05.005 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-20T13:34:05.005 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-20T13:34:05.006 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet zip 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-20T13:34:05.007 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2024-03-20T13:34:05.008 INFO:teuthology.orchestra.run.smithi089.stdout: btrfs-tools 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-20T13:34:05.097 INFO:teuthology.orchestra.run.smithi123.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-20T13:34:05.098 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-20T13:34:05.099 INFO:teuthology.orchestra.run.smithi123.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-20T13:34:05.107 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-03-20T13:34:05.107 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-20T13:34:05.107 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-20T13:34:05.107 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-20T13:34:05.108 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-20T13:34:05.108 INFO:teuthology.orchestra.run.smithi089.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-20T13:34:05.108 INFO:teuthology.orchestra.run.smithi089.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-20T13:34:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-20T13:34:05.110 INFO:teuthology.orchestra.run.smithi089.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-20T13:34:05.175 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 118 newly installed, 0 to remove and 285 not upgraded. 2024-03-20T13:34:05.175 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 176 MB of archives. 2024-03-20T13:34:05.175 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 729 MB of additional disk space will be used. 2024-03-20T13:34:05.175 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-20T13:34:05.291 INFO:teuthology.orchestra.run.smithi123.stdout:0 upgraded, 118 newly installed, 0 to remove and 285 not upgraded. 2024-03-20T13:34:05.291 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 176 MB of archives. 2024-03-20T13:34:05.291 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 729 MB of additional disk space will be used. 2024-03-20T13:34:05.291 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-20T13:34:05.320 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-20T13:34:05.324 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-20T13:34:05.344 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-20T13:34:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-20T13:34:05.417 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-20T13:34:05.429 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-20T13:34:05.433 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-20T13:34:05.433 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-20T13:34:05.434 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-20T13:34:05.445 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1426-g12fa452f-1jammy [3,535 kB] 2024-03-20T13:34:05.446 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-20T13:34:05.448 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-20T13:34:05.450 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-20T13:34:05.452 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-20T13:34:05.457 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-20T13:34:05.460 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-20T13:34:05.462 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-20T13:34:05.464 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-20T13:34:05.465 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-20T13:34:05.477 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-20T13:34:05.479 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-20T13:34:05.479 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-20T13:34:05.479 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-20T13:34:05.479 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-20T13:34:05.497 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-20T13:34:05.498 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-20T13:34:05.498 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-20T13:34:05.501 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-20T13:34:05.502 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-20T13:34:05.517 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-20T13:34:05.517 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-20T13:34:05.519 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-20T13:34:05.519 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-20T13:34:05.519 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-20T13:34:05.522 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1426-g12fa452f-1jammy [3,535 kB] 2024-03-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-20T13:34:05.557 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-20T13:34:05.558 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-20T13:34:05.559 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-20T13:34:05.562 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-20T13:34:05.562 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-20T13:34:05.577 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-20T13:34:05.578 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-20T13:34:05.580 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-20T13:34:05.581 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-20T13:34:05.582 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-20T13:34:05.596 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-20T13:34:05.654 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-20T13:34:05.655 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-20T13:34:05.656 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-20T13:34:05.656 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-20T13:34:05.657 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-20T13:34:05.676 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-20T13:34:05.678 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-20T13:34:05.678 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-20T13:34:05.694 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-20T13:34:05.694 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-20T13:34:05.697 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-20T13:34:05.698 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-20T13:34:05.698 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-20T13:34:05.698 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-20T13:34:05.715 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-20T13:34:05.716 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-20T13:34:05.716 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-20T13:34:05.719 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-20T13:34:05.721 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-20T13:34:05.722 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-20T13:34:05.723 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-20T13:34:05.727 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-20T13:34:05.735 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-20T13:34:05.738 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-20T13:34:05.738 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-20T13:34:05.739 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-20T13:34:05.755 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-20T13:34:05.756 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-20T13:34:05.776 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-20T13:34:05.776 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-20T13:34:05.784 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-20T13:34:05.784 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-20T13:34:05.795 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-20T13:34:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-20T13:34:05.798 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-20T13:34:05.808 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-20T13:34:05.960 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1426-g12fa452f-1jammy [3,211 kB] 2024-03-20T13:34:06.041 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-20T13:34:06.050 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-20T13:34:06.082 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-20T13:34:06.091 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-20T13:34:06.092 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-20T13:34:06.093 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-20T13:34:06.104 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1426-g12fa452f-1jammy [710 kB] 2024-03-20T13:34:06.111 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-20T13:34:06.126 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1426-g12fa452f-1jammy [356 kB] 2024-03-20T13:34:06.158 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1426-g12fa452f-1jammy [32.8 kB] 2024-03-20T13:34:06.166 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1426-g12fa452f-1jammy [180 kB] 2024-03-20T13:34:06.191 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1426-g12fa452f-1jammy [64.8 kB] 2024-03-20T13:34:06.279 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-20T13:34:06.314 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1426-g12fa452f-1jammy [330 kB] 2024-03-20T13:34:06.349 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1426-g12fa452f-1jammy [6,560 kB] 2024-03-20T13:34:06.473 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1426-g12fa452f-1jammy [3,211 kB] 2024-03-20T13:34:06.686 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-20T13:34:06.692 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1426-g12fa452f-1jammy [112 kB] 2024-03-20T13:34:06.694 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1426-g12fa452f-1jammy [465 kB] 2024-03-20T13:34:06.703 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1426-g12fa452f-1jammy [24.1 MB] 2024-03-20T13:34:06.718 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-20T13:34:06.721 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-20T13:34:06.741 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1426-g12fa452f-1jammy [710 kB] 2024-03-20T13:34:06.800 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1426-g12fa452f-1jammy [356 kB] 2024-03-20T13:34:06.800 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-20T13:34:06.831 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1426-g12fa452f-1jammy [32.8 kB] 2024-03-20T13:34:06.833 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1426-g12fa452f-1jammy [180 kB] 2024-03-20T13:34:06.852 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-20T13:34:06.856 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1426-g12fa452f-1jammy [64.8 kB] 2024-03-20T13:34:06.859 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1426-g12fa452f-1jammy [330 kB] 2024-03-20T13:34:06.874 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-20T13:34:06.881 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-20T13:34:06.882 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-20T13:34:06.883 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1426-g12fa452f-1jammy [6,560 kB] 2024-03-20T13:34:06.894 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-20T13:34:06.894 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-20T13:34:07.060 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-20T13:34:07.143 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-20T13:34:07.172 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-20T13:34:07.233 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-20T13:34:07.444 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-20T13:34:07.459 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-20T13:34:07.463 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1426-g12fa452f-1jammy [112 kB] 2024-03-20T13:34:07.466 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-20T13:34:07.471 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1426-g12fa452f-1jammy [465 kB] 2024-03-20T13:34:07.471 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-20T13:34:07.493 INFO:teuthology.orchestra.run.smithi123.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-20T13:34:07.496 INFO:teuthology.orchestra.run.smithi123.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-20T13:34:07.510 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1426-g12fa452f-1jammy [24.1 MB] 2024-03-20T13:34:07.663 INFO:teuthology.orchestra.run.smithi123.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-20T13:34:07.994 INFO:teuthology.orchestra.run.smithi123.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-20T13:34:08.002 INFO:teuthology.orchestra.run.smithi123.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1426-g12fa452f-1jammy [5,073 kB] 2024-03-20T13:34:08.025 INFO:teuthology.orchestra.run.smithi123.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-20T13:34:08.035 INFO:teuthology.orchestra.run.smithi123.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-20T13:34:08.219 INFO:teuthology.orchestra.run.smithi123.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1426-g12fa452f-1jammy [243 kB] 2024-03-20T13:34:08.230 INFO:teuthology.orchestra.run.smithi123.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1426-g12fa452f-1jammy [124 kB] 2024-03-20T13:34:08.236 INFO:teuthology.orchestra.run.smithi123.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1426-g12fa452f-1jammy [1,518 kB] 2024-03-20T13:34:08.237 INFO:teuthology.orchestra.run.smithi123.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-20T13:34:08.239 INFO:teuthology.orchestra.run.smithi123.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-20T13:34:08.245 INFO:teuthology.orchestra.run.smithi123.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-20T13:34:08.251 INFO:teuthology.orchestra.run.smithi123.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-20T13:34:08.266 INFO:teuthology.orchestra.run.smithi123.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-20T13:34:08.288 INFO:teuthology.orchestra.run.smithi123.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-20T13:34:08.294 INFO:teuthology.orchestra.run.smithi123.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-20T13:34:08.317 INFO:teuthology.orchestra.run.smithi123.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1426-g12fa452f-1jammy [6,240 kB] 2024-03-20T13:34:08.468 INFO:teuthology.orchestra.run.smithi123.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi123.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1426-g12fa452f-1jammy [22.7 MB] 2024-03-20T13:34:08.731 INFO:teuthology.orchestra.run.smithi123.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-20T13:34:08.910 INFO:teuthology.orchestra.run.smithi123.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-20T13:34:08.924 INFO:teuthology.orchestra.run.smithi123.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-20T13:34:08.944 INFO:teuthology.orchestra.run.smithi123.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-20T13:34:09.008 INFO:teuthology.orchestra.run.smithi123.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-20T13:34:09.297 INFO:teuthology.orchestra.run.smithi123.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-20T13:34:09.299 INFO:teuthology.orchestra.run.smithi123.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-20T13:34:09.301 INFO:teuthology.orchestra.run.smithi123.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-20T13:34:09.301 INFO:teuthology.orchestra.run.smithi123.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-20T13:34:09.304 INFO:teuthology.orchestra.run.smithi123.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-20T13:34:09.526 INFO:teuthology.orchestra.run.smithi123.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-20T13:34:09.891 INFO:teuthology.orchestra.run.smithi123.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1426-g12fa452f-1jammy [14.1 kB] 2024-03-20T13:34:09.892 INFO:teuthology.orchestra.run.smithi123.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1426-g12fa452f-1jammy [865 kB] 2024-03-20T13:34:09.909 INFO:teuthology.orchestra.run.smithi123.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1426-g12fa452f-1jammy [2,185 kB] 2024-03-20T13:34:09.946 INFO:teuthology.orchestra.run.smithi123.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1426-g12fa452f-1jammy [776 kB] 2024-03-20T13:34:09.969 INFO:teuthology.orchestra.run.smithi123.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1426-g12fa452f-1jammy [144 kB] 2024-03-20T13:34:09.973 INFO:teuthology.orchestra.run.smithi123.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-20T13:34:09.974 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1426-g12fa452f-1jammy [5,073 kB] 2024-03-20T13:34:09.979 INFO:teuthology.orchestra.run.smithi123.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-20T13:34:09.981 INFO:teuthology.orchestra.run.smithi123.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1426-g12fa452f-1jammy [1,920 kB] 2024-03-20T13:34:10.071 INFO:teuthology.orchestra.run.smithi123.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1426-g12fa452f-1jammy [8,625 kB] 2024-03-20T13:34:10.207 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1426-g12fa452f-1jammy [243 kB] 2024-03-20T13:34:10.234 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1426-g12fa452f-1jammy [124 kB] 2024-03-20T13:34:10.245 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1426-g12fa452f-1jammy [1,518 kB] 2024-03-20T13:34:10.268 INFO:teuthology.orchestra.run.smithi123.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-20T13:34:10.269 INFO:teuthology.orchestra.run.smithi123.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-20T13:34:10.271 INFO:teuthology.orchestra.run.smithi123.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-20T13:34:10.272 INFO:teuthology.orchestra.run.smithi123.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-20T13:34:10.274 INFO:teuthology.orchestra.run.smithi123.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-20T13:34:10.276 INFO:teuthology.orchestra.run.smithi123.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-20T13:34:10.277 INFO:teuthology.orchestra.run.smithi123.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-20T13:34:10.279 INFO:teuthology.orchestra.run.smithi123.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-20T13:34:10.410 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1426-g12fa452f-1jammy [6,240 kB] 2024-03-20T13:34:10.461 INFO:teuthology.orchestra.run.smithi123.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-20T13:34:10.476 INFO:teuthology.orchestra.run.smithi123.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1426-g12fa452f-1jammy [14.2 kB] 2024-03-20T13:34:10.480 INFO:teuthology.orchestra.run.smithi123.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1426-g12fa452f-1jammy [49.9 MB] 2024-03-20T13:34:10.869 INFO:teuthology.orchestra.run.smithi123.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-20T13:34:10.915 INFO:teuthology.orchestra.run.smithi123.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-20T13:34:10.934 INFO:teuthology.orchestra.run.smithi123.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-20T13:34:11.047 INFO:teuthology.orchestra.run.smithi123.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-20T13:34:11.085 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1426-g12fa452f-1jammy [22.7 MB] 2024-03-20T13:34:11.088 INFO:teuthology.orchestra.run.smithi123.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-20T13:34:11.099 INFO:teuthology.orchestra.run.smithi123.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-20T13:34:11.104 INFO:teuthology.orchestra.run.smithi123.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-20T13:34:11.152 INFO:teuthology.orchestra.run.smithi123.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-20T13:34:11.155 INFO:teuthology.orchestra.run.smithi123.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-20T13:34:11.177 INFO:teuthology.orchestra.run.smithi123.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-20T13:34:11.341 INFO:teuthology.orchestra.run.smithi123.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-20T13:34:11.613 INFO:teuthology.orchestra.run.smithi123.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-20T13:34:11.630 INFO:teuthology.orchestra.run.smithi123.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-20T13:34:11.783 INFO:teuthology.orchestra.run.smithi123.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-20T13:34:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-20T13:34:11.971 INFO:teuthology.orchestra.run.smithi123.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-20T13:34:11.973 INFO:teuthology.orchestra.run.smithi123.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-20T13:34:11.974 INFO:teuthology.orchestra.run.smithi123.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-20T13:34:11.997 INFO:teuthology.orchestra.run.smithi123.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-20T13:34:12.002 INFO:teuthology.orchestra.run.smithi123.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-20T13:34:13.078 INFO:teuthology.orchestra.run.smithi123.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1426-g12fa452f-1jammy [121 kB] 2024-03-20T13:34:13.080 INFO:teuthology.orchestra.run.smithi123.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1426-g12fa452f-1jammy [38.4 kB] 2024-03-20T13:34:13.081 INFO:teuthology.orchestra.run.smithi123.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1426-g12fa452f-1jammy [13.0 MB] 2024-03-20T13:34:13.520 INFO:teuthology.orchestra.run.smithi123.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1426-g12fa452f-1jammy [91.5 kB] 2024-03-20T13:34:13.556 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1426-g12fa452f-1jammy [14.1 kB] 2024-03-20T13:34:13.556 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1426-g12fa452f-1jammy [865 kB] 2024-03-20T13:34:13.574 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1426-g12fa452f-1jammy [2,185 kB] 2024-03-20T13:34:13.664 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1426-g12fa452f-1jammy [776 kB] 2024-03-20T13:34:13.701 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1426-g12fa452f-1jammy [144 kB] 2024-03-20T13:34:13.704 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1426-g12fa452f-1jammy [1,920 kB] 2024-03-20T13:34:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1426-g12fa452f-1jammy [8,625 kB] 2024-03-20T13:34:14.132 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 176 MB in 8s (20.9 MB/s) 2024-03-20T13:34:14.241 INFO:teuthology.orchestra.run.smithi089.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1426-g12fa452f-1jammy [14.2 kB] 2024-03-20T13:34:14.241 INFO:teuthology.orchestra.run.smithi089.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1426-g12fa452f-1jammy [49.9 MB] 2024-03-20T13:34:14.292 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-20T13:34:14.392 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-20T13:34:14.397 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-20T13:34:14.482 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-20T13:34:14.811 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-20T13:34:14.837 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-20T13:34:14.877 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-20T13:34:15.197 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-20T13:34:15.223 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-20T13:34:15.263 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-20T13:34:15.708 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-20T13:34:15.735 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-20T13:34:15.783 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:34:16.153 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-20T13:34:16.179 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-20T13:34:16.219 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:34:16.531 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-20T13:34:16.557 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-20T13:34:16.597 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:34:16.942 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-20T13:34:16.968 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-20T13:34:17.008 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-20T13:34:17.328 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librados2. 2024-03-20T13:34:17.354 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../007-librados2_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:17.395 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librados2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:17.789 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librbd1. 2024-03-20T13:34:17.815 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../008-librbd1_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:17.820 INFO:teuthology.orchestra.run.smithi089.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1426-g12fa452f-1jammy [121 kB] 2024-03-20T13:34:17.823 INFO:teuthology.orchestra.run.smithi089.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1426-g12fa452f-1jammy [38.4 kB] 2024-03-20T13:34:17.824 INFO:teuthology.orchestra.run.smithi089.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1426-g12fa452f-1jammy [13.0 MB] 2024-03-20T13:34:17.847 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librbd1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:18.275 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs2. 2024-03-20T13:34:18.302 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:18.314 INFO:teuthology.orchestra.run.smithi089.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1426-g12fa452f-1jammy [91.5 kB] 2024-03-20T13:34:18.341 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:18.602 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rados. 2024-03-20T13:34:18.617 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:18.813 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rados (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:18.871 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 176 MB in 13s (13.3 MB/s) 2024-03-20T13:34:19.048 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-20T13:34:19.150 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-20T13:34:19.154 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-20T13:34:19.230 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-20T13:34:19.256 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:19.272 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-20T13:34:19.296 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-argparse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:19.516 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cephfs. 2024-03-20T13:34:19.542 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:19.574 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cephfs (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:19.617 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-20T13:34:19.644 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-20T13:34:19.684 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-20T13:34:19.876 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-20T13:34:19.903 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:19.943 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:19.995 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-20T13:34:20.018 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-20T13:34:20.053 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-20T13:34:20.254 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-20T13:34:20.281 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-20T13:34:20.321 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-20T13:34:20.465 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-20T13:34:20.492 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-20T13:34:20.540 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:34:20.617 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-prettytable. 2024-03-20T13:34:20.644 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-20T13:34:20.684 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-20T13:34:20.894 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rbd. 2024-03-20T13:34:20.910 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:20.954 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rbd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:20.960 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-20T13:34:20.987 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-20T13:34:21.027 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:34:21.289 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-20T13:34:21.316 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-20T13:34:21.347 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-20T13:34:21.355 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-20T13:34:21.373 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-20T13:34:21.405 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:34:21.633 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-20T13:34:21.649 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-20T13:34:21.691 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-20T13:34:21.758 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-20T13:34:21.785 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-20T13:34:21.825 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-20T13:34:21.961 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-20T13:34:21.976 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-20T13:34:22.011 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-20T13:34:22.144 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librados2. 2024-03-20T13:34:22.171 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-librados2_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:22.211 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:22.322 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua5.1. 2024-03-20T13:34:22.349 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-20T13:34:22.390 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-20T13:34:22.705 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librbd1. 2024-03-20T13:34:22.708 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua-any. 2024-03-20T13:34:22.732 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-librbd1_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:22.735 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-20T13:34:22.772 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:22.775 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-20T13:34:23.002 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package zip. 2024-03-20T13:34:23.018 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-20T13:34:23.052 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking zip (3.0-12build2) ... 2024-03-20T13:34:23.192 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2024-03-20T13:34:23.218 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:23.258 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:23.389 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package unzip. 2024-03-20T13:34:23.416 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-20T13:34:23.455 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-20T13:34:23.569 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2024-03-20T13:34:23.585 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:23.627 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:23.851 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package luarocks. 2024-03-20T13:34:23.877 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-20T13:34:23.934 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-20T13:34:23.938 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-20T13:34:23.965 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:24.005 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:24.249 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2024-03-20T13:34:24.264 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:24.299 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:24.492 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librgw2. 2024-03-20T13:34:24.519 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../025-librgw2_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:24.558 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librgw2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:24.594 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-20T13:34:24.620 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:24.660 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:24.980 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-20T13:34:25.007 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-20T13:34:25.046 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-20T13:34:25.069 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rgw. 2024-03-20T13:34:25.096 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:25.127 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:25.366 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-prettytable. 2024-03-20T13:34:25.393 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-20T13:34:25.433 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-20T13:34:25.455 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-20T13:34:25.482 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-20T13:34:25.521 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-20T13:34:25.702 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rbd. 2024-03-20T13:34:25.728 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:25.769 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rbd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libradosstriper1. 2024-03-20T13:34:25.860 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:25.899 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libradosstriper1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:26.063 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-20T13:34:26.090 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-20T13:34:26.130 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-20T13:34:26.311 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-common. 2024-03-20T13:34:26.337 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:26.377 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:26.441 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-20T13:34:26.456 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-20T13:34:26.499 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-20T13:34:26.810 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-20T13:34:26.826 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-20T13:34:26.894 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-20T13:34:27.231 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua5.1. 2024-03-20T13:34:27.257 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-20T13:34:27.297 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-20T13:34:27.608 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-any. 2024-03-20T13:34:27.634 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-20T13:34:27.675 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-20T13:34:27.690 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-base. 2024-03-20T13:34:27.717 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:27.766 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-base (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:27.928 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package zip. 2024-03-20T13:34:27.953 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-20T13:34:27.994 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking zip (3.0-12build2) ... 2024-03-20T13:34:28.294 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-20T13:34:28.321 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-20T13:34:28.361 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-20T13:34:28.556 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package unzip. 2024-03-20T13:34:28.582 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-20T13:34:28.622 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-20T13:34:28.664 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cheroot. 2024-03-20T13:34:28.690 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-20T13:34:28.730 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-20T13:34:28.960 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package luarocks. 2024-03-20T13:34:28.986 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-20T13:34:29.026 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-20T13:34:29.058 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-20T13:34:29.085 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-20T13:34:29.125 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-20T13:34:29.384 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2024-03-20T13:34:29.410 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-librgw2_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:29.450 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:29.494 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-20T13:34:29.521 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-20T13:34:29.603 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-20T13:34:29.872 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-20T13:34:29.899 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-20T13:34:29.938 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-20T13:34:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rgw. 2024-03-20T13:34:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:30.069 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:30.241 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempora. 2024-03-20T13:34:30.268 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-20T13:34:30.308 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-20T13:34:30.414 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-20T13:34:30.440 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-20T13:34:30.481 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-20T13:34:30.611 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-portend. 2024-03-20T13:34:30.637 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-20T13:34:30.677 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-20T13:34:30.801 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2024-03-20T13:34:30.827 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:30.867 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:30.938 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-20T13:34:30.965 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-20T13:34:30.996 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-20T13:34:31.291 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-20T13:34:31.295 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2024-03-20T13:34:31.318 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-20T13:34:31.321 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:31.357 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-20T13:34:31.362 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:31.736 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-natsort. 2024-03-20T13:34:31.763 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-20T13:34:31.802 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-20T13:34:32.114 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-logutils. 2024-03-20T13:34:32.141 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-20T13:34:32.180 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-20T13:34:32.450 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-20T13:34:32.477 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-20T13:34:32.509 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-20T13:34:32.684 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2024-03-20T13:34:32.711 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:32.760 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:32.803 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-mako. 2024-03-20T13:34:32.830 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-20T13:34:32.869 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-20T13:34:33.197 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-20T13:34:33.224 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-20T13:34:33.272 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-20T13:34:33.313 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-20T13:34:33.328 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-20T13:34:33.363 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-20T13:34:33.575 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-20T13:34:33.602 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-20T13:34:33.641 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cheroot. 2024-03-20T13:34:33.641 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-20T13:34:33.667 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-20T13:34:33.708 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-20T13:34:33.902 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webob. 2024-03-20T13:34:33.929 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-20T13:34:33.961 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-20T13:34:34.028 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-20T13:34:34.054 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-20T13:34:34.094 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-20T13:34:34.280 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-waitress. 2024-03-20T13:34:34.307 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-20T13:34:34.342 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-20T13:34:34.397 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-20T13:34:34.423 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-20T13:34:34.463 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-20T13:34:34.625 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempita. 2024-03-20T13:34:34.652 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-20T13:34:34.691 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-20T13:34:34.775 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-20T13:34:34.801 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-20T13:34:34.833 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-20T13:34:34.994 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-paste. 2024-03-20T13:34:35.021 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-20T13:34:35.061 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-20T13:34:35.103 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempora. 2024-03-20T13:34:35.129 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-20T13:34:35.169 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-20T13:34:35.397 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-20T13:34:35.424 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-20T13:34:35.463 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-20T13:34:35.480 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-portend. 2024-03-20T13:34:35.507 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-20T13:34:35.547 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-20T13:34:35.783 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-20T13:34:35.810 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-20T13:34:35.850 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-20T13:34:35.875 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-20T13:34:35.901 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-20T13:34:35.942 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-20T13:34:36.153 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webtest. 2024-03-20T13:34:36.179 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-20T13:34:36.219 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-20T13:34:36.278 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-20T13:34:36.304 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-20T13:34:36.353 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-20T13:34:36.497 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pecan. 2024-03-20T13:34:36.524 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-20T13:34:36.563 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-20T13:34:36.715 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-natsort. 2024-03-20T13:34:36.741 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-20T13:34:36.781 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-20T13:34:36.885 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-certifi. 2024-03-20T13:34:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-20T13:34:36.943 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-20T13:34:37.101 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-logutils. 2024-03-20T13:34:37.128 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-20T13:34:37.168 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-20T13:34:37.245 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-idna. 2024-03-20T13:34:37.273 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-20T13:34:37.312 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-20T13:34:37.521 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-20T13:34:37.547 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-20T13:34:37.596 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-20T13:34:37.606 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-urllib3. 2024-03-20T13:34:37.634 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-20T13:34:37.673 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-20T13:34:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-mako. 2024-03-20T13:34:37.900 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-20T13:34:37.940 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-20T13:34:37.984 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests. 2024-03-20T13:34:38.012 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-20T13:34:38.051 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-20T13:34:38.293 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-20T13:34:38.320 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-20T13:34:38.360 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-20T13:34:38.462 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-20T13:34:38.489 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-20T13:34:38.845 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-20T13:34:39.380 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-20T13:34:39.398 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-20T13:34:39.406 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-20T13:34:39.414 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:39.446 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-20T13:34:39.456 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:39.732 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webob. 2024-03-20T13:34:39.759 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-20T13:34:39.799 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-20T13:34:40.028 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-20T13:34:40.055 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:40.094 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:40.146 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-waitress. 2024-03-20T13:34:40.172 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-20T13:34:40.215 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-20T13:34:40.397 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-20T13:34:40.424 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-20T13:34:40.464 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-20T13:34:40.523 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempita. 2024-03-20T13:34:40.550 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-20T13:34:40.590 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-20T13:34:40.775 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-openssl. 2024-03-20T13:34:40.802 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-20T13:34:40.841 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-20T13:34:40.868 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-paste. 2024-03-20T13:34:40.894 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-20T13:34:40.934 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-20T13:34:41.128 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr. 2024-03-20T13:34:41.155 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:41.263 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-20T13:34:41.289 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-20T13:34:41.329 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-20T13:34:41.539 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mon. 2024-03-20T13:34:41.566 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:41.597 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mon (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:41.598 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-20T13:34:41.625 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-20T13:34:41.665 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-20T13:34:41.968 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webtest. 2024-03-20T13:34:41.995 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-20T13:34:42.035 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-20T13:34:42.201 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-osd. 2024-03-20T13:34:42.228 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:42.267 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-osd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:42.371 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pecan. 2024-03-20T13:34:42.398 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-20T13:34:42.437 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-20T13:34:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-certifi. 2024-03-20T13:34:42.811 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-20T13:34:42.850 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-20T13:34:43.154 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-idna. 2024-03-20T13:34:43.180 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-20T13:34:43.220 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-20T13:34:43.304 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph. 2024-03-20T13:34:43.331 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../066-ceph_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:43.370 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:43.532 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-urllib3. 2024-03-20T13:34:43.558 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-20T13:34:43.598 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-20T13:34:43.656 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-fuse. 2024-03-20T13:34:43.683 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:43.722 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:43.935 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests. 2024-03-20T13:34:43.961 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-20T13:34:44.003 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-20T13:34:44.076 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mds. 2024-03-20T13:34:44.103 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:44.142 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mds (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:44.321 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-20T13:34:44.348 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-20T13:34:44.404 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-20T13:34:44.553 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephadm. 2024-03-20T13:34:44.581 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../069-cephadm_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:44.620 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:44.699 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-20T13:34:44.714 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:44.757 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:44.931 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-20T13:34:44.958 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-20T13:34:44.997 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-20T13:34:45.164 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:45.195 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:45.325 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-20T13:34:45.341 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-20T13:34:45.383 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-20T13:34:45.481 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-20T13:34:45.508 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-20T13:34:45.548 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-20T13:34:45.826 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-openssl. 2024-03-20T13:34:45.853 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-20T13:34:45.892 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-20T13:34:46.238 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2024-03-20T13:34:46.264 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:46.304 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:46.346 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-babel. 2024-03-20T13:34:46.374 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-20T13:34:46.412 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-20T13:34:46.724 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2024-03-20T13:34:46.724 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jinja2. 2024-03-20T13:34:46.751 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:46.751 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-20T13:34:46.790 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:46.790 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-20T13:34:47.135 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-20T13:34:47.162 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:47.201 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:47.402 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2024-03-20T13:34:47.429 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:47.468 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:47.488 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-20T13:34:47.504 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-20T13:34:47.546 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-20T13:34:47.882 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-routes. 2024-03-20T13:34:47.909 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-20T13:34:47.957 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-20T13:34:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-20T13:34:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:48.514 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2024-03-20T13:34:48.541 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-ceph_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:48.580 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:48.755 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-20T13:34:48.782 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-20T13:34:48.821 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-20T13:34:48.908 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2024-03-20T13:34:48.935 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:48.974 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:49.300 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-joblib. 2024-03-20T13:34:49.327 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-20T13:34:49.344 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2024-03-20T13:34:49.371 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:49.374 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-20T13:34:49.419 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:49.694 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-20T13:34:49.711 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-20T13:34:49.764 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephadm. 2024-03-20T13:34:49.769 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-20T13:34:49.791 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-cephadm_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:49.830 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:50.072 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn. 2024-03-20T13:34:50.100 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-20T13:34:50.175 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-20T13:34:50.202 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-20T13:34:50.242 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-20T13:34:50.262 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-20T13:34:50.544 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-20T13:34:50.560 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-20T13:34:50.603 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-20T13:34:50.963 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-20T13:34:50.979 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:51.098 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:51.566 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-babel. 2024-03-20T13:34:51.593 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-20T13:34:51.624 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-20T13:34:51.902 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jinja2. 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-20T13:34:51.960 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-20T13:34:51.994 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cachetools. 2024-03-20T13:34:52.021 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-20T13:34:52.060 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-20T13:34:52.272 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-20T13:34:52.299 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:52.329 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-20T13:34:52.338 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:52.357 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-20T13:34:52.387 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-20T13:34:52.633 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-20T13:34:52.649 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-20T13:34:52.649 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-20T13:34:52.664 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-20T13:34:52.691 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-20T13:34:52.699 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-20T13:34:52.986 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rsa. 2024-03-20T13:34:52.994 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-routes. 2024-03-20T13:34:53.012 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-20T13:34:53.021 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-20T13:34:53.052 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-20T13:34:53.060 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-20T13:34:53.372 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-google-auth. 2024-03-20T13:34:53.399 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-20T13:34:53.423 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-20T13:34:53.439 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-20T13:34:53.450 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:53.489 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:53.758 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-20T13:34:53.785 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-20T13:34:53.825 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-20T13:34:53.942 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-20T13:34:53.958 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-20T13:34:53.992 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-20T13:34:54.111 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-websocket. 2024-03-20T13:34:54.127 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-20T13:34:54.161 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-20T13:34:54.422 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-20T13:34:54.450 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-20T13:34:54.480 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-20T13:34:54.487 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-joblib. 2024-03-20T13:34:54.503 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-20T13:34:54.537 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-20T13:34:54.866 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-20T13:34:54.893 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-20T13:34:54.924 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-20T13:34:55.136 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-20T13:34:55.164 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:55.177 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn. 2024-03-20T13:34:55.203 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:55.203 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-20T13:34:55.243 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-20T13:34:55.522 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-20T13:34:55.549 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-20T13:34:55.588 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-20T13:34:55.917 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-20T13:34:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-20T13:34:55.977 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-20T13:34:55.983 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-20T13:34:56.004 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:56.137 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:56.210 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package jq. 2024-03-20T13:34:56.226 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-20T13:34:56.260 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-20T13:34:56.505 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package socat. 2024-03-20T13:34:56.520 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-20T13:34:56.563 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-20T13:34:56.875 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package xmlstarlet. 2024-03-20T13:34:56.902 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-20T13:34:56.941 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-20T13:34:57.116 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cachetools. 2024-03-20T13:34:57.143 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-20T13:34:57.182 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-20T13:34:57.303 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-test. 2024-03-20T13:34:57.319 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:57.361 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-test (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:57.485 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-20T13:34:57.512 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-20T13:34:57.551 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-20T13:34:57.922 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-20T13:34:57.949 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-20T13:34:57.988 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-20T13:34:58.308 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rsa. 2024-03-20T13:34:58.335 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-20T13:34:58.374 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-20T13:34:58.662 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-google-auth. 2024-03-20T13:34:58.689 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-20T13:34:58.729 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-20T13:34:59.048 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-20T13:34:59.075 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-20T13:34:59.140 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-20T13:34:59.541 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-volume. 2024-03-20T13:34:59.568 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:34:59.599 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-volume (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:34:59.684 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-websocket. 2024-03-20T13:34:59.712 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-20T13:34:59.751 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-20T13:34:59.879 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-20T13:34:59.895 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:34:59.929 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs-dev (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:00.230 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-20T13:35:00.256 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-20T13:35:00.265 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-20T13:35:00.293 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-20T13:35:00.295 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-20T13:35:00.332 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-20T13:35:00.792 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-20T13:35:00.819 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-20T13:35:00.945 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-20T13:35:00.951 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-20T13:35:00.979 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:35:01.018 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:01.307 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package nvme-cli. 2024-03-20T13:35:01.321 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-20T13:35:01.335 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-20T13:35:01.349 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-20T13:35:01.374 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-20T13:35:01.387 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-20T13:35:01.757 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-20T13:35:01.785 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-20T13:35:01.795 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package pkg-config. 2024-03-20T13:35:01.820 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-20T13:35:01.823 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-20T13:35:01.862 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-20T13:35:02.085 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2024-03-20T13:35:02.098 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-20T13:35:02.100 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-20T13:35:02.114 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-20T13:35:02.143 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-20T13:35:02.148 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-20T13:35:02.388 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2024-03-20T13:35:02.415 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-20T13:35:02.446 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-20T13:35:02.568 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-20T13:35:02.596 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-20T13:35:02.634 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-20T13:35:02.734 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2024-03-20T13:35:02.760 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-20T13:35:02.799 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-20T13:35:02.929 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastescript. 2024-03-20T13:35:02.957 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-20T13:35:02.987 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-20T13:35:03.161 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2024-03-20T13:35:03.177 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:35:03.219 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:03.291 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pluggy. 2024-03-20T13:35:03.318 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-20T13:35:03.357 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-20T13:35:03.668 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-psutil. 2024-03-20T13:35:03.696 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-20T13:35:03.734 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-20T13:35:04.079 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-py. 2024-03-20T13:35:04.107 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-20T13:35:04.146 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-20T13:35:04.474 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pygments. 2024-03-20T13:35:04.502 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-20T13:35:04.540 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-20T13:35:04.961 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-20T13:35:04.989 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-20T13:35:05.036 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-20T13:35:05.347 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-toml. 2024-03-20T13:35:05.375 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-20T13:35:05.413 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-20T13:35:05.574 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-volume. 2024-03-20T13:35:05.602 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1426-g12fa452f-1jammy_all.deb ... 2024-03-20T13:35:05.641 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-volume (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:05.716 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pytest. 2024-03-20T13:35:05.744 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-20T13:35:05.783 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-20T13:35:05.936 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-20T13:35:05.952 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:35:05.994 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:06.128 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplejson. 2024-03-20T13:35:06.155 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-20T13:35:06.202 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-20T13:35:06.314 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-20T13:35:06.341 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-20T13:35:06.380 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-20T13:35:06.472 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-20T13:35:06.488 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-20T13:35:06.530 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-20T13:35:06.685 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-20T13:35:06.712 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-20T13:35:06.743 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-20T13:35:07.206 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2024-03-20T13:35:07.233 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-20T13:35:07.234 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package radosgw. 2024-03-20T13:35:07.262 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../116-radosgw_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-20T13:35:07.300 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking radosgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:07.694 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pkg-config. 2024-03-20T13:35:07.721 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-20T13:35:07.760 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-20T13:35:08.030 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-20T13:35:08.046 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-20T13:35:08.080 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-20T13:35:08.086 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package rbd-fuse. 2024-03-20T13:35:08.103 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:35:08.136 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking rbd-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:08.449 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-20T13:35:08.517 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-20T13:35:08.544 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-20T13:35:08.583 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-20T13:35:08.700 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-20T13:35:08.825 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-20T13:35:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastescript. 2024-03-20T13:35:08.863 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-20T13:35:08.894 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-20T13:35:09.091 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-20T13:35:09.239 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pluggy. 2024-03-20T13:35:09.267 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-20T13:35:09.306 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-20T13:35:09.411 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-20T13:35:09.592 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-psutil. 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi123.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-20T13:35:09.919 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-py. 2024-03-20T13:35:10.014 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-20T13:35:10.061 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-20T13:35:10.356 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pygments. 2024-03-20T13:35:10.380 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user cephadm....done 2024-03-20T13:35:10.384 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-20T13:35:10.533 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-20T13:35:10.818 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-20T13:35:10.860 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-20T13:35:10.888 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-toml. 2024-03-20T13:35:11.291 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-20T13:35:11.329 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-20T13:35:11.412 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pytest. 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-20T13:35:11.663 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-20T13:35:11.699 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-20T13:35:12.040 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-20T13:35:12.044 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplejson. 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-20T13:35:12.110 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-20T13:35:12.342 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-20T13:35:12.380 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-20T13:35:12.407 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-20T13:35:12.446 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-20T13:35:13.221 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-20T13:35:13.225 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2024-03-20T13:35:13.254 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../116-radosgw_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:35:13.292 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:13.481 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-20T13:35:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-20T13:35:14.000 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-20T13:35:14.103 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2024-03-20T13:35:14.131 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1426-g12fa452f-1jammy_amd64.deb ... 2024-03-20T13:35:14.169 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:14.259 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-argparse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:14.449 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-20T13:35:14.526 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-20T13:35:14.636 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-20T13:35:14.699 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-20T13:35:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-20T13:35:14.880 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-20T13:35:15.096 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-20T13:35:15.131 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-20T13:35:15.445 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-20T13:35:15.543 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-20T13:35:15.578 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-20T13:35:15.642 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-20T13:35:15.776 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-20T13:35:15.853 INFO:teuthology.orchestra.run.smithi089.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-20T13:35:16.262 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-20T13:35:16.421 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user cephadm....done 2024-03-20T13:35:16.543 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-20T13:35:16.563 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-20T13:35:16.831 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-20T13:35:16.835 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-20T13:35:17.096 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-20T13:35:17.132 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up zip (3.0-12build2) ... 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-20T13:35:17.258 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-20T13:35:17.431 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-20T13:35:17.682 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-20T13:35:17.808 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-20T13:35:18.110 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-20T13:35:18.153 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-20T13:35:18.479 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-20T13:35:18.681 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-20T13:35:18.706 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-20T13:35:18.964 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-20T13:35:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-20T13:35:19.183 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-20T13:35:19.316 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-20T13:35:19.434 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-20T13:35:19.684 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-20T13:35:19.685 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-20T13:35:19.936 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:19.986 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-20T13:35:20.262 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-20T13:35:20.295 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-20T13:35:20.373 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-20T13:35:20.499 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-20T13:35:20.546 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-20T13:35:20.647 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-20T13:35:20.697 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:20.901 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-20T13:35:20.999 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-idna (3.3-1) ... 2024-03-20T13:35:21.302 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-20T13:35:21.316 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-20T13:35:21.333 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-20T13:35:21.382 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-20T13:35:21.480 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-20T13:35:21.840 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-20T13:35:21.966 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-20T13:35:22.225 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-20T13:35:22.439 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-20T13:35:22.501 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-20T13:35:22.690 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:35:22.803 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up zip (3.0-12build2) ... 2024-03-20T13:35:22.824 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-20T13:35:22.929 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-20T13:35:23.100 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-20T13:35:23.226 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-20T13:35:23.328 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-20T13:35:23.604 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-20T13:35:23.614 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-20T13:35:23.863 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-20T13:35:23.874 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-20T13:35:23.974 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-20T13:35:24.084 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-20T13:35:24.114 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:35:24.240 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-20T13:35:24.418 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-20T13:35:24.533 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-20T13:35:24.793 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-20T13:35:24.836 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-20T13:35:25.044 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-20T13:35:25.087 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-20T13:35:25.278 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-20T13:35:25.447 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-20T13:35:25.663 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-20T13:35:25.765 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-20T13:35:25.922 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-20T13:35:26.048 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-20T13:35:26.109 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-20T13:35:26.324 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-20T13:35:26.359 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-20T13:35:26.450 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-20T13:35:26.485 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:26.743 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-20T13:35:26.778 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-idna (3.3-1) ... 2024-03-20T13:35:27.044 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-20T13:35:27.096 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-20T13:35:27.278 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-20T13:35:27.405 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-20T13:35:27.547 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-20T13:35:27.637 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-20T13:35:27.899 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-20T13:35:28.025 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-20T13:35:28.335 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-20T13:35:28.426 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-20T13:35:28.579 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:35:28.677 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-20T13:35:28.688 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-20T13:35:28.810 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-20T13:35:28.948 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-20T13:35:29.049 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-20T13:35:29.063 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:35:29.150 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-20T13:35:29.189 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-20T13:35:29.426 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-20T13:35:29.506 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-20T13:35:29.677 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-20T13:35:29.808 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-20T13:35:30.100 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-20T13:35:30.226 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-20T13:35:30.253 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:35:30.362 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-20T13:35:30.486 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-20T13:35:30.664 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-20T13:35:30.745 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-20T13:35:30.907 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-20T13:35:31.082 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-20T13:35:31.158 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-20T13:35:31.401 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-20T13:35:31.466 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-20T13:35:31.651 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-20T13:35:31.743 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-20T13:35:31.911 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-20T13:35:32.029 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-20T13:35:32.121 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-20T13:35:32.247 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librados2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:32.288 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-20T13:35:32.373 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:32.406 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-20T13:35:32.499 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-20T13:35:32.674 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-20T13:35:32.843 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:32.950 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-20T13:35:32.978 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libradosstriper1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:33.104 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-20T13:35:33.201 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-20T13:35:33.327 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-20T13:35:33.380 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librbd1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:33.453 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-20T13:35:33.506 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-modules-core (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:33.542 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-20T13:35:33.632 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:33.805 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-20T13:35:33.846 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-20T13:35:33.846 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-20T13:35:33.922 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs-dev (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:34.324 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-20T13:35:34.426 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rados (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librgw2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-20T13:35:34.661 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-20T13:35:34.693 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-20T13:35:34.960 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-20T13:35:35.086 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-20T13:35:35.396 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-20T13:35:35.689 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-20T13:35:35.883 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rbd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:35.973 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-20T13:35:36.007 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up rbd-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:36.124 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-20T13:35:36.133 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:36.251 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cephfs (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:36.360 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:36.383 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-20T13:35:36.651 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-20T13:35:36.879 INFO:teuthology.orchestra.run.smithi123.stdout:Adding group ceph....done 2024-03-20T13:35:36.988 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-20T13:35:37.196 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user ceph....done 2024-03-20T13:35:37.323 INFO:teuthology.orchestra.run.smithi123.stdout:Setting system user ceph properties....done 2024-03-20T13:35:37.342 INFO:teuthology.orchestra.run.smithi123.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-20T13:35:37.356 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-20T13:35:37.484 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-20T13:35:37.625 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-20T13:35:37.789 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-20T13:35:37.961 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-20T13:35:38.087 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:38.213 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:38.236 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-test (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:38.356 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-20T13:35:38.362 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up radosgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:38.634 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:38.759 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:38.815 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:35:38.815 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:35:38.886 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-20T13:35:39.154 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:39.255 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-modules-core (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:39.264 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-base (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:39.364 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:39.580 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-20T13:35:39.580 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-20T13:35:39.610 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-20T13:35:40.099 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:40.100 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mds (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:40.225 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:40.321 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-20T13:35:40.322 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-20T13:35:40.351 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:40.477 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-20T13:35:40.784 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-20T13:35:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-20T13:35:41.453 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-osd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:41.681 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rbd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:41.724 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-20T13:35:41.725 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-20T13:35:41.782 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:41.883 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:41.992 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:42.118 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:42.196 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:42.331 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:42.653 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2024-03-20T13:35:42.799 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mon (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:42.994 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-20T13:35:42.994 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-20T13:35:43.038 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2024-03-20T13:35:43.181 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2024-03-20T13:35:43.199 INFO:teuthology.orchestra.run.smithi089.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-20T13:35:43.332 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-20T13:35:43.484 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:43.624 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-20T13:35:43.626 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:43.752 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-dashboard (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:43.912 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-volume (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:44.078 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:44.204 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:44.265 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-20T13:35:44.374 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-20T13:35:44.518 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-20T13:35:44.658 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:35:44.658 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:35:45.131 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:45.451 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-20T13:35:45.643 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-20T13:35:45.918 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:46.221 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-20T13:35:46.221 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-20T13:35:46.272 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-20T13:35:46.277 DEBUG:teuthology.parallel:result is None 2024-03-20T13:35:46.694 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:46.896 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-20T13:35:46.896 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-20T13:35:47.354 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:47.635 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-20T13:35:47.635 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-20T13:35:48.089 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:48.198 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:48.324 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:48.522 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-20T13:35:48.522 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-20T13:35:49.009 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-cephadm (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:49.160 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:49.286 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:49.437 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-volume (19.0.0-1426-g12fa452f-1jammy) ... 2024-03-20T13:35:49.782 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-20T13:35:49.874 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-20T13:35:50.010 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-20T13:35:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-20T13:35:51.464 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-20T13:35:51.469 DEBUG:teuthology.parallel:result is None 2024-03-20T13:35:51.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:35:51.684 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2024-03-20T13:35:51.704 INFO:teuthology.orchestra.run.smithi089.stdout:19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:35:51.704 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:35:51.705 INFO:teuthology.task.install:The correct ceph version 19.0.0-1426-g12fa452f-1jammy is installed. 2024-03-20T13:35:51.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:35:51.923 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-query -W -f '${Version}' ceph 2024-03-20T13:35:51.943 INFO:teuthology.orchestra.run.smithi123.stdout:19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:35:51.943 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1426-g12fa452f-1jammy 2024-03-20T13:35:51.943 INFO:teuthology.task.install:The correct ceph version 19.0.0-1426-g12fa452f-1jammy is installed. 2024-03-20T13:35:51.946 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-20T13:35:51.946 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:51.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-20T13:35:51.960 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:51.960 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-20T13:35:52.001 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-20T13:35:52.001 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:52.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-03-20T13:35:52.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-20T13:35:52.068 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:52.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-03-20T13:35:52.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-20T13:35:52.135 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-20T13:35:52.135 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:52.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-20T13:35:52.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-20T13:35:52.200 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:52.201 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-20T13:35:52.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-20T13:35:52.267 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-20T13:35:52.268 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:52.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-03-20T13:35:52.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-20T13:35:52.337 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:52.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-03-20T13:35:52.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-20T13:35:52.402 INFO:teuthology.run_tasks:Running task ceph... 2024-03-20T13:35:52.488 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-20T13:35:52.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-03-20T13:35:52.491 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-03-20T13:35:52.503 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-20T13:35:52.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-20T13:35:52.551 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-20T13:35:52.563 INFO:tasks.ceph:Creating extra log directories... 2024-03-20T13:35:52.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-20T13:35:52.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-20T13:35:52.627 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-20T13:35:52.627 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-20T13:35:52.627 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305', 'branch': 'wip_thotz_update_attrs_from_state_setattrs', 'description': 'rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7612305', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip_thotz_update_attrs_from_state_setattrs'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip_thotz_update_attrs_from_state_setattrs', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}}, 'owner': 'scheduled_amaredia@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4446, 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'sleep_before_teardown': 0, 'suite': 'rgw:singleton', 'suite_branch': 'wip_thotz_update_attrs_from_state_setattrs', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKOSN6JHb/n65YoBGNHUGf8IQTTm58xCM0bYcw6Q83rJH3LwybxnqCEHlnPiL/ZT/Bw8Ix1Go/OTIPeVBhJTz8=', 'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQkSkDgw+Ua/Y5BwKIeHuRzQVFHqxkFwqvyQRRnWyQimem8q3XyJugDl8P31woQxNEF+xC+FEgVJk4U13z/mH4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-20_13:11:42', 'tube': 'smithi', 'user': 'amaredia', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-20T13:35:52.628 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-20T13:35:52.662 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-20T13:35:52.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-03-20T13:35:52.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-03-20T13:35:52.724 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:52.724 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-03-20T13:35:52.770 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-20T13:35:52.770 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-03-20T13:35:52.818 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-20T13:35:52.818 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:52.818 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-03-20T13:35:52.819 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:52.819 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-03-20 13:30:38.167860263 +0000 2024-03-20T13:35:52.819 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-03-20 13:30:37.871862903 +0000 2024-03-20T13:35:52.819 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-03-20 13:30:37.871862903 +0000 2024-03-20T13:35:52.819 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-03-20T13:35:52.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-20T13:35:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-03-20T13:35:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-03-20T13:35:52.872 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000341773 s, 1.5 MB/s 2024-03-20T13:35:52.873 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-20T13:35:52.923 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-03-20T13:35:52.970 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-20T13:35:52.970 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:52.970 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-03-20T13:35:52.971 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:52.971 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-03-20 13:30:38.651855945 +0000 2024-03-20T13:35:52.971 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-03-20 13:30:38.395858228 +0000 2024-03-20T13:35:52.971 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-03-20 13:30:38.395858228 +0000 2024-03-20T13:35:52.971 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-03-20T13:35:52.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-20T13:35:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-03-20T13:35:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-03-20T13:35:53.025 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000411954 s, 1.2 MB/s 2024-03-20T13:35:53.026 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-20T13:35:53.077 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-03-20T13:35:53.125 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-03-20 13:30:39.179851234 +0000 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-03-20 13:30:38.931853447 +0000 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-03-20 13:30:38.931853447 +0000 2024-03-20T13:35:53.126 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-03-20T13:35:53.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-20T13:35:53.180 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-03-20T13:35:53.180 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-03-20T13:35:53.180 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000345357 s, 1.5 MB/s 2024-03-20T13:35:53.181 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-20T13:35:53.231 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-03-20 13:30:39.427849021 +0000 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-03-20 13:30:39.423849058 +0000 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-03-20 13:30:39.423849058 +0000 2024-03-20T13:35:53.278 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-03-20T13:35:53.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-20T13:35:53.332 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-03-20T13:35:53.332 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-03-20T13:35:53.332 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000280971 s, 1.8 MB/s 2024-03-20T13:35:53.333 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-20T13:35:53.383 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-03-20T13:35:53.383 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:53.384 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-03-20T13:35:53.390 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-20T13:35:53.390 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-03-20 13:30:37.433092942 +0000 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-03-20 13:30:37.129095657 +0000 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-03-20 13:30:37.129095657 +0000 2024-03-20T13:35:53.437 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-03-20T13:35:53.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-20T13:35:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-03-20T13:35:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-03-20T13:35:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000417621 s, 1.2 MB/s 2024-03-20T13:35:53.492 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-20T13:35:53.541 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-03-20T13:35:53.587 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-03-20 13:30:37.965088189 +0000 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-03-20 13:30:37.681090726 +0000 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-03-20 13:30:37.681090726 +0000 2024-03-20T13:35:53.588 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-03-20T13:35:53.588 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-20T13:35:53.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-03-20T13:35:53.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-03-20T13:35:53.642 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.00033947 s, 1.5 MB/s 2024-03-20T13:35:53.643 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-20T13:35:53.693 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-03-20T13:35:53.739 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-20T13:35:53.739 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:53.740 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-03-20T13:35:53.740 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:53.740 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-03-20 13:30:38.429084045 +0000 2024-03-20T13:35:53.740 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-03-20 13:30:38.173086331 +0000 2024-03-20T13:35:53.740 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-03-20 13:30:38.173086331 +0000 2024-03-20T13:35:53.740 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-03-20T13:35:53.740 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-20T13:35:53.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-03-20T13:35:53.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-03-20T13:35:53.794 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000446293 s, 1.1 MB/s 2024-03-20T13:35:53.795 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-20T13:35:53.845 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-03-20T13:35:53.891 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-03-20 13:30:38.901079829 +0000 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-03-20 13:30:38.657082008 +0000 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-03-20 13:30:38.657082008 +0000 2024-03-20T13:35:53.892 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-03-20T13:35:53.892 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-20T13:35:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-03-20T13:35:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-03-20T13:35:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000273866 s, 1.9 MB/s 2024-03-20T13:35:53.948 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-20T13:35:53.996 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:35:53.996 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-03-20T13:35:53.996 INFO:tasks.ceph:Generating config... 2024-03-20T13:35:53.997 INFO:tasks.ceph:[client] debug ms = 1 2024-03-20T13:35:53.997 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-03-20T13:35:53.998 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-20T13:35:53.998 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-20T13:35:53.998 INFO:tasks.ceph:[client] setuser = ceph 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] debug objclass = 20 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-20T13:35:53.998 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-20T13:35:53.999 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-20T13:35:53.999 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-20T13:35:53.999 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-20T13:35:53.999 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-20T13:35:53.999 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-20T13:35:53.999 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-20T13:35:53.999 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-20T13:35:53.999 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-20T13:35:53.999 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-20T13:35:53.999 INFO:tasks.ceph:Setting up mon.a... 2024-03-20T13:35:53.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-20T13:35:54.034 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2024-03-20T13:35:54.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-20T13:35:54.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-20T13:35:54.180 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89')] 2024-03-20T13:35:54.181 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-03-20T13:35:54.181 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:54.181 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-20T13:35:54.226 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:35:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:35:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid cda039e5-cc53-45cd-8008-4f57580e2f4e 2024-03-20T13:35:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = quincy 2024-03-20T13:35:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2024-03-20T13:35:54.305 INFO:teuthology.orchestra.run.smithi089.stdout:fsid cda039e5-cc53-45cd-8008-4f57580e2f4e 2024-03-20T13:35:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2024-03-20T13:35:54.308967+0000 2024-03-20T13:35:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-03-20T13:35:54.308967+0000 2024-03-20T13:35:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 17 (quincy) 2024-03-20T13:35:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2024-03-20T13:35:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-03-20T13:35:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-03-20T13:35:54.307 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-20T13:35:54.354 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cda039e5-cc53-45cd-8008-4f57580e2f4e... 2024-03-20T13:35:54.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-20T13:35:54.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-20T13:35:54.428 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-03-20T13:35:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-03-20T13:35:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-20T13:35:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-03-20T13:35:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.428 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.429 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-20T13:35:54.430 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = 172.21.15.89 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = cda039e5-cc53-45cd-8008-4f57580e2f4e 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-03-20T13:35:54.431 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-03-20T13:35:54.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: debug objclass = 20 2024-03-20T13:35:54.433 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-03-20T13:35:54.434 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-03-20T13:35:54.435 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.436 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: rgw gc obj min wait = 15 2024-03-20T13:35:54.437 INFO:teuthology.orchestra.run.smithi089.stdout: debug rgw = 20 2024-03-20T13:35:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: setgroup = ceph 2024-03-20T13:35:54.438 INFO:teuthology.orchestra.run.smithi089.stdout: setuser = ceph 2024-03-20T13:35:54.438 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-03-20T13:35:54.438 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-03-20T13:35:54.438 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-03-20T13:35:54.438 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.439 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-20T13:35:54.440 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = 172.21.15.89 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = cda039e5-cc53-45cd-8008-4f57580e2f4e 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.441 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-03-20T13:35:54.442 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-03-20T13:35:54.443 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: debug objclass = 20 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-03-20T13:35:54.444 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-03-20T13:35:54.445 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-03-20T13:35:54.446 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: rgw gc obj min wait = 15 2024-03-20T13:35:54.447 INFO:teuthology.orchestra.run.smithi123.stdout: debug rgw = 20 2024-03-20T13:35:54.448 INFO:teuthology.orchestra.run.smithi123.stdout: setgroup = ceph 2024-03-20T13:35:54.448 INFO:teuthology.orchestra.run.smithi123.stdout: setuser = ceph 2024-03-20T13:35:54.448 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-03-20T13:35:54.449 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-20T13:35:54.449 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-20T13:35:54.536 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-20T13:35:54.536 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:54.536 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-20T13:35:54.542 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:54.542 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-20T13:35:54.589 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-03-20T13:35:54.589 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:54.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-20T13:35:54.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-20T13:35:54.654 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:35:54.654 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:35:54.702 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:35:54.702 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:54.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-20T13:35:54.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-20T13:35:54.724 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:35:54.724 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:35:54.772 INFO:tasks.ceph:Setting up mon nodes... 2024-03-20T13:35:54.772 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-20T13:35:54.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-20T13:35:54.856 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-20T13:35:54.869 INFO:tasks.ceph:Setting up mds nodes... 2024-03-20T13:35:54.869 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-20T13:35:54.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-20T13:35:54.943 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-20T13:35:54.952 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-20T13:35:54.953 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-03-20T13:35:54.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-20T13:35:54.967 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-03-20T13:35:54.967 INFO:tasks.ceph:role: osd.0 2024-03-20T13:35:54.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-03-20T13:35:54.967 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:35:55.029 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:35:55.500 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-03-20T13:35:55.502 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-03-20T13:35:55.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-20T13:35:55.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-20T13:35:55.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:35:55.654 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-03-20T13:35:55.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:35:55.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:35:55.811+0000 7f9eab9c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-20T13:35:55.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:35:55.819+0000 7f9eab9c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-20T13:35:55.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:35:55.819+0000 7f9eab9c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-20T13:35:55.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:35:55.819+0000 7f9eab9c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-20T13:35:55.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:35:55.819+0000 7f9eab9c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-20T13:35:55.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:35:55.827+0000 7f9eab9c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-20T13:35:58.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-20T13:35:58.811 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-20T13:35:58.825 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:35:58.825 INFO:tasks.ceph:role: osd.1 2024-03-20T13:35:58.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:35:58.825 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-20T13:35:58.887 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:35:58.888 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:35:59.378 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-03-20T13:35:59.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-03-20T13:35:59.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-03-20T13:35:59.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-20T13:35:59.540 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-03-20T13:35:59.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:35:59.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-20T13:35:59.595 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:35:59.595 INFO:tasks.ceph:role: osd.2 2024-03-20T13:35:59.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:35:59.595 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:35:59.659 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:35:59.660 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-20T13:35:59.660 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:35:59.660 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:36:00.112 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-03-20T13:36:00.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-03-20T13:36:00.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-03-20T13:36:00.205 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-20T13:36:00.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:36:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-03-20T13:36:00.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-20T13:36:00.273 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:36:00.273 INFO:tasks.ceph:role: osd.3 2024-03-20T13:36:00.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:36:00.274 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:36:00.340 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:36:00.804 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-03-20T13:36:00.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-03-20T13:36:00.806 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-03-20T13:36:00.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-20T13:36:00.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:36:00.937 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-03-20T13:36:00.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:36:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:01.039+0000 7fd2e48b27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-20T13:36:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:01.043+0000 7fd2e48b27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-20T13:36:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:01.043+0000 7fd2e48b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-20T13:36:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:01.043+0000 7fd2e48b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-20T13:36:01.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:01.043+0000 7fd2e48b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-20T13:36:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:01.051+0000 7fd2e48b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-20T13:36:04.032 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-20T13:36:04.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:36:04.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:04.119+0000 7f2d526c87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-20T13:36:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:04.119+0000 7f2d526c87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-20T13:36:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:04.119+0000 7f2d526c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-20T13:36:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:04.119+0000 7f2d526c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-20T13:36:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:04.119+0000 7f2d526c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-20T13:36:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:04.119+0000 7f2d526c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-20T13:36:07.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-20T13:36:07.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:36:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:07.238+0000 7f2c4e05b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-20T13:36:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:07.238+0000 7f2c4e05b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-20T13:36:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:07.238+0000 7f2c4e05b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-20T13:36:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:07.238+0000 7f2c4e05b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-20T13:36:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:07.238+0000 7f2c4e05b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-20T13:36:07.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:07.238+0000 7f2c4e05b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-20T13:36:10.218 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-20T13:36:10.275 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-20T13:36:10.275 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:36:10.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-20T13:36:10.290 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:10.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-20T13:36:10.330 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:10.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-20T13:36:10.382 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:10.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-20T13:36:10.438 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:10.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-20T13:36:10.490 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:10.490 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-20T13:36:10.535 INFO:tasks.ceph:Adding keys to all mons... 2024-03-20T13:36:10.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-20T13:36:10.547 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA75vplK/azMBAAS5o1YTztAT33SjGFg3UXpg== 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA65vple3YBMxAAh5SpiwdOZ+LUsZmAgaDVHg== 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBB5vplyuGnAhAAKgMPc1lPdsdx5W18B+/Sgw== 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBE5vpl9klhBxAACSTC9W1XdDrs/iDRS5DoyQ== 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBH5vpladSFDhAAhIRUy8xdPQmwL5dE7Ap41Q== 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-03-20T13:36:10.548 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA65vplPGspOBAAa6Qv6sEWs9rg9xRDW3qbcA== 2024-03-20T13:36:10.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:36:10.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-20T13:36:10.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:36:10.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:36:10.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:36:10.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-20T13:36:11.068 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-20T13:36:11.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-20T13:36:11.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-20T13:36:11.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-20T13:36:11.227 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:36:11.273 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-20T13:36:11.273 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-20T13:36:11.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-20T13:36:11.318 INFO:tasks.ceph.mon.a:Started 2024-03-20T13:36:11.319 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-20T13:36:11.319 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-20T13:36:11.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-20T13:36:11.321 INFO:tasks.ceph.mgr.x:Started 2024-03-20T13:36:11.322 INFO:tasks.ceph:Setting crush tunables to default 2024-03-20T13:36:11.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f24923640 1 Processor -- start 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f24923640 1 -- start start 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f24923640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 0x7f2f2006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f24923640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2006c1e0 con 0x7f2f2012a800 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f24923640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f20072230 con 0x7f2f2006c610 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 0x7f2f2006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1dd9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2f2012a800 0x7f2f2012ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42832/0 (socket says 172.21.15.89:42832) 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1dd9b640 1 -- 172.21.15.89:0/3946014824 learned_addr learned my addr 172.21.15.89:0/3946014824 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1e59c640 1 -- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 msgr2=0x7f2f2006c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1e59c640 1 -- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 msgr2=0x7f2f2006c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1e59c640 1 --2- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 0x7f2f2006c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.442+0000 7f2f1e59c640 1 --2- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 0x7f2f2006c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.458+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244837377 0 0) 0x7f2f2006c1e0 con 0x7f2f2012a800 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.458+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f0c003530 con 0x7f2f2012a800 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 516359866 0 0) 0x7f2f0c003530 con 0x7f2f2012a800 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 msgr2=0x7f2f2006c9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 --2- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 0x7f2f2006c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200727a0 con 0x7f2f2012a800 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 867087403 0 0) 0x7f2f080015b0 con 0x7f2f2012a800 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 >> v1:172.21.15.89:6789/0 conn(0x7f2f2012a800 legacy=0x7f2f2012ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 --2- 172.21.15.89:0/3946014824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c004540 con 0x7f2f0c0039d0 2024-03-20T13:36:11.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1e59c640 1 --2- 172.21.15.89:0/3946014824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.462+0000 7f2f1e59c640 1 -- 172.21.15.89:0/3946014824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c003530 con 0x7f2f0c0039d0 2024-03-20T13:36:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f1e59c640 1 --2- 172.21.15.89:0/3946014824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f0c003dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c7a0 tx=0x7f2f1001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a6acb3d8911f90 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f100ab590 con 0x7f2f0c0039d0 2024-03-20T13:36:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100ab6f0 con 0x7f2f0c0039d0 2024-03-20T13:36:11.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f1d59a640 1 -- 172.21.15.89:0/3946014824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f100ab9d0 con 0x7f2f0c0039d0 2024-03-20T13:36:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 -- 172.21.15.89:0/3946014824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 msgr2=0x7f2f0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 --2- 172.21.15.89:0/3946014824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f0c003dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c7a0 tx=0x7f2f1001c5d0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 -- 172.21.15.89:0/3946014824 shutdown_connections 2024-03-20T13:36:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 --2- 172.21.15.89:0/3946014824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f0c003dd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 --2- 172.21.15.89:0/3946014824 >> v2:172.21.15.89:3300/0 conn(0x7f2f2006c610 0x7f2f2006c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 -- 172.21.15.89:0/3946014824 >> 172.21.15.89:0/3946014824 conn(0x7f2f2009d470 msgr2=0x7f2f2009d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 -- 172.21.15.89:0/3946014824 shutdown_connections 2024-03-20T13:36:11.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 -- 172.21.15.89:0/3946014824 wait complete. 2024-03-20T13:36:11.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 Processor -- start 2024-03-20T13:36:11.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.478+0000 7f2f24923640 1 -- start start 2024-03-20T13:36:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f24923640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f20126810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f24923640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201299c0 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f1e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f20126810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f1e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f20126810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53236/0 (socket says 172.21.15.89:53236) 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f1e59c640 1 -- 172.21.15.89:0/446851335 learned_addr learned my addr 172.21.15.89:0/446851335 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f1e59c640 1 -- 172.21.15.89:0/446851335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2008a340 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f1e59c640 1 --2- 172.21.15.89:0/446851335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f20126810 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f100ad040 tx=0x7f2f0c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f100abc40 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100abda0 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2008ab40 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f100bd580 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2008a780 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2f100a9070 con 0x7f2f0c0039d0 2024-03-20T13:36:11.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f100c7760 con 0x7f2f0c0039d0 2024-03-20T13:36:11.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.482+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20062860 con 0x7f2f0c0039d0 2024-03-20T13:36:11.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.486+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2f100c2070 con 0x7f2f0c0039d0 2024-03-20T13:36:11.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.554+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2f20067b50 con 0x7f2f0c0039d0 2024-03-20T13:36:11.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.554+0000 7f2f16ffd640 1 -- 172.21.15.89:0/446851335 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2f1000f040 con 0x7f2f0c0039d0 2024-03-20T13:36:11.556 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.554+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 msgr2=0x7f2f20126810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.554+0000 7f2f24923640 1 --2- 172.21.15.89:0/446851335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f20126810 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f100ad040 tx=0x7f2f0c005800 comp rx=0 tx=0).stop 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.554+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 shutdown_connections 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.554+0000 7f2f24923640 1 --2- 172.21.15.89:0/446851335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c0039d0 0x7f2f20126810 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.558+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 >> 172.21.15.89:0/446851335 conn(0x7f2f2009d470 msgr2=0x7f2f20098900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.558+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 shutdown_connections 2024-03-20T13:36:11.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:11.558+0000 7f2f24923640 1 -- 172.21.15.89:0/446851335 wait complete. 2024-03-20T13:36:11.573 INFO:tasks.ceph:check_enable_crimson: False 2024-03-20T13:36:11.573 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-20T13:36:11.574 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-03-20T13:36:11.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-20T13:36:11.583 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:11.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-20T13:36:11.596 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:11.596 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-20T13:36:11.651 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-03-20T13:36:11.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-20T13:36:11.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new a22bfa48-013d-4c01-b5c6-62643a1caa96 0 2024-03-20T13:36:11.790 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:11.782+0000 7f3012a72180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-20T13:36:11.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.874+0000 7f1adb565640 1 Processor -- start 2024-03-20T13:36:11.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.874+0000 7f1adb565640 1 -- start start 2024-03-20T13:36:11.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.874+0000 7f1adb565640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ad4113aa0 0x7f1ad4113e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.874+0000 7f1adb565640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad410e980 con 0x7f1ad410ddc0 2024-03-20T13:36:11.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.874+0000 7f1adb565640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad41145a0 con 0x7f1ad4113aa0 2024-03-20T13:36:11.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad9301640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ad4113aa0 0x7f1ad4113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad9301640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ad4113aa0 0x7f1ad4113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:38026/0 (socket says 172.21.15.123:38026) 2024-03-20T13:36:11.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad9301640 1 -- 172.21.15.123:0/3999535971 learned_addr learned my addr 172.21.15.123:0/3999535971 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:11.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad8b00640 1 --1- 172.21.15.123:0/3999535971 >> v1:172.21.15.89:6789/0 conn(0x7f1ad410ddc0 0x7f1ad410e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:32784/0 (socket says 172.21.15.123:32784) 2024-03-20T13:36:11.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad9301640 1 -- 172.21.15.123:0/3999535971 >> v1:172.21.15.89:6789/0 conn(0x7f1ad410ddc0 legacy=0x7f1ad410e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad9301640 1 -- 172.21.15.123:0/3999535971 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad410eb10 con 0x7f1ad4113aa0 2024-03-20T13:36:11.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1ad9301640 1 --2- 172.21.15.123:0/3999535971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4113aa0 0x7f1ad4113e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40097f0 tx=0x7f1ac401d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f195527c3e63576e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1acbfff640 1 -- 172.21.15.123:0/3999535971 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40ab580 con 0x7f1ad4113aa0 2024-03-20T13:36:11.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1acbfff640 1 -- 172.21.15.123:0/3999535971 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac40ab6e0 con 0x7f1ad4113aa0 2024-03-20T13:36:11.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.878+0000 7f1acbfff640 1 -- 172.21.15.123:0/3999535971 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40ab9a0 con 0x7f1ad4113aa0 2024-03-20T13:36:11.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/3999535971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4113aa0 msgr2=0x7f1ad4113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 --2- 172.21.15.123:0/3999535971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4113aa0 0x7f1ad4113e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40097f0 tx=0x7f1ac401d540 comp rx=0 tx=0).stop 2024-03-20T13:36:11.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/3999535971 shutdown_connections 2024-03-20T13:36:11.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 --2- 172.21.15.123:0/3999535971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4113aa0 0x7f1ad4113e80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/3999535971 >> 172.21.15.123:0/3999535971 conn(0x7f1ad406ef00 msgr2=0x7f1ad4071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/3999535971 shutdown_connections 2024-03-20T13:36:11.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/3999535971 wait complete. 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 Processor -- start 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- start start 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 0x7f1ad41a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41a51a0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ad9301640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 0x7f1ad41a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ad9301640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 0x7f1ad41a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:38040/0 (socket says 172.21.15.123:38040) 2024-03-20T13:36:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ad9301640 1 -- 172.21.15.123:0/1425929664 learned_addr learned my addr 172.21.15.123:0/1425929664 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ad9301640 1 -- 172.21.15.123:0/1425929664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40094d0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ad9301640 1 --2- 172.21.15.123:0/1425929664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 0x7f1ad41a4c60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ac401a150 tx=0x7f1ac401a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40aaa70 con 0x7f1ad410ddc0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41a53a0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac40aabd0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40aaeb0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41a94f0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1ac4005d30 con 0x7f1ad410ddc0 2024-03-20T13:36:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.882+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1ac40b8070 con 0x7f1ad410ddc0 2024-03-20T13:36:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.886+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad41a57c0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.914+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1ac4005fe0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.982+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a22bfa48-013d-4c01-b5c6-62643a1caa96", "id": 0} v 0) v1 -- 0x7f1ad4062860 con 0x7f1ad410ddc0 2024-03-20T13:36:11.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1ac9ffb640 1 -- 172.21.15.123:0/1425929664 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a22bfa48-013d-4c01-b5c6-62643a1caa96", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ac40bc8d0 con 0x7f1ad410ddc0 2024-03-20T13:36:11.994 INFO:teuthology.orchestra.run.smithi123.stdout:0 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 msgr2=0x7f1ad41a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 --2- 172.21.15.123:0/1425929664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 0x7f1ad41a4c60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ac401a150 tx=0x7f1ac401a2e0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 shutdown_connections 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 --2- 172.21.15.123:0/1425929664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad410ddc0 0x7f1ad41a4c60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 >> 172.21.15.123:0/1425929664 conn(0x7f1ad406ef00 msgr2=0x7f1ad410f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 shutdown_connections 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:11.986+0000 7f1adb565640 1 -- 172.21.15.123:0/1425929664 wait complete. 2024-03-20T13:36:12.011 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 56155634-7501-466c-ab30-d5b26a12a17d 1 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc060210640 1 Processor -- start 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc060210640 1 -- start start 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc060210640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc05806b5d0 0x7fc05806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc060210640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05811cd20 con 0x7fc05806bfe0 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc060210640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05811dec0 con 0x7fc05806b5d0 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc05dfac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc05806b5d0 0x7fc05806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc05dfac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc05806b5d0 0x7fc05806b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:38042/0 (socket says 172.21.15.123:38042) 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc05dfac640 1 -- 172.21.15.123:0/2441851910 learned_addr learned my addr 172.21.15.123:0/2441851910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc05d7ab640 1 --1- 172.21.15.123:0/2441851910 >> v1:172.21.15.89:6789/0 conn(0x7fc05806bfe0 0x7fc05811b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:32792/0 (socket says 172.21.15.123:32792) 2024-03-20T13:36:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc05dfac640 1 -- 172.21.15.123:0/2441851910 >> v1:172.21.15.89:6789/0 conn(0x7fc05806bfe0 legacy=0x7fc05811b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.170+0000 7fc05dfac640 1 -- 172.21.15.123:0/2441851910 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05811e000 con 0x7fc05806b5d0 2024-03-20T13:36:12.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc05dfac640 1 --2- 172.21.15.123:0/2441851910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc05806b9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097f0 tx=0x7fc05401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125f492e11fe05cb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc05cfaa640 1 -- 172.21.15.123:0/2441851910 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0540ab580 con 0x7fc05806b5d0 2024-03-20T13:36:12.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc05cfaa640 1 -- 172.21.15.123:0/2441851910 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0540ab6e0 con 0x7fc05806b5d0 2024-03-20T13:36:12.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc05cfaa640 1 -- 172.21.15.123:0/2441851910 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0540ab9a0 con 0x7fc05806b5d0 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 -- 172.21.15.123:0/2441851910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 msgr2=0x7fc05806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 --2- 172.21.15.123:0/2441851910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc05806b9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097f0 tx=0x7fc05401c430 comp rx=0 tx=0).stop 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 -- 172.21.15.123:0/2441851910 shutdown_connections 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 --2- 172.21.15.123:0/2441851910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc05806b9b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 -- 172.21.15.123:0/2441851910 >> 172.21.15.123:0/2441851910 conn(0x7fc05806f4d0 msgr2=0x7fc0580718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 -- 172.21.15.123:0/2441851910 shutdown_connections 2024-03-20T13:36:12.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.174+0000 7fc060210640 1 -- 172.21.15.123:0/2441851910 wait complete. 2024-03-20T13:36:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 Processor -- start 2024-03-20T13:36:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 -- start start 2024-03-20T13:36:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc0581a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581a8d00 con 0x7fc05806b5d0 2024-03-20T13:36:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc05dfac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc0581a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc05dfac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc0581a8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:38048/0 (socket says 172.21.15.123:38048) 2024-03-20T13:36:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc05dfac640 1 -- 172.21.15.123:0/4072592647 learned_addr learned my addr 172.21.15.123:0/4072592647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc05dfac640 1 -- 172.21.15.123:0/4072592647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0540094d0 con 0x7fc05806b5d0 2024-03-20T13:36:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc05dfac640 1 --2- 172.21.15.123:0/4072592647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc0581a8730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0540ad040 tx=0x7fc05401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0540aaa30 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0581a8f00 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0581ad000 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0540aab90 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0540aae30 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc0540be780 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc0540c7bc0 con 0x7fc05806b5d0 2024-03-20T13:36:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.178+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058062860 con 0x7fc05806b5d0 2024-03-20T13:36:12.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.186+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc0540c7d80 con 0x7fc05806b5d0 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.250+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56155634-7501-466c-ab30-d5b26a12a17d", "id": 1} v 0) v1 -- 0x7fc058067620 con 0x7fc05806b5d0 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.254+0000 7fc04e7fc640 1 -- 172.21.15.123:0/4072592647 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56155634-7501-466c-ab30-d5b26a12a17d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc0540bec10 con 0x7fc05806b5d0 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 msgr2=0x7fc0581a8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 --2- 172.21.15.123:0/4072592647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc0581a8730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0540ad040 tx=0x7fc05401ac70 comp rx=0 tx=0).stop 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 shutdown_connections 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 --2- 172.21.15.123:0/4072592647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc05806b5d0 0x7fc0581a8730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 >> 172.21.15.123:0/4072592647 conn(0x7fc05806f4d0 msgr2=0x7fc05811be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 shutdown_connections 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.258+0000 7fc060210640 1 -- 172.21.15.123:0/4072592647 wait complete. 2024-03-20T13:36:12.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new fbae2cb8-b7b0-4ddf-b00a-e3e209a12363 2 2024-03-20T13:36:12.342 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:12.334+0000 7f3012a72180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-20T13:36:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd823b1f640 1 Processor -- start 2024-03-20T13:36:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd823b1f640 1 -- start start 2024-03-20T13:36:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd823b1f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd81c118180 0x7fd81c11a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd823b1f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c11ab40 con 0x7fd81c115400 2024-03-20T13:36:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd823b1f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81c11bce0 con 0x7fd81c118180 2024-03-20T13:36:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd8210ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd81c118180 0x7fd81c11a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd8218bb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd81c115400 0x7fd81c1157e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:32800/0 (socket says 172.21.15.123:32800) 2024-03-20T13:36:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd8218bb640 1 -- 172.21.15.123:0/1216450644 learned_addr learned my addr 172.21.15.123:0/1216450644 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd8210ba640 1 -- 172.21.15.123:0/1216450644 >> v1:172.21.15.89:6789/0 conn(0x7fd81c115400 legacy=0x7fd81c1157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.390+0000 7fd8210ba640 1 -- 172.21.15.123:0/1216450644 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c11be20 con 0x7fd81c118180 2024-03-20T13:36:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd8210ba640 1 --2- 172.21.15.123:0/1216450644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c118180 0x7fd81c11a570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009740 tx=0x7fd80c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f40621cbb099d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd8208b9640 1 -- 172.21.15.123:0/1216450644 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd80c0a8050 con 0x7fd81c118180 2024-03-20T13:36:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd8208b9640 1 -- 172.21.15.123:0/1216450644 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c0ac520 con 0x7fd81c118180 2024-03-20T13:36:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd8208b9640 1 -- 172.21.15.123:0/1216450644 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd80c0ac7e0 con 0x7fd81c118180 2024-03-20T13:36:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 -- 172.21.15.123:0/1216450644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c118180 msgr2=0x7fd81c11a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 --2- 172.21.15.123:0/1216450644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c118180 0x7fd81c11a570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009740 tx=0x7fd80c01c370 comp rx=0 tx=0).stop 2024-03-20T13:36:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 -- 172.21.15.123:0/1216450644 shutdown_connections 2024-03-20T13:36:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 --2- 172.21.15.123:0/1216450644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c118180 0x7fd81c11a570 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 -- 172.21.15.123:0/1216450644 >> 172.21.15.123:0/1216450644 conn(0x7fd81c06f540 msgr2=0x7fd81c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 -- 172.21.15.123:0/1216450644 shutdown_connections 2024-03-20T13:36:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.394+0000 7fd823b1f640 1 -- 172.21.15.123:0/1216450644 wait complete. 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 Processor -- start 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 -- start start 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 0x7fd81c1ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c1ac940 con 0x7fd81c115400 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8218bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 0x7fd81c1ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8218bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 0x7fd81c1ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:38062/0 (socket says 172.21.15.123:38062) 2024-03-20T13:36:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8218bb640 1 -- 172.21.15.123:0/2754716911 learned_addr learned my addr 172.21.15.123:0/2754716911 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8218bb640 1 -- 172.21.15.123:0/2754716911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c009420 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8218bb640 1 --2- 172.21.15.123:0/2754716911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 0x7fd81c1ac370 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd81800ca90 tx=0x7fd81800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd818004ca0 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81c1acb40 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818004e00 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd81800aba0 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c1a6200 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd81800ad00 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd818005800 con 0x7fd81c115400 2024-03-20T13:36:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.398+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81c062860 con 0x7fd81c115400 2024-03-20T13:36:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.406+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd818018070 con 0x7fd81c115400 2024-03-20T13:36:12.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.470+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fbae2cb8-b7b0-4ddf-b00a-e3e209a12363", "id": 2} v 0) v1 -- 0x7fd81c067620 con 0x7fd81c115400 2024-03-20T13:36:12.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.470+0000 7fd8127fc640 1 -- 172.21.15.123:0/2754716911 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbae2cb8-b7b0-4ddf-b00a-e3e209a12363", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd818005a90 con 0x7fd81c115400 2024-03-20T13:36:12.478 INFO:teuthology.orchestra.run.smithi123.stdout:2 2024-03-20T13:36:12.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 msgr2=0x7fd81c1ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 --2- 172.21.15.123:0/2754716911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 0x7fd81c1ac370 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd81800ca90 tx=0x7fd81800cf50 comp rx=0 tx=0).stop 2024-03-20T13:36:12.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 shutdown_connections 2024-03-20T13:36:12.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 --2- 172.21.15.123:0/2754716911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd81c115400 0x7fd81c1ac370 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 >> 172.21.15.123:0/2754716911 conn(0x7fd81c06f540 msgr2=0x7fd81c118800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 shutdown_connections 2024-03-20T13:36:12.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.474+0000 7fd823b1f640 1 -- 172.21.15.123:0/2754716911 wait complete. 2024-03-20T13:36:12.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 844dcdcd-c116-4e43-adcd-27f21b51945b 3 2024-03-20T13:36:12.528 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:12.522+0000 7f3012a72180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-20T13:36:12.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe85e15a640 1 Processor -- start 2024-03-20T13:36:12.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe85e15a640 1 -- start start 2024-03-20T13:36:12.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe85e15a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe858118130 0x7fe85811a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe85e15a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85811aaf0 con 0x7fe858115390 2024-03-20T13:36:12.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe85e15a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85811bc90 con 0x7fe858118130 2024-03-20T13:36:12.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe856ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe858118130 0x7fe85811a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe8577fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe858115390 0x7fe858115770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:32802/0 (socket says 172.21.15.123:32802) 2024-03-20T13:36:12.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe8577fe640 1 -- 172.21.15.123:0/2980297209 learned_addr learned my addr 172.21.15.123:0/2980297209 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:12.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe856ffd640 1 -- 172.21.15.123:0/2980297209 >> v1:172.21.15.89:6789/0 conn(0x7fe858115390 legacy=0x7fe858115770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.594+0000 7fe856ffd640 1 -- 172.21.15.123:0/2980297209 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85811bdd0 con 0x7fe858118130 2024-03-20T13:36:12.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe856ffd640 1 --2- 172.21.15.123:0/2980297209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858118130 0x7fe85811a520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe840009740 tx=0x7fe84001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b024f5e9d6a10f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe8567fc640 1 -- 172.21.15.123:0/2980297209 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8400a8050 con 0x7fe858118130 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe8567fc640 1 -- 172.21.15.123:0/2980297209 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8400ac520 con 0x7fe858118130 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe8567fc640 1 -- 172.21.15.123:0/2980297209 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8400ac7e0 con 0x7fe858118130 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- 172.21.15.123:0/2980297209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858118130 msgr2=0x7fe85811a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 --2- 172.21.15.123:0/2980297209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858118130 0x7fe85811a520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe840009740 tx=0x7fe84001c370 comp rx=0 tx=0).stop 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- 172.21.15.123:0/2980297209 shutdown_connections 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 --2- 172.21.15.123:0/2980297209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858118130 0x7fe85811a520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- 172.21.15.123:0/2980297209 >> 172.21.15.123:0/2980297209 conn(0x7fe858070260 msgr2=0x7fe858072680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- 172.21.15.123:0/2980297209 shutdown_connections 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- 172.21.15.123:0/2980297209 wait complete. 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 Processor -- start 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- start start 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 0x7fe8581ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe85e15a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8581ac8f0 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe8577fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 0x7fe8581ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe8577fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 0x7fe8581ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:38084/0 (socket says 172.21.15.123:38084) 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.598+0000 7fe8577fe640 1 -- 172.21.15.123:0/568930207 learned_addr learned my addr 172.21.15.123:0/568930207 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe8577fe640 1 -- 172.21.15.123:0/568930207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840009420 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe8577fe640 1 --2- 172.21.15.123:0/568930207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 0x7fe8581ac320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe84800c3a0 tx=0x7fe84800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe848005c20 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85811bb00 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848005d80 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe848007200 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8581acde0 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe848007360 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe848007610 con 0x7fe858115390 2024-03-20T13:36:12.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.602+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858062860 con 0x7fe858115390 2024-03-20T13:36:12.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.606+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe848021060 con 0x7fe858115390 2024-03-20T13:36:12.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.670+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "844dcdcd-c116-4e43-adcd-27f21b51945b", "id": 3} v 0) v1 -- 0x7fe85811b800 con 0x7fe858115390 2024-03-20T13:36:12.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe84ffff640 1 -- 172.21.15.123:0/568930207 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "844dcdcd-c116-4e43-adcd-27f21b51945b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe848017070 con 0x7fe858115390 2024-03-20T13:36:12.680 INFO:teuthology.orchestra.run.smithi123.stdout:3 2024-03-20T13:36:12.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 msgr2=0x7fe8581ac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 --2- 172.21.15.123:0/568930207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 0x7fe8581ac320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe84800c3a0 tx=0x7fe84800c860 comp rx=0 tx=0).stop 2024-03-20T13:36:12.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 shutdown_connections 2024-03-20T13:36:12.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 --2- 172.21.15.123:0/568930207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe858115390 0x7fe8581ac320 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 >> 172.21.15.123:0/568930207 conn(0x7fe858070260 msgr2=0x7fe858119ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 shutdown_connections 2024-03-20T13:36:12.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:12.674+0000 7fe85e15a640 1 -- 172.21.15.123:0/568930207 wait complete. 2024-03-20T13:36:12.695 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-20T13:36:12.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-20T13:36:12.698 INFO:tasks.ceph.osd.0:Started 2024-03-20T13:36:12.699 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-20T13:36:12.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-20T13:36:12.740 INFO:tasks.ceph.osd.1:Started 2024-03-20T13:36:12.740 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-20T13:36:12.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-20T13:36:12.742 INFO:tasks.ceph.osd.2:Started 2024-03-20T13:36:12.743 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-20T13:36:12.743 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-20T13:36:12.745 INFO:tasks.ceph.osd.3:Started 2024-03-20T13:36:12.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.858+0000 7f93bcf4f640 1 Processor -- start 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- start start 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93b80946a0 0x7f93b8130da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b8097610 con 0x7f93b8128ae0 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b8128690 con 0x7f93b80946a0 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b5d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93b80946a0 0x7f93b8130da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b5d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93b80946a0 0x7f93b8130da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53256/0 (socket says 172.21.15.89:53256) 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b5d9b640 1 -- 172.21.15.89:0/1742179298 learned_addr learned my addr 172.21.15.89:0/1742179298 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:12.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b5d9b640 1 -- 172.21.15.89:0/1742179298 >> v1:172.21.15.89:6789/0 conn(0x7f93b8128ae0 legacy=0x7f93b8128ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b5d9b640 1 -- 172.21.15.89:0/1742179298 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80952e0 con 0x7f93b80946a0 2024-03-20T13:36:12.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b5d9b640 1 --2- 172.21.15.89:0/1742179298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b8130da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93a80097f0 tx=0x7f93a801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b855ffa94bf3c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b559a640 1 -- 172.21.15.89:0/1742179298 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b8095020 con 0x7f93b80946a0 2024-03-20T13:36:12.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b559a640 1 -- 172.21.15.89:0/1742179298 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80aa570 con 0x7f93b80946a0 2024-03-20T13:36:12.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93b559a640 1 -- 172.21.15.89:0/1742179298 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93a80aa830 con 0x7f93b80946a0 2024-03-20T13:36:12.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- 172.21.15.89:0/1742179298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 msgr2=0x7f93b8130da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 --2- 172.21.15.89:0/1742179298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b8130da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93a80097f0 tx=0x7f93a801c4c0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- 172.21.15.89:0/1742179298 shutdown_connections 2024-03-20T13:36:12.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 --2- 172.21.15.89:0/1742179298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b8130da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- 172.21.15.89:0/1742179298 >> 172.21.15.89:0/1742179298 conn(0x7f93b809d500 msgr2=0x7f93b809d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- 172.21.15.89:0/1742179298 shutdown_connections 2024-03-20T13:36:12.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.862+0000 7f93bcf4f640 1 -- 172.21.15.89:0/1742179298 wait complete. 2024-03-20T13:36:12.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 Processor -- start 2024-03-20T13:36:12.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 -- start start 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b81221c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8123440 con 0x7f93b80946a0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93b659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b81221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93b659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b81221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53266/0 (socket says 172.21.15.89:53266) 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93b659c640 1 -- 172.21.15.89:0/3264155485 learned_addr learned my addr 172.21.15.89:0/3264155485 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93b659c640 1 -- 172.21.15.89:0/3264155485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80094d0 con 0x7f93b80946a0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93b659c640 1 --2- 172.21.15.89:0/3264155485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b81221c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c480 tx=0x7f93ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ac005150 con 0x7f93b80946a0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac0052b0 con 0x7f93b80946a0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8130170 con 0x7f93b80946a0 2024-03-20T13:36:12.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ac007030 con 0x7f93b80946a0 2024-03-20T13:36:12.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b812fa60 con 0x7f93b80946a0 2024-03-20T13:36:12.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f93ac007520 con 0x7f93b80946a0 2024-03-20T13:36:12.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f93ac003c70 con 0x7f93b80946a0 2024-03-20T13:36:12.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.866+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8062860 con 0x7f93b80946a0 2024-03-20T13:36:12.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.870+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f93ac003600 con 0x7f93b80946a0 2024-03-20T13:36:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93b8073100 con 0x7f93b80946a0 2024-03-20T13:36:12.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93a6ffd640 1 -- 172.21.15.89:0/3264155485 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f93ac006830 con 0x7f93b80946a0 2024-03-20T13:36:12.927 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:12.927 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:36:12.682331+0000","last_up_change":"0.000000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 msgr2=0x7f93b81221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 --2- 172.21.15.89:0/3264155485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b81221c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c480 tx=0x7f93ac00c940 comp rx=0 tx=0).stop 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 shutdown_connections 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 --2- 172.21.15.89:0/3264155485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b80946a0 0x7f93b81221c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 >> 172.21.15.89:0/3264155485 conn(0x7f93b809d500 msgr2=0x7f93b812b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 shutdown_connections 2024-03-20T13:36:12.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:12.926+0000 7f93bcf4f640 1 -- 172.21.15.89:0/3264155485 wait complete. 2024-03-20T13:36:12.944 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-20T13:36:12.944 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-20T13:36:13.076 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.070+0000 7f3012a72180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-20T13:36:13.129 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.122+0000 7f3012a72180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-20T13:36:13.181 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.174+0000 7f3012a72180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-20T13:36:13.257 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.250+0000 7f3012a72180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-20T13:36:13.307 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-03-20T13:36:13.306+0000 7fbb8069c7c0 -1 Falling back to public interface 2024-03-20T13:36:13.309 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.302+0000 7f3012a72180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-20T13:36:13.347 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:13.349 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-03-20T13:36:13.342+0000 7f5eae2367c0 -1 Falling back to public interface 2024-03-20T13:36:13.349 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-03-20T13:36:13.342+0000 7f68bad467c0 -1 Falling back to public interface 2024-03-20T13:36:13.369 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-03-20T13:36:13.362+0000 7f394bf297c0 -1 Falling back to public interface 2024-03-20T13:36:13.387 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.382+0000 7f3012a72180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-20T13:36:13.438 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.430+0000 7f3012a72180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-20T13:36:13.466 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f381581f640 1 Processor -- start 2024-03-20T13:36:13.466 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f381581f640 1 -- start start 2024-03-20T13:36:13.466 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f381581f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f381006d280 0x7f3810132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:13.466 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f381581f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381012e050 con 0x7f381012dc70 2024-03-20T13:36:13.466 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f381581f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38100951a0 con 0x7f381006d280 2024-03-20T13:36:13.467 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f381006d280 0x7f3810132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:13.467 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f381012dc70 0x7f381012e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42848/0 (socket says 172.21.15.89:42848) 2024-03-20T13:36:13.467 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f381006d280 0x7f3810132ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53282/0 (socket says 172.21.15.89:53282) 2024-03-20T13:36:13.467 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380effd640 1 -- 172.21.15.89:0/884882411 learned_addr learned my addr 172.21.15.89:0/884882411 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:13.467 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380e7fc640 1 -- 172.21.15.89:0/884882411 >> v1:172.21.15.89:6789/0 conn(0x7f381012dc70 legacy=0x7f381012e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:13.467 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380e7fc640 1 -- 172.21.15.89:0/884882411 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810092780 con 0x7f381006d280 2024-03-20T13:36:13.469 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.466+0000 7f380e7fc640 1 --2- 172.21.15.89:0/884882411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f3810132ff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009740 tx=0x7f37f801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b54ec2ddb682cfc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:13.469 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380dffb640 1 -- 172.21.15.89:0/884882411 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f80ab530 con 0x7f381006d280 2024-03-20T13:36:13.469 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380dffb640 1 -- 172.21.15.89:0/884882411 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f80a7050 con 0x7f381006d280 2024-03-20T13:36:13.469 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380dffb640 1 -- 172.21.15.89:0/884882411 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f80ab7e0 con 0x7f381006d280 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/884882411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 msgr2=0x7f3810132ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 --2- 172.21.15.89:0/884882411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f3810132ff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009740 tx=0x7f37f801c370 comp rx=0 tx=0).stop 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/884882411 shutdown_connections 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 --2- 172.21.15.89:0/884882411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f3810132ff0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/884882411 >> 172.21.15.89:0/884882411 conn(0x7f381009e370 msgr2=0x7f381009e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/884882411 shutdown_connections 2024-03-20T13:36:13.470 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/884882411 wait complete. 2024-03-20T13:36:13.472 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 Processor -- start 2024-03-20T13:36:13.472 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- start start 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f38101c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3810131900 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f38101c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f38101c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53294/0 (socket says 172.21.15.89:53294) 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380effd640 1 -- 172.21.15.89:0/3773477040 learned_addr learned my addr 172.21.15.89:0/3773477040 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380effd640 1 -- 172.21.15.89:0/3773477040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8009420 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f380effd640 1 --2- 172.21.15.89:0/3773477040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f38101c5480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f380800c480 tx=0x7f380800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3808005c20 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808005d80 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3810132400 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38080071a0 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38101320f0 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3808007300 con 0x7f381006d280 2024-03-20T13:36:13.473 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.470+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3808012910 con 0x7f381006d280 2024-03-20T13:36:13.474 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.474+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3810062860 con 0x7f381006d280 2024-03-20T13:36:13.476 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.474+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3808021060 con 0x7f381006d280 2024-03-20T13:36:13.533 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.530+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38100683c0 con 0x7f381006d280 2024-03-20T13:36:13.534 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f3807fff640 1 -- 172.21.15.89:0/3773477040 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f3808017070 con 0x7f381006d280 2024-03-20T13:36:13.534 INFO:teuthology.misc.health.smithi089.stdout: 2024-03-20T13:36:13.535 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":6,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:36:12.682331+0000","last_up_change":"0.000000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:13.535 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 msgr2=0x7f38101c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:13.535 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 --2- 172.21.15.89:0/3773477040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f38101c5480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f380800c480 tx=0x7f380800c940 comp rx=0 tx=0).stop 2024-03-20T13:36:13.535 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 shutdown_connections 2024-03-20T13:36:13.536 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 --2- 172.21.15.89:0/3773477040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381006d280 0x7f38101c5480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:13.536 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 >> 172.21.15.89:0/3773477040 conn(0x7f381009e370 msgr2=0x7f3810098ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:13.536 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 shutdown_connections 2024-03-20T13:36:13.536 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:13.534+0000 7f381581f640 1 -- 172.21.15.89:0/3773477040 wait complete. 2024-03-20T13:36:13.550 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-03-20T13:36:13.586 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.578+0000 7f3012a72180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-20T13:36:13.647 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:13.642+0000 7f3012a72180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-20T13:36:14.382 INFO:tasks.ceph.mgr.x.smithi123.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-20T13:36:14.383 INFO:tasks.ceph.mgr.x.smithi123.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-20T13:36:14.383 INFO:tasks.ceph.mgr.x.smithi123.stderr: from numpy import show_config as show_numpy_config 2024-03-20T13:36:14.419 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:14.414+0000 7f3012a72180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-20T13:36:14.558 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:14.550+0000 7f3012a72180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-20T13:36:14.711 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:14.702+0000 7f3012a72180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-20T13:36:14.773 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:14.766+0000 7f3012a72180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-20T13:36:14.905 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:14.898+0000 7f3012a72180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-20T13:36:15.530 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:15.522+0000 7f3012a72180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-20T13:36:15.605 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:15.598+0000 7f3012a72180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-20T13:36:15.784 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:15.778+0000 7f3012a72180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-20T13:36:15.857 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:15.850+0000 7f3012a72180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-20T13:36:16.146 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:16.138+0000 7f3012a72180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-20T13:36:16.209 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:16.202+0000 7f3012a72180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-20T13:36:17.013 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-03-20T13:36:17.014+0000 7fbb8069c7c0 -1 osd.0 0 log_to_monitors true 2024-03-20T13:36:17.203 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-03-20T13:36:17.198+0000 7f394bf297c0 -1 osd.3 0 log_to_monitors true 2024-03-20T13:36:17.208 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-03-20T13:36:17.202+0000 7f68bad467c0 -1 osd.2 0 log_to_monitors true 2024-03-20T13:36:17.240 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-03-20T13:36:17.234+0000 7f2fb9ec1640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-20T13:36:17.320 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-03-20T13:36:17.314+0000 7f5eae2367c0 -1 osd.1 0 log_to_monitors true 2024-03-20T13:36:19.202 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-03-20T13:36:19.202+0000 7fbb7d658640 -1 osd.0 0 waiting for initial osdmap 2024-03-20T13:36:19.230 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-03-20T13:36:19.230+0000 7fbb74469640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:36:19.673 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-03-20T13:36:19.666+0000 7f39476af640 -1 osd.3 0 waiting for initial osdmap 2024-03-20T13:36:19.701 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-03-20T13:36:19.694+0000 7f68b64cc640 -1 osd.2 0 waiting for initial osdmap 2024-03-20T13:36:19.708 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-03-20T13:36:19.702+0000 7f393fcf6640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:36:19.738 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-03-20T13:36:19.730+0000 7f68aeb13640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:36:19.953 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:20.073 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aab0f5640 1 Processor -- start 2024-03-20T13:36:20.073 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aab0f5640 1 -- start start 2024-03-20T13:36:20.074 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aab0f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2aa4131110 0x7f2aa4133500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:20.074 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aab0f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa409d910 con 0x7f2aa412e180 2024-03-20T13:36:20.074 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aab0f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa412de00 con 0x7f2aa4131110 2024-03-20T13:36:20.074 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aa3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2aa4131110 0x7f2aa4133500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:20.075 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aa8e91640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2aa412e180 0x7f2aa412e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42852/0 (socket says 172.21.15.89:42852) 2024-03-20T13:36:20.075 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aa8e91640 1 -- 172.21.15.89:0/2720210390 learned_addr learned my addr 172.21.15.89:0/2720210390 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:20.075 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aa3fff640 1 -- 172.21.15.89:0/2720210390 >> v1:172.21.15.89:6789/0 conn(0x7f2aa412e180 legacy=0x7f2aa412e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:20.075 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.074+0000 7f2aa3fff640 1 -- 172.21.15.89:0/2720210390 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40a1360 con 0x7f2aa4131110 2024-03-20T13:36:20.077 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa3fff640 1 --2- 172.21.15.89:0/2720210390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa4131110 0x7f2aa4133500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009740 tx=0x7f2a9401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2dd07962efcf7f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:20.077 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa37fe640 1 -- 172.21.15.89:0/2720210390 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a940ab530 con 0x7f2aa4131110 2024-03-20T13:36:20.077 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa37fe640 1 -- 172.21.15.89:0/2720210390 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940a7050 con 0x7f2aa4131110 2024-03-20T13:36:20.077 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa37fe640 1 -- 172.21.15.89:0/2720210390 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a940ab7e0 con 0x7f2aa4131110 2024-03-20T13:36:20.078 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/2720210390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa4131110 msgr2=0x7f2aa4133500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:20.078 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 --2- 172.21.15.89:0/2720210390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa4131110 0x7f2aa4133500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009740 tx=0x7f2a9401c370 comp rx=0 tx=0).stop 2024-03-20T13:36:20.078 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/2720210390 shutdown_connections 2024-03-20T13:36:20.078 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 --2- 172.21.15.89:0/2720210390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa4131110 0x7f2aa4133500 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:20.078 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/2720210390 >> 172.21.15.89:0/2720210390 conn(0x7f2aa40a0a40 msgr2=0x7f2aa409cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:20.078 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/2720210390 shutdown_connections 2024-03-20T13:36:20.079 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/2720210390 wait complete. 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 Processor -- start 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- start start 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 0x7f2aa4125710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4096db0 con 0x7f2aa412e180 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa8e91640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 0x7f2aa4125710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa8e91640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 0x7f2aa4125710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53324/0 (socket says 172.21.15.89:53324) 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa8e91640 1 -- 172.21.15.89:0/1852351637 learned_addr learned my addr 172.21.15.89:0/1852351637 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa8e91640 1 -- 172.21.15.89:0/1852351637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94009420 con 0x7f2aa412e180 2024-03-20T13:36:20.080 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa8e91640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 0x7f2aa4125710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c3a0 tx=0x7f2a8c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:20.081 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c005c20 con 0x7f2aa412e180 2024-03-20T13:36:20.081 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c005d80 con 0x7f2aa412e180 2024-03-20T13:36:20.081 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c007200 con 0x7f2aa412e180 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa4126c00 con 0x7f2aa412e180 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.078+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa41278a0 con 0x7f2aa412e180 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.082+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 43479+0+0 (secure 0 0 0) 0x7f2a8c007360 con 0x7f2aa412e180 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.082+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa4062860 con 0x7f2aa412e180 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.082+0000 7f2aa17fa640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a84035980 0x7f2a84037e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.082+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1903+0+0 (secure 0 0 0) 0x7f2a8c046bb0 con 0x7f2aa412e180 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.082+0000 7f2aa3fff640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a84035980 0x7f2a84037e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:20.082 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.082+0000 7f2aa3fff640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a84035980 0x7f2a84037e40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a940a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:20.086 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.086+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2a8c012400 con 0x7f2aa412e180 2024-03-20T13:36:20.232 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.230+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aa4127c40 con 0x7f2aa412e180 2024-03-20T13:36:20.233 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aa17fa640 1 -- 172.21.15.89:0/1852351637 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4637 (secure 0 0 0) 0x7f2a8c017020 con 0x7f2aa412e180 2024-03-20T13:36:20.233 INFO:teuthology.misc.health.smithi089.stdout: 2024-03-20T13:36:20.233 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":9,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:36:19.297374+0000","last_up_change":"2024-03-20T13:36:19.297374+0000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6801","nonce":854515999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6803","nonce":854515999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6807","nonce":854515999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6805","nonce":854515999}]},"public_addr":"172.21.15.89:6801/854515999","cluster_addr":"172.21.15.89:6803/854515999","heartbeat_back_addr":"172.21.15.89:6807/854515999","heartbeat_front_addr":"172.21.15.89:6805/854515999","state":["exists","up"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:20.235 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a84035980 msgr2=0x7f2a84037e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:20.235 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a84035980 0x7f2a84037e40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a940a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:20.235 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 msgr2=0x7f2aa4125710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:20.235 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 0x7f2aa4125710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c3a0 tx=0x7f2a8c00c860 comp rx=0 tx=0).stop 2024-03-20T13:36:20.236 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 shutdown_connections 2024-03-20T13:36:20.236 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a84035980 0x7f2a84037e40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:20.236 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 --2- 172.21.15.89:0/1852351637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa412e180 0x7f2aa4125710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:20.236 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 >> 172.21.15.89:0/1852351637 conn(0x7f2aa40a0a40 msgr2=0x7f2aa406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:20.236 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 shutdown_connections 2024-03-20T13:36:20.236 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:20.234+0000 7f2aab0f5640 1 -- 172.21.15.89:0/1852351637 wait complete. 2024-03-20T13:36:20.249 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-03-20T13:36:20.387 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-03-20T13:36:20.382+0000 7f5eab1f2640 -1 osd.1 0 waiting for initial osdmap 2024-03-20T13:36:20.408 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-03-20T13:36:20.402+0000 7f5ea2003640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:36:26.653 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.774+0000 7fd607825640 1 Processor -- start 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.774+0000 7fd607825640 1 -- start start 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.774+0000 7fd607825640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd600129060 0x7fd600130c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.774+0000 7fd607825640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6000961b0 con 0x7fd600128430 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.774+0000 7fd607825640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd600094b00 con 0x7fd600129060 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd604dc0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd600129060 0x7fd600130c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd6055c1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd600128430 0x7fd600128950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51700/0 (socket says 172.21.15.89:51700) 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd6055c1640 1 -- 172.21.15.89:0/2130564394 learned_addr learned my addr 172.21.15.89:0/2130564394 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd604dc0640 1 -- 172.21.15.89:0/2130564394 >> v1:172.21.15.89:6789/0 conn(0x7fd600128430 legacy=0x7fd600128950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:26.777 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd604dc0640 1 -- 172.21.15.89:0/2130564394 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000724c0 con 0x7fd600129060 2024-03-20T13:36:26.779 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd604dc0640 1 --2- 172.21.15.89:0/2130564394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600129060 0x7fd600130c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009740 tx=0x7fd5f001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5060b3ae37e75357 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:26.780 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd5f7fff640 1 -- 172.21.15.89:0/2130564394 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00ab530 con 0x7fd600129060 2024-03-20T13:36:26.780 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd5f7fff640 1 -- 172.21.15.89:0/2130564394 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f00a7050 con 0x7fd600129060 2024-03-20T13:36:26.780 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd5f7fff640 1 -- 172.21.15.89:0/2130564394 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00ab7e0 con 0x7fd600129060 2024-03-20T13:36:26.780 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 -- 172.21.15.89:0/2130564394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600129060 msgr2=0x7fd600130c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:26.780 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 --2- 172.21.15.89:0/2130564394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600129060 0x7fd600130c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009740 tx=0x7fd5f001c400 comp rx=0 tx=0).stop 2024-03-20T13:36:26.780 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 -- 172.21.15.89:0/2130564394 shutdown_connections 2024-03-20T13:36:26.781 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 --2- 172.21.15.89:0/2130564394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600129060 0x7fd600130c90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:26.781 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 -- 172.21.15.89:0/2130564394 >> 172.21.15.89:0/2130564394 conn(0x7fd60009a000 msgr2=0x7fd60009a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:26.781 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 -- 172.21.15.89:0/2130564394 shutdown_connections 2024-03-20T13:36:26.781 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.778+0000 7fd607825640 1 -- 172.21.15.89:0/2130564394 wait complete. 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 Processor -- start 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 -- start start 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 0x7fd60006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600130a60 con 0x7fd600128430 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd6055c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 0x7fd60006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd6055c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 0x7fd60006c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45890/0 (socket says 172.21.15.89:45890) 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd6055c1640 1 -- 172.21.15.89:0/2258199080 learned_addr learned my addr 172.21.15.89:0/2258199080 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd6055c1640 1 -- 172.21.15.89:0/2258199080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0009420 con 0x7fd600128430 2024-03-20T13:36:26.783 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd6055c1640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 0x7fd60006c0e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800cb20 tx=0x7fd5f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f800abf0 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f800ad50 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd600095550 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8012400 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd600125660 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd5f8007070 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600067fa0 con 0x7fd600128430 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd5f5ffb640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd5e4035a10 0x7fd5e4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:26.784 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3129+0+0 (secure 0 0 0) 0x7fd5f8047af0 con 0x7fd600128430 2024-03-20T13:36:26.785 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd604dc0640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd5e4035a10 0x7fd5e4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:26.785 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.782+0000 7fd604dc0640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd5e4035a10 0x7fd5e4037ed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009740 tx=0x7fd5f00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:26.788 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.786+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5f8007930 con 0x7fd600128430 2024-03-20T13:36:26.946 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.946+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd60006dec0 con 0x7fd600128430 2024-03-20T13:36:26.947 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.946+0000 7fd5f5ffb640 1 -- 172.21.15.89:0/2258199080 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7978 (secure 0 0 0) 0x7fd5f8047e60 con 0x7fd600128430 2024-03-20T13:36:26.947 INFO:teuthology.misc.health.smithi089.stdout: 2024-03-20T13:36:26.947 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":14,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:36:24.725774+0000","last_up_change":"2024-03-20T13:36:20.709715+0000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:36:22.313256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6801","nonce":854515999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6803","nonce":854515999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6807","nonce":854515999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6805","nonce":854515999}]},"public_addr":"172.21.15.89:6801/854515999","cluster_addr":"172.21.15.89:6803/854515999","heartbeat_back_addr":"172.21.15.89:6807/854515999","heartbeat_front_addr":"172.21.15.89:6805/854515999","state":["exists","up"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6801","nonce":3706732118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6804","nonce":3706732118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6813","nonce":3706732118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6808","nonce":3706732118}]},"public_addr":"172.21.15.123:6801/3706732118","cluster_addr":"172.21.15.123:6804/3706732118","heartbeat_back_addr":"172.21.15.123:6813/3706732118","heartbeat_front_addr":"172.21.15.123:6808/3706732118","state":["exists","up"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6803","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6805","nonce":1251286685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6807","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6809","nonce":1251286685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6815","nonce":1251286685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6811","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6812","nonce":1251286685}]},"public_addr":"172.21.15.123:6805/1251286685","cluster_addr":"172.21.15.123:6809/1251286685","heartbeat_back_addr":"172.21.15.123:6815/1251286685","heartbeat_front_addr":"172.21.15.123:6812/1251286685","state":["exists","up"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6817","nonce":3519650013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6819","nonce":3519650013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6823","nonce":3519650013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6821","nonce":3519650013}]},"public_addr":"172.21.15.123:6817/3519650013","cluster_addr":"172.21.15.123:6819/3519650013","heartbeat_back_addr":"172.21.15.123:6823/3519650013","heartbeat_front_addr":"172.21.15.123:6821/3519650013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.066936+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.327428+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.161844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.172631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd5e4035a10 msgr2=0x7fd5e4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd5e4035a10 0x7fd5e4037ed0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009740 tx=0x7fd5f00a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 msgr2=0x7fd60006c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 0x7fd60006c0e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800cb20 tx=0x7fd5f800a060 comp rx=0 tx=0).stop 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 shutdown_connections 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd5e4035a10 0x7fd5e4037ed0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 --2- 172.21.15.89:0/2258199080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd600128430 0x7fd60006c0e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:26.950 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 >> 172.21.15.89:0/2258199080 conn(0x7fd60009a000 msgr2=0x7fd600096930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:26.951 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 shutdown_connections 2024-03-20T13:36:26.951 INFO:teuthology.misc.health.smithi089.stderr:2024-03-20T13:36:26.950+0000 7fd607825640 1 -- 172.21.15.89:0/2258199080 wait complete. 2024-03-20T13:36:26.965 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-03-20T13:36:26.965 INFO:tasks.ceph:Creating RBD pool 2024-03-20T13:36:26.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-20T13:36:27.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f23313fc640 1 Processor -- start 2024-03-20T13:36:27.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f23313fc640 1 -- start start 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f23313fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f232c098910 0x7f232c098cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f23313fc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c073250 con 0x7f232c099230 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f23313fc640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c096da0 con 0x7f232c098910 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f232affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f232c098910 0x7f232c098cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f2323fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f232c099230 0x7f232c132570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51706/0 (socket says 172.21.15.89:51706) 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.078+0000 7f2323fff640 1 -- 172.21.15.89:0/4131374231 learned_addr learned my addr 172.21.15.89:0/4131374231 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232a7fc640 1 -- 172.21.15.89:0/4131374231 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923498259 0 0) 0x7f232c073250 con 0x7f232c099230 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232a7fc640 1 -- 172.21.15.89:0/4131374231 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2318003530 con 0x7f232c099230 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232affd640 1 -- 172.21.15.89:0/4131374231 >> v1:172.21.15.89:6789/0 conn(0x7f232c099230 legacy=0x7f232c132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:27.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232affd640 1 -- 172.21.15.89:0/4131374231 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c099ee0 con 0x7f232c098910 2024-03-20T13:36:27.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232affd640 1 --2- 172.21.15.89:0/4131374231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c098cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2314009740 tx=0x7f231401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce2860ac412bf76 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:27.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232a7fc640 1 -- 172.21.15.89:0/4131374231 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23140ab530 con 0x7f232c098910 2024-03-20T13:36:27.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232a7fc640 1 -- 172.21.15.89:0/4131374231 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23140a7050 con 0x7f232c098910 2024-03-20T13:36:27.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f232a7fc640 1 -- 172.21.15.89:0/4131374231 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23140ab7e0 con 0x7f232c098910 2024-03-20T13:36:27.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 -- 172.21.15.89:0/4131374231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 msgr2=0x7f232c098cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:27.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 --2- 172.21.15.89:0/4131374231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c098cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2314009740 tx=0x7f231401c370 comp rx=0 tx=0).stop 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 -- 172.21.15.89:0/4131374231 shutdown_connections 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 --2- 172.21.15.89:0/4131374231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c098cf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 -- 172.21.15.89:0/4131374231 >> 172.21.15.89:0/4131374231 conn(0x7f232c09e900 msgr2=0x7f232c09ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 -- 172.21.15.89:0/4131374231 shutdown_connections 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.082+0000 7f23313fc640 1 -- 172.21.15.89:0/4131374231 wait complete. 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 Processor -- start 2024-03-20T13:36:27.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 -- start start 2024-03-20T13:36:27.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c1322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c125ab0 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f232affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c1322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f232affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c1322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45908/0 (socket says 172.21.15.89:45908) 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f232affd640 1 -- 172.21.15.89:0/4081488834 learned_addr learned my addr 172.21.15.89:0/4081488834 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f232affd640 1 -- 172.21.15.89:0/4081488834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314009420 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f232affd640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c1322c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23140ae040 tx=0x7f231401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23140b7450 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23140b75b0 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c125c90 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23140b7850 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c094fe0 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c096350 con 0x7f232c098910 2024-03-20T13:36:27.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f23140b79b0 con 0x7f232c098910 2024-03-20T13:36:27.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23237fe640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f230c035a40 0x7f230c037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:27.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f23140e2590 con 0x7f232c098910 2024-03-20T13:36:27.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f2323fff640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f230c035a40 0x7f230c037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:27.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.086+0000 7f2323fff640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f230c035a40 0x7f230c037f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f231c007fd0 tx=0x7f231c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.090+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f23140c76c0 con 0x7f232c098910 2024-03-20T13:36:27.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.238+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f232c095480 con 0x7f232c098910 2024-03-20T13:36:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.734+0000 7f23237fe640 1 -- 172.21.15.89:0/4081488834 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f23140b0020 con 0x7f232c098910 2024-03-20T13:36:27.734 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2024-03-20T13:36:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f230c035a40 msgr2=0x7f230c037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f230c035a40 0x7f230c037f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f231c007fd0 tx=0x7f231c007980 comp rx=0 tx=0).stop 2024-03-20T13:36:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 msgr2=0x7f232c1322c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:27.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c1322c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23140ae040 tx=0x7f231401abb0 comp rx=0 tx=0).stop 2024-03-20T13:36:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 shutdown_connections 2024-03-20T13:36:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f230c035a40 0x7f230c037f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 --2- 172.21.15.89:0/4081488834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c098910 0x7f232c1322c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 >> 172.21.15.89:0/4081488834 conn(0x7f232c09e900 msgr2=0x7f232c06fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 shutdown_connections 2024-03-20T13:36:27.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.738+0000 7f23313fc640 1 -- 172.21.15.89:0/4081488834 wait complete. 2024-03-20T13:36:27.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-20T13:36:27.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.886+0000 7f504ee0f640 1 Processor -- start 2024-03-20T13:36:27.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.886+0000 7f504ee0f640 1 -- start start 2024-03-20T13:36:27.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f504812dd50 0x7f504812e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:27.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504809a700 con 0x7f504809d620 2024-03-20T13:36:27.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480a1240 con 0x7f504812dd50 2024-03-20T13:36:27.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504cbab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f504812dd50 0x7f504812e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:27.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f5047fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f504809d620 0x7f5048096490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51722/0 (socket says 172.21.15.89:51722) 2024-03-20T13:36:27.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504cbab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f504812dd50 0x7f504812e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45916/0 (socket says 172.21.15.89:45916) 2024-03-20T13:36:27.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f5047fff640 1 -- 172.21.15.89:0/2773148718 learned_addr learned my addr 172.21.15.89:0/2773148718 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:27.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504cbab640 1 -- 172.21.15.89:0/2773148718 >> v1:172.21.15.89:6789/0 conn(0x7f504809d620 legacy=0x7f5048096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:27.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504cbab640 1 -- 172.21.15.89:0/2773148718 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504809a0b0 con 0x7f504812dd50 2024-03-20T13:36:27.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f50477fe640 1 -- 172.21.15.89:0/2773148718 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777313454 0 0) 0x7f504809a700 con 0x7f504809d620 2024-03-20T13:36:27.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504cbab640 1 --2- 172.21.15.89:0/2773148718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504812dd50 0x7f504812e130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5038009740 tx=0x7f503801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba2ee99bd33dfa5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:27.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f50477fe640 1 -- 172.21.15.89:0/2773148718 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50380a8050 con 0x7f504812dd50 2024-03-20T13:36:27.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f50477fe640 1 -- 172.21.15.89:0/2773148718 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50380ac520 con 0x7f504812dd50 2024-03-20T13:36:27.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f50477fe640 1 -- 172.21.15.89:0/2773148718 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50380ac7e0 con 0x7f504812dd50 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- 172.21.15.89:0/2773148718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504812dd50 msgr2=0x7f504812e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 --2- 172.21.15.89:0/2773148718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504812dd50 0x7f504812e130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5038009740 tx=0x7f503801c370 comp rx=0 tx=0).stop 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- 172.21.15.89:0/2773148718 shutdown_connections 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 --2- 172.21.15.89:0/2773148718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504812dd50 0x7f504812e130 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- 172.21.15.89:0/2773148718 >> 172.21.15.89:0/2773148718 conn(0x7f50480a0920 msgr2=0x7f504809ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- 172.21.15.89:0/2773148718 shutdown_connections 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.890+0000 7f504ee0f640 1 -- 172.21.15.89:0/2773148718 wait complete. 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 Processor -- start 2024-03-20T13:36:27.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 -- start start 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 0x7f504806f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048133ef0 con 0x7f504809d620 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504cbab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 0x7f504806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504cbab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 0x7f504806f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45918/0 (socket says 172.21.15.89:45918) 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504cbab640 1 -- 172.21.15.89:0/483298729 learned_addr learned my addr 172.21.15.89:0/483298729 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504cbab640 1 -- 172.21.15.89:0/483298729 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038009420 con 0x7f504809d620 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504cbab640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 0x7f504806f880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5038019fa0 tx=0x7f503801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5038004020 con 0x7f504809d620 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5038004180 con 0x7f504809d620 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048125ec0 con 0x7f504809d620 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5038004460 con 0x7f504809d620 2024-03-20T13:36:27.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048071d70 con 0x7f504809d620 2024-03-20T13:36:27.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048071a60 con 0x7f504809d620 2024-03-20T13:36:27.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f50380b3050 con 0x7f504809d620 2024-03-20T13:36:27.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f50457fa640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50340359c0 0x7f5034037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:27.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f50380e2050 con 0x7f504809d620 2024-03-20T13:36:27.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f5047fff640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50340359c0 0x7f5034037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:27.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.894+0000 7f5047fff640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50340359c0 0x7f5034037e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f503c007fd0 tx=0x7f503c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:27.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:27.898+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50380b38f0 con 0x7f504809d620 2024-03-20T13:36:28.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.050+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5048062860 con 0x7f504809d620 2024-03-20T13:36:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.734+0000 7f50457fa640 1 -- 172.21.15.89:0/483298729 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f50380b1070 con 0x7f504809d620 2024-03-20T13:36:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-20T13:36:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50340359c0 msgr2=0x7f5034037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50340359c0 0x7f5034037e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f503c007fd0 tx=0x7f503c007920 comp rx=0 tx=0).stop 2024-03-20T13:36:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 msgr2=0x7f504806f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 0x7f504806f880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5038019fa0 tx=0x7f503801abb0 comp rx=0 tx=0).stop 2024-03-20T13:36:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 shutdown_connections 2024-03-20T13:36:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50340359c0 0x7f5034037e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 --2- 172.21.15.89:0/483298729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f504809d620 0x7f504806f880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 >> 172.21.15.89:0/483298729 conn(0x7f50480a0920 msgr2=0x7f504809ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 shutdown_connections 2024-03-20T13:36:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.738+0000 7f504ee0f640 1 -- 172.21.15.89:0/483298729 wait complete. 2024-03-20T13:36:28.759 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-20T13:36:28.759 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-20T13:36:28.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-20T13:36:28.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-20T13:36:28.760 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-20T13:36:28.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff7159a1640 1 Processor -- start 2024-03-20T13:36:28.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff7159a1640 1 -- start start 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff7159a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff71012d530 0x7ff71012f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff7159a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff710094180 con 0x7ff710092560 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff7159a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff710093050 con 0x7ff71012d530 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff70e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff71012d530 0x7ff71012f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff70e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff71012d530 0x7ff71012f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45920/0 (socket says 172.21.15.89:45920) 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff70effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff710092560 0x7ff710092940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51726/0 (socket says 172.21.15.89:51726) 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff70e7fc640 1 -- 172.21.15.89:0/3173272987 learned_addr learned my addr 172.21.15.89:0/3173272987 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff70e7fc640 1 -- 172.21.15.89:0/3173272987 >> v1:172.21.15.89:6789/0 conn(0x7ff710092560 legacy=0x7ff710092940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:28.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.874+0000 7ff70e7fc640 1 -- 172.21.15.89:0/3173272987 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100958f0 con 0x7ff71012d530 2024-03-20T13:36:28.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff70e7fc640 1 --2- 172.21.15.89:0/3173272987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff71012d530 0x7ff71012f920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff704006fd0 tx=0x7ff70401e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c283370b5f981 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:28.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff70dffb640 1 -- 172.21.15.89:0/3173272987 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff704004160 con 0x7ff71012d530 2024-03-20T13:36:28.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff70dffb640 1 -- 172.21.15.89:0/3173272987 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7040ab070 con 0x7ff71012d530 2024-03-20T13:36:28.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff70dffb640 1 -- 172.21.15.89:0/3173272987 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff704004470 con 0x7ff71012d530 2024-03-20T13:36:28.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 -- 172.21.15.89:0/3173272987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff71012d530 msgr2=0x7ff71012f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:28.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 --2- 172.21.15.89:0/3173272987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff71012d530 0x7ff71012f920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff704006fd0 tx=0x7ff70401e8e0 comp rx=0 tx=0).stop 2024-03-20T13:36:28.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 -- 172.21.15.89:0/3173272987 shutdown_connections 2024-03-20T13:36:28.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 --2- 172.21.15.89:0/3173272987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff71012d530 0x7ff71012f920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:28.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 -- 172.21.15.89:0/3173272987 >> 172.21.15.89:0/3173272987 conn(0x7ff71009a2f0 msgr2=0x7ff71009a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:28.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 -- 172.21.15.89:0/3173272987 shutdown_connections 2024-03-20T13:36:28.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 -- 172.21.15.89:0/3173272987 wait complete. 2024-03-20T13:36:28.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 Processor -- start 2024-03-20T13:36:28.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.878+0000 7ff7159a1640 1 -- start start 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff7159a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 0x7ff71008b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff7159a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71008e410 con 0x7ff710092560 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 0x7ff71008b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 0x7ff71008b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45936/0 (socket says 172.21.15.89:45936) 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70effd640 1 -- 172.21.15.89:0/3474766990 learned_addr learned my addr 172.21.15.89:0/3474766990 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70effd640 1 -- 172.21.15.89:0/3474766990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70400b780 con 0x7ff710092560 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70effd640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 0x7ff71008b3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff70000c410 tx=0x7ff70000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:28.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff700007410 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff700007570 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff710071e40 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7000047f0 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7100982e0 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff710067e00 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff700004950 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff6f7fff640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6fc035a10 0x7ff6fc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff700047750 con 0x7ff710092560 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70e7fc640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6fc035a10 0x7ff6fc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:28.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.882+0000 7ff70e7fc640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6fc035a10 0x7ff6fc037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7040b1000 tx=0x7ff7040a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:28.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:28.886+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff70001ad00 con 0x7ff710092560 2024-03-20T13:36:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.082+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff710062860 con 0x7ff710092560 2024-03-20T13:36:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.086+0000 7ff6f7fff640 1 -- 172.21.15.89:0/3474766990 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83333 (secure 0 0 0) 0x7ff70001ad00 con 0x7ff710092560 2024-03-20T13:36:29.088 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:29.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6fc035a10 msgr2=0x7ff6fc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6fc035a10 0x7ff6fc037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7040b1000 tx=0x7ff7040a9070 comp rx=0 tx=0).stop 2024-03-20T13:36:29.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 msgr2=0x7ff71008b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 0x7ff71008b3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff70000c410 tx=0x7ff70000c8d0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 shutdown_connections 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6fc035a10 0x7ff6fc037ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 --2- 172.21.15.89:0/3474766990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff710092560 0x7ff71008b3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 >> 172.21.15.89:0/3474766990 conn(0x7ff71009a2f0 msgr2=0x7ff710090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 shutdown_connections 2024-03-20T13:36:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.090+0000 7ff7159a1640 1 -- 172.21.15.89:0/3474766990 wait complete. 2024-03-20T13:36:29.106 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2420952722},{"type":"v1","addr":"172.21.15.123:6825","nonce":2420952722}]},"active_addr":"172.21.15.123:6825/2420952722","active_change":"2024-03-20T13:36:16.232525+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":648056165}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1587730153}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2302072290}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":697198803}]}]} 2024-03-20T13:36:29.108 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-20T13:36:29.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-20T13:36:29.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:29.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f60099d7640 1 Processor -- start 2024-03-20T13:36:29.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f60099d7640 1 -- start start 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f60099d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6004128d10 0x7f60041290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f60099d7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6004095ee0 con 0x7f600412bb20 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f60099d7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6004095b30 con 0x7f6004128d10 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f6002ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6004128d10 0x7f60041290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f6002ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6004128d10 0x7f60041290f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45944/0 (socket says 172.21.15.89:45944) 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f60027fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f600412bb20 0x7f600412bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51730/0 (socket says 172.21.15.89:51730) 2024-03-20T13:36:29.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.222+0000 7f6002ffd640 1 -- 172.21.15.89:0/466585979 learned_addr learned my addr 172.21.15.89:0/466585979 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f6002ffd640 1 -- 172.21.15.89:0/466585979 >> v1:172.21.15.89:6789/0 conn(0x7f600412bb20 legacy=0x7f600412bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f6002ffd640 1 -- 172.21.15.89:0/466585979 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004096320 con 0x7f6004128d10 2024-03-20T13:36:29.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f6002ffd640 1 --2- 172.21.15.89:0/466585979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041290f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80097f0 tx=0x7f5ff801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0254be680dd247 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f6001ffb640 1 -- 172.21.15.89:0/466585979 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff80ab530 con 0x7f6004128d10 2024-03-20T13:36:29.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f6001ffb640 1 -- 172.21.15.89:0/466585979 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80a7050 con 0x7f6004128d10 2024-03-20T13:36:29.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f6001ffb640 1 -- 172.21.15.89:0/466585979 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff80ab7e0 con 0x7f6004128d10 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 -- 172.21.15.89:0/466585979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 msgr2=0x7f60041290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 --2- 172.21.15.89:0/466585979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041290f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80097f0 tx=0x7f5ff801c4c0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 -- 172.21.15.89:0/466585979 shutdown_connections 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 --2- 172.21.15.89:0/466585979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041290f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 -- 172.21.15.89:0/466585979 >> 172.21.15.89:0/466585979 conn(0x7f600409a2f0 msgr2=0x7f600409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 -- 172.21.15.89:0/466585979 shutdown_connections 2024-03-20T13:36:29.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.226+0000 7f60099d7640 1 -- 172.21.15.89:0/466585979 wait complete. 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 Processor -- start 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 -- start start 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6004123400 con 0x7f6004128d10 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f6002ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f6002ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45950/0 (socket says 172.21.15.89:45950) 2024-03-20T13:36:29.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f6002ffd640 1 -- 172.21.15.89:0/2514941338 learned_addr learned my addr 172.21.15.89:0/2514941338 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f6002ffd640 1 -- 172.21.15.89:0/2514941338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80094d0 con 0x7f6004128d10 2024-03-20T13:36:29.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f6002ffd640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041c3ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80ae040 tx=0x7f5ff8019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff80aa760 con 0x7f6004128d10 2024-03-20T13:36:29.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80aa8c0 con 0x7f6004128d10 2024-03-20T13:36:29.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ff80aab60 con 0x7f6004128d10 2024-03-20T13:36:29.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60041238d0 con 0x7f6004128d10 2024-03-20T13:36:29.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6004130d40 con 0x7f6004128d10 2024-03-20T13:36:29.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5ff80b2040 con 0x7f6004128d10 2024-03-20T13:36:29.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004067e00 con 0x7f6004128d10 2024-03-20T13:36:29.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f5febfff640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ff0035a40 0x7f5ff0037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f5ff80e2330 con 0x7f6004128d10 2024-03-20T13:36:29.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60027fc640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ff0035a40 0x7f5ff0037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.230+0000 7f60027fc640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ff0035a40 0x7f5ff0037f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4000f70 tx=0x7f5ff4007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.234+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ff80bc9a0 con 0x7f6004128d10 2024-03-20T13:36:29.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.386+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6004062860 con 0x7f6004128d10 2024-03-20T13:36:29.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f5febfff640 1 -- 172.21.15.89:0/2514941338 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9758 (secure 0 0 0) 0x7f5ff80b0070 con 0x7f6004128d10 2024-03-20T13:36:29.390 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:29.390 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":16,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:36:28.737564+0000","last_up_change":"2024-03-20T13:36:20.709715+0000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:36:22.313256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-20T13:36:27.278625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6801","nonce":854515999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6803","nonce":854515999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6807","nonce":854515999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6805","nonce":854515999}]},"public_addr":"172.21.15.89:6801/854515999","cluster_addr":"172.21.15.89:6803/854515999","heartbeat_back_addr":"172.21.15.89:6807/854515999","heartbeat_front_addr":"172.21.15.89:6805/854515999","state":["exists","up"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6801","nonce":3706732118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6804","nonce":3706732118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6813","nonce":3706732118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6808","nonce":3706732118}]},"public_addr":"172.21.15.123:6801/3706732118","cluster_addr":"172.21.15.123:6804/3706732118","heartbeat_back_addr":"172.21.15.123:6813/3706732118","heartbeat_front_addr":"172.21.15.123:6808/3706732118","state":["exists","up"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6803","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6805","nonce":1251286685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6807","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6809","nonce":1251286685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6815","nonce":1251286685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6811","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6812","nonce":1251286685}]},"public_addr":"172.21.15.123:6805/1251286685","cluster_addr":"172.21.15.123:6809/1251286685","heartbeat_back_addr":"172.21.15.123:6815/1251286685","heartbeat_front_addr":"172.21.15.123:6812/1251286685","state":["exists","up"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6817","nonce":3519650013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6819","nonce":3519650013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6823","nonce":3519650013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6821","nonce":3519650013}]},"public_addr":"172.21.15.123:6817/3519650013","cluster_addr":"172.21.15.123:6819/3519650013","heartbeat_back_addr":"172.21.15.123:6823/3519650013","heartbeat_front_addr":"172.21.15.123:6821/3519650013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.066936+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.327428+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.161844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.172631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:29.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ff0035a40 msgr2=0x7f5ff0037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ff0035a40 0x7f5ff0037f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4000f70 tx=0x7f5ff4007a90 comp rx=0 tx=0).stop 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 msgr2=0x7f60041c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041c3ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80ae040 tx=0x7f5ff8019260 comp rx=0 tx=0).stop 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 shutdown_connections 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ff0035a40 0x7f5ff0037f00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 --2- 172.21.15.89:0/2514941338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6004128d10 0x7f60041c3ac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 >> 172.21.15.89:0/2514941338 conn(0x7f600409a2f0 msgr2=0x7f60040971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 shutdown_connections 2024-03-20T13:36:29.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.390+0000 7f60099d7640 1 -- 172.21.15.89:0/2514941338 wait complete. 2024-03-20T13:36:29.408 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-20T13:36:29.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.510+0000 7f781eef0640 1 Processor -- start 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.510+0000 7f781eef0640 1 -- start start 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.510+0000 7f781eef0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7818128d10 0x7f78181290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.510+0000 7f781eef0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7818095ee0 con 0x7f781812bb20 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7818095b30 con 0x7f7818128d10 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781cc8c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7818128d10 0x7f78181290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f7817fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f781812bb20 0x7f781812bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51736/0 (socket says 172.21.15.89:51736) 2024-03-20T13:36:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f7817fff640 1 -- 172.21.15.89:0/2836574424 learned_addr learned my addr 172.21.15.89:0/2836574424 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:29.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781cc8c640 1 -- 172.21.15.89:0/2836574424 >> v1:172.21.15.89:6789/0 conn(0x7f781812bb20 legacy=0x7f781812bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f78177fe640 1 -- 172.21.15.89:0/2836574424 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649316157 0 0) 0x7f7818095ee0 con 0x7f781812bb20 2024-03-20T13:36:29.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781cc8c640 1 -- 172.21.15.89:0/2836574424 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818096320 con 0x7f7818128d10 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781cc8c640 1 --2- 172.21.15.89:0/2836574424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181290f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7810009d90 tx=0x7f781001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41cc520a933526c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f78177fe640 1 -- 172.21.15.89:0/2836574424 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78100a56c0 con 0x7f7818128d10 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f78177fe640 1 -- 172.21.15.89:0/2836574424 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78100a5820 con 0x7f7818128d10 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f78177fe640 1 -- 172.21.15.89:0/2836574424 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78100a5ae0 con 0x7f7818128d10 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 -- 172.21.15.89:0/2836574424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 msgr2=0x7f78181290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 --2- 172.21.15.89:0/2836574424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181290f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7810009d90 tx=0x7f781001c950 comp rx=0 tx=0).stop 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 -- 172.21.15.89:0/2836574424 shutdown_connections 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 --2- 172.21.15.89:0/2836574424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181290f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 -- 172.21.15.89:0/2836574424 >> 172.21.15.89:0/2836574424 conn(0x7f781809a2f0 msgr2=0x7f781809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 -- 172.21.15.89:0/2836574424 shutdown_connections 2024-03-20T13:36:29.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.514+0000 7f781eef0640 1 -- 172.21.15.89:0/2836574424 wait complete. 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 Processor -- start 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 -- start start 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818130c40 con 0x7f7818128d10 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781cc8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781cc8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45964/0 (socket says 172.21.15.89:45964) 2024-03-20T13:36:29.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781cc8c640 1 -- 172.21.15.89:0/2716679022 learned_addr learned my addr 172.21.15.89:0/2716679022 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781cc8c640 1 -- 172.21.15.89:0/2716679022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810009a70 con 0x7f7818128d10 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781cc8c640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181c3ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f781001ce30 tx=0x7f78100196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78100039a0 con 0x7f7818128d10 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810003b00 con 0x7f7818128d10 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7818130280 con 0x7f7818128d10 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7810003da0 con 0x7f7818128d10 2024-03-20T13:36:29.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78180980f0 con 0x7f7818128d10 2024-03-20T13:36:29.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7818067e00 con 0x7f7818128d10 2024-03-20T13:36:29.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f78100b4040 con 0x7f7818128d10 2024-03-20T13:36:29.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f78157fa640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f77f8035a10 0x7f77f8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f78100e3390 con 0x7f7818128d10 2024-03-20T13:36:29.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f7817fff640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f77f8035a10 0x7f77f8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.518+0000 7f7817fff640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f77f8035a10 0x7f77f8037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.522+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f78100b5a10 con 0x7f7818128d10 2024-03-20T13:36:29.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78181312e0 con 0x7f7818128d10 2024-03-20T13:36:29.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f78157fa640 1 -- 172.21.15.89:0/2716679022 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9758 (secure 0 0 0) 0x7f78100b2070 con 0x7f7818128d10 2024-03-20T13:36:29.678 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:29.679 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":16,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:36:28.737564+0000","last_up_change":"2024-03-20T13:36:20.709715+0000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:36:22.313256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-20T13:36:27.278625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6801","nonce":854515999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6803","nonce":854515999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6807","nonce":854515999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6805","nonce":854515999}]},"public_addr":"172.21.15.89:6801/854515999","cluster_addr":"172.21.15.89:6803/854515999","heartbeat_back_addr":"172.21.15.89:6807/854515999","heartbeat_front_addr":"172.21.15.89:6805/854515999","state":["exists","up"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6801","nonce":3706732118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6804","nonce":3706732118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6813","nonce":3706732118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6808","nonce":3706732118}]},"public_addr":"172.21.15.123:6801/3706732118","cluster_addr":"172.21.15.123:6804/3706732118","heartbeat_back_addr":"172.21.15.123:6813/3706732118","heartbeat_front_addr":"172.21.15.123:6808/3706732118","state":["exists","up"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6803","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6805","nonce":1251286685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6807","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6809","nonce":1251286685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6815","nonce":1251286685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6811","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6812","nonce":1251286685}]},"public_addr":"172.21.15.123:6805/1251286685","cluster_addr":"172.21.15.123:6809/1251286685","heartbeat_back_addr":"172.21.15.123:6815/1251286685","heartbeat_front_addr":"172.21.15.123:6812/1251286685","state":["exists","up"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6817","nonce":3519650013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6819","nonce":3519650013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6823","nonce":3519650013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6821","nonce":3519650013}]},"public_addr":"172.21.15.123:6817/3519650013","cluster_addr":"172.21.15.123:6819/3519650013","heartbeat_back_addr":"172.21.15.123:6823/3519650013","heartbeat_front_addr":"172.21.15.123:6821/3519650013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.066936+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.327428+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.161844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.172631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:29.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f77f8035a10 msgr2=0x7f77f8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f77f8035a10 0x7f77f8037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800007920 comp rx=0 tx=0).stop 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 msgr2=0x7f78181c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181c3ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f781001ce30 tx=0x7f78100196f0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 shutdown_connections 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f77f8035a10 0x7f77f8037ed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 --2- 172.21.15.89:0/2716679022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7818128d10 0x7f78181c3ac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 >> 172.21.15.89:0/2716679022 conn(0x7f781809a2f0 msgr2=0x7f7818121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.678+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 shutdown_connections 2024-03-20T13:36:29.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.682+0000 7f781eef0640 1 -- 172.21.15.89:0/2716679022 wait complete. 2024-03-20T13:36:29.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-20T13:36:29.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-20T13:36:29.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-20T13:36:29.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-20T13:36:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f64769c4640 1 Processor -- start 2024-03-20T13:36:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f14750da640 1 Processor -- start 2024-03-20T13:36:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f64769c4640 1 -- start start 2024-03-20T13:36:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f14750da640 1 -- start start 2024-03-20T13:36:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f64769c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f647012eaf0 0x7f6470133100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f64769c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647012dde0 con 0x7f647012e000 2024-03-20T13:36:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f64769c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647009ced0 con 0x7f647012eaf0 2024-03-20T13:36:29.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f14750da640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f147012df20 0x7f1470130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f14750da640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147006f950 con 0x7f1470096410 2024-03-20T13:36:29.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f14750da640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147006f390 con 0x7f147012df20 2024-03-20T13:36:29.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f146e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f147012df20 0x7f1470130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.802+0000 7f146e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f147012df20 0x7f1470130310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45982/0 (socket says 172.21.15.89:45982) 2024-03-20T13:36:29.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146e59c640 1 -- 172.21.15.89:0/616593352 learned_addr learned my addr 172.21.15.89:0/616593352 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f647012eaf0 0x7f6470133100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f647012eaf0 0x7f6470133100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45970/0 (socket says 172.21.15.89:45970) 2024-03-20T13:36:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646f7fe640 1 -- 172.21.15.89:0/583087144 learned_addr learned my addr 172.21.15.89:0/583087144 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646ffff640 1 --1- 172.21.15.89:0/583087144 >> v1:172.21.15.89:6789/0 conn(0x7f647012e000 0x7f647012e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51748/0 (socket says 172.21.15.89:51748) 2024-03-20T13:36:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146e59c640 1 -- 172.21.15.89:0/616593352 >> v1:172.21.15.89:6789/0 conn(0x7f1470096410 legacy=0x7f14700967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:36:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146e59c640 1 -- 172.21.15.89:0/616593352 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470096f00 con 0x7f147012df20 2024-03-20T13:36:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646f7fe640 1 -- 172.21.15.89:0/583087144 >> v1:172.21.15.89:6789/0 conn(0x7f647012e000 legacy=0x7f647012e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646f7fe640 1 -- 172.21.15.89:0/583087144 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470091bb0 con 0x7f647012eaf0 2024-03-20T13:36:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b07217640 1 Processor -- start 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b07217640 1 -- start start 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b07217640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b000992b0 0x7f1b001330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b07217640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0009a130 con 0x7f1b000987c0 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b07217640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000727b0 con 0x7f1b000992b0 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1afffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b000992b0 0x7f1b001330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b04fb3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1b000987c0 0x7f1b00098ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51762/0 (socket says 172.21.15.89:51762) 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1b04fb3640 1 -- 172.21.15.89:0/2994528175 learned_addr learned my addr 172.21.15.89:0/2994528175 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146e59c640 1 --2- 172.21.15.89:0/616593352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f147012df20 0x7f1470130310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14640097f0 tx=0x7f146401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54717c427b8e161 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1afffff640 1 -- 172.21.15.89:0/2994528175 >> v1:172.21.15.89:6789/0 conn(0x7f1b000987c0 legacy=0x7f1b00098ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f1afffff640 1 -- 172.21.15.89:0/2994528175 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000a11b0 con 0x7f1b000992b0 2024-03-20T13:36:29.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646f7fe640 1 --2- 172.21.15.89:0/583087144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012eaf0 0x7f6470133100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64640097f0 tx=0x7f646401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b21b0ad55269a9b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146dd9b640 1 -- 172.21.15.89:0/616593352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14640ab530 con 0x7f147012df20 2024-03-20T13:36:29.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146dd9b640 1 -- 172.21.15.89:0/616593352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14640a7050 con 0x7f147012df20 2024-03-20T13:36:29.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f146dd9b640 1 -- 172.21.15.89:0/616593352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14640ab7e0 con 0x7f147012df20 2024-03-20T13:36:29.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646effd640 1 -- 172.21.15.89:0/583087144 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64640ab520 con 0x7f647012eaf0 2024-03-20T13:36:29.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646effd640 1 -- 172.21.15.89:0/583087144 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640ab680 con 0x7f647012eaf0 2024-03-20T13:36:29.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f646effd640 1 -- 172.21.15.89:0/583087144 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64640ab940 con 0x7f647012eaf0 2024-03-20T13:36:29.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 -- 172.21.15.89:0/616593352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f147012df20 msgr2=0x7f1470130310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 --2- 172.21.15.89:0/616593352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f147012df20 0x7f1470130310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14640097f0 tx=0x7f146401c430 comp rx=0 tx=0).stop 2024-03-20T13:36:29.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 -- 172.21.15.89:0/616593352 shutdown_connections 2024-03-20T13:36:29.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 --2- 172.21.15.89:0/616593352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f147012df20 0x7f1470130310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 -- 172.21.15.89:0/616593352 >> 172.21.15.89:0/616593352 conn(0x7f147009c8e0 msgr2=0x7f147009ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 -- 172.21.15.89:0/616593352 shutdown_connections 2024-03-20T13:36:29.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f14750da640 1 -- 172.21.15.89:0/616593352 wait complete. 2024-03-20T13:36:29.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f64769c4640 1 -- 172.21.15.89:0/583087144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012eaf0 msgr2=0x7f6470133100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.806+0000 7f64769c4640 1 --2- 172.21.15.89:0/583087144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012eaf0 0x7f6470133100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64640097f0 tx=0x7f646401c4c0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- 172.21.15.89:0/583087144 shutdown_connections 2024-03-20T13:36:29.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 --2- 172.21.15.89:0/583087144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012eaf0 0x7f6470133100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- 172.21.15.89:0/583087144 >> 172.21.15.89:0/583087144 conn(0x7f647009b1d0 msgr2=0x7f647009b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- 172.21.15.89:0/583087144 shutdown_connections 2024-03-20T13:36:29.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- 172.21.15.89:0/583087144 wait complete. 2024-03-20T13:36:29.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 Processor -- start 2024-03-20T13:36:29.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 -- start start 2024-03-20T13:36:29.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 Processor -- start 2024-03-20T13:36:29.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- start start 2024-03-20T13:36:29.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 0x7f147008fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470093370 con 0x7f1470096410 2024-03-20T13:36:29.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 0x7f64701c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701325f0 con 0x7f647012e000 2024-03-20T13:36:29.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 0x7f147008fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 0x7f147008fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45986/0 (socket says 172.21.15.89:45986) 2024-03-20T13:36:29.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f146ed9d640 1 -- 172.21.15.89:0/3389601832 learned_addr learned my addr 172.21.15.89:0/3389601832 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 0x7f64701c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 0x7f64701c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45988/0 (socket says 172.21.15.89:45988) 2024-03-20T13:36:29.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646ffff640 1 -- 172.21.15.89:0/3814510360 learned_addr learned my addr 172.21.15.89:0/3814510360 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1afffff640 1 --2- 172.21.15.89:0/2994528175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000992b0 0x7f1b001330f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009740 tx=0x7f1af001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25da85c6439fa75c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f146ed9d640 1 -- 172.21.15.89:0/3389601832 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640094d0 con 0x7f1470096410 2024-03-20T13:36:29.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1aff7fe640 1 -- 172.21.15.89:0/2994528175 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1af00ab530 con 0x7f1b000992b0 2024-03-20T13:36:29.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f146ed9d640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 0x7f147008fd20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f146000c3a0 tx=0x7f146000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646ffff640 1 -- 172.21.15.89:0/3814510360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640094d0 con 0x7f647012e000 2024-03-20T13:36:29.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1aff7fe640 1 -- 172.21.15.89:0/2994528175 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af00a7050 con 0x7f1b000992b0 2024-03-20T13:36:29.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1aff7fe640 1 -- 172.21.15.89:0/2994528175 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1af00ab7e0 con 0x7f1b000992b0 2024-03-20T13:36:29.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1460005150 con 0x7f1470096410 2024-03-20T13:36:29.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14600052b0 con 0x7f1470096410 2024-03-20T13:36:29.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147006e650 con 0x7f1470096410 2024-03-20T13:36:29.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14600067e0 con 0x7f1470096410 2024-03-20T13:36:29.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646ffff640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 0x7f64701c5500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f646000c410 tx=0x7f646000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1470092720 con 0x7f1470096410 2024-03-20T13:36:29.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14700931b0 con 0x7f1470096410 2024-03-20T13:36:29.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1b07217640 1 -- 172.21.15.89:0/2994528175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000992b0 msgr2=0x7f1b001330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1b07217640 1 --2- 172.21.15.89:0/2994528175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000992b0 0x7f1b001330f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009740 tx=0x7f1af001c370 comp rx=0 tx=0).stop 2024-03-20T13:36:29.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6460007410 con 0x7f647012e000 2024-03-20T13:36:29.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647012b790 con 0x7f647012e000 2024-03-20T13:36:29.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470132860 con 0x7f647012e000 2024-03-20T13:36:29.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460007570 con 0x7f647012e000 2024-03-20T13:36:29.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64600047f0 con 0x7f647012e000 2024-03-20T13:36:29.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1b07217640 1 -- 172.21.15.89:0/2994528175 shutdown_connections 2024-03-20T13:36:29.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1b07217640 1 --2- 172.21.15.89:0/2994528175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000992b0 0x7f1b001330f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.810+0000 7f1b07217640 1 -- 172.21.15.89:0/2994528175 >> 172.21.15.89:0/2994528175 conn(0x7f1b000a08b0 msgr2=0x7f1b0009cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1460006940 con 0x7f1470096410 2024-03-20T13:36:29.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6450000f90 con 0x7f647012e000 2024-03-20T13:36:29.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f145c035a10 0x7f145c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f1460047730 con 0x7f1470096410 2024-03-20T13:36:29.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7f145c03b190 0x7f145c03d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f145c03dca0 con 0x7f145c03b190 2024-03-20T13:36:29.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1460047b30 con 0x7f1470096410 2024-03-20T13:36:29.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6460004950 con 0x7f647012e000 2024-03-20T13:36:29.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- 172.21.15.89:0/2994528175 shutdown_connections 2024-03-20T13:36:29.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- 172.21.15.89:0/2994528175 wait complete. 2024-03-20T13:36:29.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f146e59c640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f145c035a10 0x7f145c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646cff9640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f645c035a10 0x7f645c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f64600476f0 con 0x7f647012e000 2024-03-20T13:36:29.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f146f59e640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7f145c03b190 0x7f145c03d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646cff9640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f645c03b190 0x7f645c03d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f645c03dca0 con 0x7f645c03b190 2024-03-20T13:36:29.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646f7fe640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f645c035a10 0x7f645c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6460004c50 con 0x7f647012e000 2024-03-20T13:36:29.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 Processor -- start 2024-03-20T13:36:29.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f6474f61640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f645c03b190 0x7f645c03d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- start start 2024-03-20T13:36:29.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f146f59e640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7f145c03b190 0x7f145c03d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f146e59c640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f145c035a10 0x7f145c037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f147006c950 tx=0x7f14640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 0x7f1b0012b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0012ce20 con 0x7f1b000987c0 2024-03-20T13:36:29.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b04fb3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 0x7f1b0012b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b04fb3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 0x7f1b0012b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46004/0 (socket says 172.21.15.89:46004) 2024-03-20T13:36:29.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b04fb3640 1 -- 172.21.15.89:0/437533890 learned_addr learned my addr 172.21.15.89:0/437533890 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f646f7fe640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f645c035a10 0x7f645c037ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f64640af000 tx=0x7f64640a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b04fb3640 1 -- 172.21.15.89:0/437533890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0009420 con 0x7f1b000987c0 2024-03-20T13:36:29.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f6474f61640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f645c03b190 0x7f645c03d5d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b04fb3640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 0x7f1b0012b940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c480 tx=0x7f1af400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1af4005c20 con 0x7f1b000987c0 2024-03-20T13:36:29.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4005d80 con 0x7f1b000987c0 2024-03-20T13:36:29.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b00071ff0 con 0x7f1b000987c0 2024-03-20T13:36:29.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1af40071a0 con 0x7f1b000987c0 2024-03-20T13:36:29.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00071240 con 0x7f1b000987c0 2024-03-20T13:36:29.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b001334c0 con 0x7f1b000987c0 2024-03-20T13:36:29.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f145c03dca0 con 0x7f145c03b190 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1af4007300 con 0x7f1b000987c0 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.814+0000 7f1afd7fa640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1aec0359c0 0x7f1aec037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f1af4047280 con 0x7f1b000987c0 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f1afd7fa640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f1aec03b140 0x7f1aec03d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1aec03dc50 con 0x7f1aec03b140 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af4049970 con 0x7f1b000987c0 2024-03-20T13:36:29.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f645c03dca0 con 0x7f645c03b190 2024-03-20T13:36:29.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f1afffff640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1aec0359c0 0x7f1aec037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f1afffff640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1aec0359c0 0x7f1aec037e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009740 tx=0x7f1af00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41eb11c640 1 Processor -- start 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41eb11c640 1 -- start start 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41eb11c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f41dc0b1340 0x7f41dc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41eb11c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc01cde0 con 0x7f41dc0b1e80 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41eb11c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0b2300 con 0x7f41dc0b1340 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41e9919640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f41dc0b1e80 0x7f41dc0addc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51772/0 (socket says 172.21.15.89:51772) 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41e9919640 1 -- 172.21.15.89:0/3112770676 learned_addr learned my addr 172.21.15.89:0/3112770676 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41ea11a640 1 --2- 172.21.15.89:0/3112770676 >> v2:172.21.15.89:3300/0 conn(0x7f41dc0b1340 0x7f41dc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41e9118640 1 -- 172.21.15.89:0/3112770676 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800000534 0 0) 0x7f41dc01cde0 con 0x7f41dc0b1e80 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41e9118640 1 -- 172.21.15.89:0/3112770676 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d0003530 con 0x7f41dc0b1e80 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41ea11a640 1 -- 172.21.15.89:0/3112770676 >> v1:172.21.15.89:6789/0 conn(0x7f41dc0b1e80 legacy=0x7f41dc0addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.818+0000 7f41ea11a640 1 -- 172.21.15.89:0/3112770676 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc01c470 con 0x7f41dc0b1340 2024-03-20T13:36:29.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f1b057b4640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f1aec03b140 0x7f1aec03d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f1b057b4640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f1aec03b140 0x7f1aec03d580 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1aec03dc50 con 0x7f1aec03b140 2024-03-20T13:36:29.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41ea11a640 1 --2- 172.21.15.89:0/3112770676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc0b1940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009740 tx=0x7f41e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0696f3ad267c824 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41e9118640 1 -- 172.21.15.89:0/3112770676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41dc0aece0 con 0x7f41dc0b1340 2024-03-20T13:36:29.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41e9118640 1 -- 172.21.15.89:0/3112770676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e00a7050 con 0x7f41dc0b1340 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41e9118640 1 -- 172.21.15.89:0/3112770676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e00ab680 con 0x7f41dc0b1340 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 -- 172.21.15.89:0/3112770676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 msgr2=0x7f41dc0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 --2- 172.21.15.89:0/3112770676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc0b1940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009740 tx=0x7f41e001c370 comp rx=0 tx=0).stop 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 -- 172.21.15.89:0/3112770676 shutdown_connections 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 --2- 172.21.15.89:0/3112770676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc0b1940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 -- 172.21.15.89:0/3112770676 >> 172.21.15.89:0/3112770676 conn(0x7f41dc0227c0 msgr2=0x7f41dc022ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 -- 172.21.15.89:0/3112770676 shutdown_connections 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.822+0000 7f41eb11c640 1 -- 172.21.15.89:0/3112770676 wait complete. 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41eb11c640 1 Processor -- start 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41eb11c640 1 -- start start 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41eb11c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc01f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41eb11c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0b36e0 con 0x7f41dc0b1340 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41ea11a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc01f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41ea11a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc01f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46026/0 (socket says 172.21.15.89:46026) 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41ea11a640 1 -- 172.21.15.89:0/485019228 learned_addr learned my addr 172.21.15.89:0/485019228 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41ea11a640 1 -- 172.21.15.89:0/485019228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009420 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41ea11a640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc01f190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ae040 tx=0x7f41e0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e00b4540 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e00b46a0 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e00b4960 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41eb11c640 1 -- 172.21.15.89:0/485019228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc0ade20 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41eb11c640 1 -- 172.21.15.89:0/485019228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc0b2690 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41c0000f90 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41e00b2040 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f41c8039e20 0x7f41c803c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f41e00e1dc0 con 0x7f41dc0b1340 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f41c803f5a0 0x7f41c80419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41c80420b0 con 0x7f41c803f5a0 2024-03-20T13:36:29.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.826+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41e00e4430 con 0x7f41dc0b1340 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.830+0000 7f41ea91b640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f41c803f5a0 0x7f41c80419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.830+0000 7f41e9919640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f41c8039e20 0x7f41c803c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.830+0000 7f41ea91b640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f41c803f5a0 0x7f41c80419e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.830+0000 7f41e9919640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f41c8039e20 0x7f41c803c2e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f41d4007fd0 tx=0x7f41d4007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.830+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f41c80420b0 con 0x7f41c803f5a0 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.830+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6450002be0 con 0x7f645c03b190 2024-03-20T13:36:29.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.838+0000 7f646cff9640 1 -- 172.21.15.89:0/3814510360 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6450002be0 con 0x7f645c03b190 2024-03-20T13:36:29.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1470062860 con 0x7f145c03b190 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f645c03b190 msgr2=0x7f645c03d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f645c03b190 0x7f645c03d5d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f645c035a10 msgr2=0x7f645c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f645c035a10 0x7f645c037ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f64640af000 tx=0x7f64640a7000 comp rx=0 tx=0).stop 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 msgr2=0x7f64701c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 0x7f64701c5500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f646000c410 tx=0x7f646000c8d0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 shutdown_connections 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f645c03b190 0x7f645c03d5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f645c035a10 0x7f645c037ed0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 --2- 172.21.15.89:0/3814510360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f647012e000 0x7f64701c5500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 >> 172.21.15.89:0/3814510360 conn(0x7f647009b1d0 msgr2=0x7f6470097b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 shutdown_connections 2024-03-20T13:36:29.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f64769c4640 1 -- 172.21.15.89:0/3814510360 wait complete. 2024-03-20T13:36:29.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14577fe640 1 -- 172.21.15.89:0/3389601832 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1470062860 con 0x7f145c03b190 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7f145c03b190 msgr2=0x7f145c03d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7f145c03b190 0x7f145c03d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f145c035a10 msgr2=0x7f145c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f145c035a10 0x7f145c037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f147006c950 tx=0x7f14640a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 msgr2=0x7f147008fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 0x7f147008fd20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f146000c3a0 tx=0x7f146000c860 comp rx=0 tx=0).stop 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 shutdown_connections 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7f145c03b190 0x7f145c03d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f145c035a10 0x7f145c037ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 --2- 172.21.15.89:0/3389601832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470096410 0x7f147008fd20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 >> 172.21.15.89:0/3389601832 conn(0x7f147009c8e0 msgr2=0x7f147006d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 shutdown_connections 2024-03-20T13:36:29.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.842+0000 7f14750da640 1 -- 172.21.15.89:0/3389601832 wait complete. 2024-03-20T13:36:29.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41c0002be0 con 0x7f41c803f5a0 2024-03-20T13:36:29.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41daffd640 1 -- 172.21.15.89:0/485019228 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41c0002be0 con 0x7f41c803f5a0 2024-03-20T13:36:29.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b00071b50 con 0x7f1aec03b140 2024-03-20T13:36:29.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f41c803f5a0 msgr2=0x7f41c80419e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f41c803f5a0 0x7f41c80419e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f41c8039e20 msgr2=0x7f41c803c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f41c8039e20 0x7f41c803c2e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f41d4007fd0 tx=0x7f41d4007980 comp rx=0 tx=0).stop 2024-03-20T13:36:29.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 msgr2=0x7f41dc01f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc01f190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ae040 tx=0x7f41e0019110 comp rx=0 tx=0).stop 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1afd7fa640 1 -- 172.21.15.89:0/437533890 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b00071b50 con 0x7f1aec03b140 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 shutdown_connections 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f41c803f5a0 0x7f41c80419e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f41c8039e20 0x7f41c803c2e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 --2- 172.21.15.89:0/485019228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41dc0b1340 0x7f41dc01f190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 >> 172.21.15.89:0/485019228 conn(0x7f41dc0227c0 msgr2=0x7f41dc0aaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 shutdown_connections 2024-03-20T13:36:29.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f41d8ff9640 1 -- 172.21.15.89:0/485019228 wait complete. 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f1aec03b140 msgr2=0x7f1aec03d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f1aec03b140 0x7f1aec03d580 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1aec0359c0 msgr2=0x7f1aec037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1aec0359c0 0x7f1aec037e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009740 tx=0x7f1af00a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 msgr2=0x7f1b0012b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 0x7f1b0012b940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c480 tx=0x7f1af400c940 comp rx=0 tx=0).stop 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 shutdown_connections 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f1aec03b140 0x7f1aec03d580 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1aec0359c0 0x7f1aec037e80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 --2- 172.21.15.89:0/437533890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b000987c0 0x7f1b0012b940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 >> 172.21.15.89:0/437533890 conn(0x7f1b000a08b0 msgr2=0x7f1b00127380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 shutdown_connections 2024-03-20T13:36:29.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.846+0000 7f1b07217640 1 -- 172.21.15.89:0/437533890 wait complete. 2024-03-20T13:36:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:42949672964 2024-03-20T13:36:29.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-20T13:36:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:42949672965 2024-03-20T13:36:29.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-20T13:36:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-03-20T13:36:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:42949672966 2024-03-20T13:36:29.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-20T13:36:29.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-20T13:36:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadd6875640 1 Processor -- start 2024-03-20T13:36:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadd6875640 1 -- start start 2024-03-20T13:36:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadd6875640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fadd012dfc0 0x7fadd012e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadd6875640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd009df90 con 0x7fadd006d1e0 2024-03-20T13:36:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadd6875640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd006e2a0 con 0x7fadd012dfc0 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadcffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fadd012dfc0 0x7fadd012e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadcf7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fadd006d1e0 0x7fadd006d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51784/0 (socket says 172.21.15.89:51784) 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadcf7fe640 1 -- 172.21.15.89:0/3893077281 learned_addr learned my addr 172.21.15.89:0/3893077281 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadceffd640 1 -- 172.21.15.89:0/3893077281 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274402034 0 0) 0x7fadd009df90 con 0x7fadd006d1e0 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadceffd640 1 -- 172.21.15.89:0/3893077281 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb8003530 con 0x7fadd006d1e0 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadcffff640 1 -- 172.21.15.89:0/3893077281 >> v1:172.21.15.89:6789/0 conn(0x7fadd006d1e0 legacy=0x7fadd006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.970+0000 7fadcffff640 1 -- 172.21.15.89:0/3893077281 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00720e0 con 0x7fadd012dfc0 2024-03-20T13:36:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadcffff640 1 --2- 172.21.15.89:0/3893077281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd012dfc0 0x7fadd012e3a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009740 tx=0x7fadc001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e8ebf834191ed server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadceffd640 1 -- 172.21.15.89:0/3893077281 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc00ab530 con 0x7fadd012dfc0 2024-03-20T13:36:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadceffd640 1 -- 172.21.15.89:0/3893077281 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc00a7050 con 0x7fadd012dfc0 2024-03-20T13:36:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadceffd640 1 -- 172.21.15.89:0/3893077281 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc00ab7e0 con 0x7fadd012dfc0 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 -- 172.21.15.89:0/3893077281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd012dfc0 msgr2=0x7fadd012e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 --2- 172.21.15.89:0/3893077281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd012dfc0 0x7fadd012e3a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009740 tx=0x7fadc001c400 comp rx=0 tx=0).stop 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 -- 172.21.15.89:0/3893077281 shutdown_connections 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 --2- 172.21.15.89:0/3893077281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd012dfc0 0x7fadd012e3a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 -- 172.21.15.89:0/3893077281 >> 172.21.15.89:0/3893077281 conn(0x7fadd009c330 msgr2=0x7fadd0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 -- 172.21.15.89:0/3893077281 shutdown_connections 2024-03-20T13:36:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 -- 172.21.15.89:0/3893077281 wait complete. 2024-03-20T13:36:29.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 Processor -- start 2024-03-20T13:36:29.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.974+0000 7fadd6875640 1 -- start start 2024-03-20T13:36:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadd6875640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 0x7fadd01329e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadd6875640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0131be0 con 0x7fadd006d1e0 2024-03-20T13:36:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 0x7fadd01329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 0x7fadd01329e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46038/0 (socket says 172.21.15.89:46038) 2024-03-20T13:36:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcffff640 1 -- 172.21.15.89:0/4237743182 learned_addr learned my addr 172.21.15.89:0/4237743182 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcffff640 1 -- 172.21.15.89:0/4237743182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0009420 con 0x7fadd006d1e0 2024-03-20T13:36:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcffff640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 0x7fadd01329e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fadc001a030 tx=0x7fadc001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc00abe10 con 0x7fadd006d1e0 2024-03-20T13:36:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc00b7450 con 0x7fadd006d1e0 2024-03-20T13:36:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd0071380 con 0x7fadd006d1e0 2024-03-20T13:36:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc00b76f0 con 0x7fadd006d1e0 2024-03-20T13:36:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0131470 con 0x7fadd006d1e0 2024-03-20T13:36:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd0062860 con 0x7fadd006d1e0 2024-03-20T13:36:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fadc00b7850 con 0x7fadd006d1e0 2024-03-20T13:36:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadccff9640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fadbc035a10 0x7fadbc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fadc00e2750 con 0x7fadd006d1e0 2024-03-20T13:36:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcf7fe640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fadbc035a10 0x7fadbc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.978+0000 7fadcf7fe640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fadbc035a10 0x7fadbc037ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc4007fd0 tx=0x7fadc4007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:29.986+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fadc00c76c0 con 0x7fadd006d1e0 2024-03-20T13:36:30.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5bb177d640 1 Processor -- start 2024-03-20T13:36:30.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5bb177d640 1 -- start start 2024-03-20T13:36:30.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5bb177d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bac122bb0 0x7f5bac130f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5bb177d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac096240 con 0x7f5bac1220c0 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5bb177d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac122f90 con 0x7f5bac122bb0 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5baa7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bac122bb0 0x7f5bac130f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5baaffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5bac1220c0 0x7f5bac1224a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51786/0 (socket says 172.21.15.89:51786) 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5baaffd640 1 -- 172.21.15.89:0/1463952003 learned_addr learned my addr 172.21.15.89:0/1463952003 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5baa7fc640 1 -- 172.21.15.89:0/1463952003 >> v1:172.21.15.89:6789/0 conn(0x7f5bac1220c0 legacy=0x7f5bac1224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5ba9ffb640 1 -- 172.21.15.89:0/1463952003 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176768951 0 0) 0x7f5bac096240 con 0x7f5bac1220c0 2024-03-20T13:36:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7f5baa7fc640 1 -- 172.21.15.89:0/1463952003 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac09a4d0 con 0x7f5bac122bb0 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.018+0000 7ff098a4f640 1 Processor -- start 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 -- start start 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff094130fc0 0x7ff0941333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff094098d10 con 0x7ff09412a9f0 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff094099310 con 0x7ff094130fc0 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff091d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff094130fc0 0x7ff0941333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff091d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff094130fc0 0x7ff0941333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46058/0 (socket says 172.21.15.89:46058) 2024-03-20T13:36:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff091d9b640 1 -- 172.21.15.89:0/4133995391 learned_addr learned my addr 172.21.15.89:0/4133995391 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff091d9b640 1 -- 172.21.15.89:0/4133995391 >> v1:172.21.15.89:6789/0 conn(0x7ff09412a9f0 legacy=0x7ff09412add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff091d9b640 1 -- 172.21.15.89:0/4133995391 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09409a3b0 con 0x7ff094130fc0 2024-03-20T13:36:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5baa7fc640 1 --2- 172.21.15.89:0/1463952003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac122bb0 0x7f5bac130f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009740 tx=0x7f5ba001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666a2e06704052ad server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5ba9ffb640 1 -- 172.21.15.89:0/1463952003 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ba00ab530 con 0x7f5bac122bb0 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5ba9ffb640 1 -- 172.21.15.89:0/1463952003 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba00a7050 con 0x7f5bac122bb0 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5ba9ffb640 1 -- 172.21.15.89:0/1463952003 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ba00ab7e0 con 0x7f5bac122bb0 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 -- 172.21.15.89:0/1463952003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac122bb0 msgr2=0x7f5bac130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 --2- 172.21.15.89:0/1463952003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac122bb0 0x7f5bac130f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009740 tx=0x7f5ba001c370 comp rx=0 tx=0).stop 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff091d9b640 1 --2- 172.21.15.89:0/4133995391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff094130fc0 0x7ff0941333b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097f0 tx=0x7ff08801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7a449e2c770b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 -- 172.21.15.89:0/1463952003 shutdown_connections 2024-03-20T13:36:30.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 --2- 172.21.15.89:0/1463952003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac122bb0 0x7f5bac130f00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 -- 172.21.15.89:0/1463952003 >> 172.21.15.89:0/1463952003 conn(0x7f5bac09d600 msgr2=0x7f5bac099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff09159a640 1 -- 172.21.15.89:0/4133995391 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0880ab530 con 0x7ff094130fc0 2024-03-20T13:36:30.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff09159a640 1 -- 172.21.15.89:0/4133995391 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880a7050 con 0x7ff094130fc0 2024-03-20T13:36:30.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff09159a640 1 -- 172.21.15.89:0/4133995391 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0880ab7e0 con 0x7ff094130fc0 2024-03-20T13:36:30.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd73d322640 1 Processor -- start 2024-03-20T13:36:30.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 -- 172.21.15.89:0/1463952003 shutdown_connections 2024-03-20T13:36:30.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd73d322640 1 -- start start 2024-03-20T13:36:30.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7f5bb177d640 1 -- 172.21.15.89:0/1463952003 wait complete. 2024-03-20T13:36:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd73d322640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd73806cbb0 0x7fd73806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd73d322640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73809d7d0 con 0x7fd73806d4d0 2024-03-20T13:36:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd73d322640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd738070da0 con 0x7fd73806cbb0 2024-03-20T13:36:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 -- 172.21.15.89:0/4133995391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff094130fc0 msgr2=0x7ff0941333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 --2- 172.21.15.89:0/4133995391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff094130fc0 0x7ff0941333b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097f0 tx=0x7ff08801c430 comp rx=0 tx=0).stop 2024-03-20T13:36:30.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd7367fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd73806d4d0 0x7fd7380960c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51806/0 (socket says 172.21.15.89:51806) 2024-03-20T13:36:30.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd7367fc640 1 -- 172.21.15.89:0/1994718442 learned_addr learned my addr 172.21.15.89:0/1994718442 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:30.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7fd736ffd640 1 --2- 172.21.15.89:0/1994718442 >> v2:172.21.15.89:3300/0 conn(0x7fd73806cbb0 0x7fd73806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 -- 172.21.15.89:0/4133995391 shutdown_connections 2024-03-20T13:36:30.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 --2- 172.21.15.89:0/4133995391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff094130fc0 0x7ff0941333b0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097f0 tx=0x7ff08801c430 comp rx=0 tx=0).stop 2024-03-20T13:36:30.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.022+0000 7ff098a4f640 1 -- 172.21.15.89:0/4133995391 >> 172.21.15.89:0/4133995391 conn(0x7ff0940a04f0 msgr2=0x7ff0940a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd735ffb640 1 -- 172.21.15.89:0/1994718442 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760827061 0 0) 0x7fd73809d7d0 con 0x7fd73806d4d0 2024-03-20T13:36:30.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 -- 172.21.15.89:0/4133995391 shutdown_connections 2024-03-20T13:36:30.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd735ffb640 1 -- 172.21.15.89:0/1994718442 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd720003530 con 0x7fd73806d4d0 2024-03-20T13:36:30.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 -- 172.21.15.89:0/4133995391 wait complete. 2024-03-20T13:36:30.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 Processor -- start 2024-03-20T13:36:30.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd736ffd640 1 -- 172.21.15.89:0/1994718442 >> v1:172.21.15.89:6789/0 conn(0x7fd73806d4d0 legacy=0x7fd7380960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd736ffd640 1 -- 172.21.15.89:0/1994718442 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738072990 con 0x7fd73806cbb0 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 -- start start 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 0x7f5bac092a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac06eeb0 con 0x7f5bac1220c0 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5baaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 0x7f5bac092a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5baaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 0x7f5bac092a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46072/0 (socket says 172.21.15.89:46072) 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5baaffd640 1 -- 172.21.15.89:0/1322081128 learned_addr learned my addr 172.21.15.89:0/1322081128 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:30.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5baaffd640 1 -- 172.21.15.89:0/1322081128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009420 con 0x7f5bac1220c0 2024-03-20T13:36:30.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 Processor -- start 2024-03-20T13:36:30.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 -- start start 2024-03-20T13:36:30.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5baaffd640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 0x7f5bac092a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00c420 tx=0x7f5b9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c0074d0 con 0x7f5bac1220c0 2024-03-20T13:36:30.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c007630 con 0x7f5bac1220c0 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac095f30 con 0x7f5bac1220c0 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac06f130 con 0x7f5bac1220c0 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 0x7ff09412ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09412e410 con 0x7ff09412a9f0 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff09259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 0x7ff09412ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff09259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 0x7ff09412ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46074/0 (socket says 172.21.15.89:46074) 2024-03-20T13:36:30.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff09259c640 1 -- 172.21.15.89:0/2271347985 learned_addr learned my addr 172.21.15.89:0/2271347985 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:30.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c004920 con 0x7f5bac1220c0 2024-03-20T13:36:30.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff09259c640 1 -- 172.21.15.89:0/2271347985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880094d0 con 0x7ff09412a9f0 2024-03-20T13:36:30.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd736ffd640 1 --2- 172.21.15.89:0/1994718442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73806cf90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd728009740 tx=0x7fd72801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88a9d8fc6b60cb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5b9c004b00 con 0x7f5bac1220c0 2024-03-20T13:36:30.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5b937fe640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5b980359c0 0x7f5b98037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f5b9c0472a0 con 0x7f5bac1220c0 2024-03-20T13:36:30.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd735ffb640 1 -- 172.21.15.89:0/1994718442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7280ab530 con 0x7fd73806cbb0 2024-03-20T13:36:30.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff09259c640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 0x7ff09412ca60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c480 tx=0x7ff08400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff084005150 con 0x7ff09412a9f0 2024-03-20T13:36:30.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09406d460 con 0x7ff09412a9f0 2024-03-20T13:36:30.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0840052b0 con 0x7ff09412a9f0 2024-03-20T13:36:30.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09406c6b0 con 0x7ff09412a9f0 2024-03-20T13:36:30.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff084007030 con 0x7ff09412a9f0 2024-03-20T13:36:30.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5baa7fc640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5b980359c0 0x7f5b98037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac06be80 con 0x7f5bac1220c0 2024-03-20T13:36:30.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff078005090 con 0x7ff09412a9f0 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd735ffb640 1 -- 172.21.15.89:0/1994718442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7280a7050 con 0x7fd73806cbb0 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.026+0000 7fd735ffb640 1 -- 172.21.15.89:0/1994718442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7280ab7c0 con 0x7fd73806cbb0 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- 172.21.15.89:0/1994718442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 msgr2=0x7fd73806cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 --2- 172.21.15.89:0/1994718442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73806cf90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd728009740 tx=0x7fd72801c370 comp rx=0 tx=0).stop 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- 172.21.15.89:0/1994718442 shutdown_connections 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 --2- 172.21.15.89:0/1994718442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73806cf90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- 172.21.15.89:0/1994718442 >> 172.21.15.89:0/1994718442 conn(0x7fd73809c8e0 msgr2=0x7fd73809ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- 172.21.15.89:0/1994718442 shutdown_connections 2024-03-20T13:36:30.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7f5baa7fc640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5b980359c0 0x7f5b98037e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00ad000 tx=0x7f5ba0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- 172.21.15.89:0/1994718442 wait complete. 2024-03-20T13:36:30.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff084007190 con 0x7ff09412a9f0 2024-03-20T13:36:30.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7ff082ffd640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff074035a10 0x7ff074037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 Processor -- start 2024-03-20T13:36:30.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7ff091d9b640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff074035a10 0x7ff074037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- start start 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73812ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd73d322640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738131c20 con 0x7fd73806cbb0 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd736ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73812ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd736ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73812ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46078/0 (socket says 172.21.15.89:46078) 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd736ffd640 1 -- 172.21.15.89:0/1073165190 learned_addr learned my addr 172.21.15.89:0/1073165190 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:30.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7ff091d9b640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff074035a10 0x7ff074037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff094067520 tx=0x7ff0880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd736ffd640 1 -- 172.21.15.89:0/1073165190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728009420 con 0x7fd73806cbb0 2024-03-20T13:36:30.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.030+0000 7fd736ffd640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73812ec50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd728018f80 tx=0x7fd728019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.034+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd728003960 con 0x7fd73806cbb0 2024-03-20T13:36:30.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.034+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd738121c80 con 0x7fd73806cbb0 2024-03-20T13:36:30.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.034+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7381220c0 con 0x7fd73806cbb0 2024-03-20T13:36:30.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.034+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5bac06be80 con 0x7f5bac1220c0 2024-03-20T13:36:30.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.034+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd738062860 con 0x7fd73806cbb0 2024-03-20T13:36:30.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.034+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff084007670 con 0x7ff09412a9f0 2024-03-20T13:36:30.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd728003ac0 con 0x7fd73806cbb0 2024-03-20T13:36:30.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd728003d60 con 0x7fd73806cbb0 2024-03-20T13:36:30.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff084011590 con 0x7ff09412a9f0 2024-03-20T13:36:30.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd7280b2040 con 0x7fd73806cbb0 2024-03-20T13:36:30.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7fd71f7fe640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd724035a10 0x7fd724037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:30.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fd7280e2140 con 0x7fd73806cbb0 2024-03-20T13:36:30.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.038+0000 7fd7367fc640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd724035a10 0x7fd724037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:30.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.042+0000 7fd7367fc640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd724035a10 0x7fd724037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd72c007fd0 tx=0x7fd72c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:30.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.042+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7280b3360 con 0x7fd73806cbb0 2024-03-20T13:36:30.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.146+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fadd0130f60 con 0x7fadd006d1e0 2024-03-20T13:36:30.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.146+0000 7fadccff9640 1 -- 172.21.15.89:0/4237743182 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadc00b0070 con 0x7fadd006d1e0 2024-03-20T13:36:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:42949672963 2024-03-20T13:36:30.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fadbc035a10 msgr2=0x7fadbc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fadbc035a10 0x7fadbc037ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc4007fd0 tx=0x7fadc4007980 comp rx=0 tx=0).stop 2024-03-20T13:36:30.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 msgr2=0x7fadd01329e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 0x7fadd01329e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fadc001a030 tx=0x7fadc001ac40 comp rx=0 tx=0).stop 2024-03-20T13:36:30.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 shutdown_connections 2024-03-20T13:36:30.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fadbc035a10 0x7fadbc037ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 --2- 172.21.15.89:0/4237743182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd006d1e0 0x7fadd01329e0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fadc001a030 tx=0x7fadc001ac40 comp rx=0 tx=0).stop 2024-03-20T13:36:30.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 >> 172.21.15.89:0/4237743182 conn(0x7fadd009c330 msgr2=0x7fadd0127100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 shutdown_connections 2024-03-20T13:36:30.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.150+0000 7fadd6875640 1 -- 172.21.15.89:0/4237743182 wait complete. 2024-03-20T13:36:30.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.1 2024-03-20T13:36:30.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff078005340 con 0x7ff09412a9f0 2024-03-20T13:36:30.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff082ffd640 1 -- 172.21.15.89:0/2271347985 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff08401a3a0 con 0x7ff09412a9f0 2024-03-20T13:36:30.194 INFO:teuthology.orchestra.run.smithi089.stdout:42949672965 2024-03-20T13:36:30.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff074035a10 msgr2=0x7ff074037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff074035a10 0x7ff074037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff094067520 tx=0x7ff0880a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:30.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 msgr2=0x7ff09412ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 0x7ff09412ca60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c480 tx=0x7ff08400c940 comp rx=0 tx=0).stop 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 shutdown_connections 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff074035a10 0x7ff074037ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 --2- 172.21.15.89:0/2271347985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09412a9f0 0x7ff09412ca60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 >> 172.21.15.89:0/2271347985 conn(0x7ff0940a04f0 msgr2=0x7ff094129260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 shutdown_connections 2024-03-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.194+0000 7ff098a4f640 1 -- 172.21.15.89:0/2271347985 wait complete. 2024-03-20T13:36:30.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2024-03-20T13:36:30.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.238+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bac06be80 con 0x7f5bac1220c0 2024-03-20T13:36:30.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.238+0000 7f5b937fe640 1 -- 172.21.15.89:0/1322081128 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bac06be80 con 0x7f5bac1220c0 2024-03-20T13:36:30.238 INFO:teuthology.orchestra.run.smithi089.stdout:42949672964 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.238+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5b980359c0 msgr2=0x7f5b98037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.238+0000 7f5bb177d640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5b980359c0 0x7f5b98037e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00ad000 tx=0x7f5ba0008040 comp rx=0 tx=0).stop 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.238+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 msgr2=0x7f5bac092a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 0x7f5bac092a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00c420 tx=0x7f5b9c00c8e0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 shutdown_connections 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5b980359c0 0x7f5b98037e80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 --2- 172.21.15.89:0/1322081128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bac1220c0 0x7f5bac092a70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 >> 172.21.15.89:0/1322081128 conn(0x7f5bac09d600 msgr2=0x7f5bac071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 shutdown_connections 2024-03-20T13:36:30.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.242+0000 7f5bb177d640 1 -- 172.21.15.89:0/1322081128 wait complete. 2024-03-20T13:36:30.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd738066c20 con 0x7fd73806cbb0 2024-03-20T13:36:30.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd71f7fe640 1 -- 172.21.15.89:0/1073165190 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7280b0070 con 0x7fd73806cbb0 2024-03-20T13:36:30.245 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd724035a10 msgr2=0x7fd724037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd724035a10 0x7fd724037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd72c007fd0 tx=0x7fd72c007980 comp rx=0 tx=0).stop 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 msgr2=0x7fd73812ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73812ec50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd728018f80 tx=0x7fd728019110 comp rx=0 tx=0).stop 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 shutdown_connections 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fd724035a10 0x7fd724037ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 --2- 172.21.15.89:0/1073165190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd73806cbb0 0x7fd73812ec50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 >> 172.21.15.89:0/1073165190 conn(0x7fd73809c8e0 msgr2=0x7fd738094820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 shutdown_connections 2024-03-20T13:36:30.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:30.246+0000 7fd73d322640 1 -- 172.21.15.89:0/1073165190 wait complete. 2024-03-20T13:36:30.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-03-20T13:36:30.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-03-20T13:36:31.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-20T13:36:31.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-20T13:36:31.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-20T13:36:31.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-20T13:36:31.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b7a61640 1 Processor -- start 2024-03-20T13:36:31.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b7a61640 1 -- start start 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b7a61640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3b01310b0 0x7ff3b01334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b7a61640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00951f0 con 0x7ff3b012aba0 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b7a61640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b012a980 con 0x7ff3b01310b0 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b4ffc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3b01310b0 0x7ff3b01334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b57fd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff3b012aba0 0x7ff3b012af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40958/0 (socket says 172.21.15.89:40958) 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b57fd640 1 -- 172.21.15.89:0/1636173887 learned_addr learned my addr 172.21.15.89:0/1636173887 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b4ffc640 1 -- 172.21.15.89:0/1636173887 >> v1:172.21.15.89:6789/0 conn(0x7ff3b012aba0 legacy=0x7ff3b012af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.294+0000 7ff3b4ffc640 1 -- 172.21.15.89:0/1636173887 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b012b690 con 0x7ff3b01310b0 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.298+0000 7ff3b4ffc640 1 --2- 172.21.15.89:0/1636173887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b01310b0 0x7ff3b01334a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009740 tx=0x7ff3a001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa32b560a57b8b2a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.298+0000 7ff3a7fff640 1 -- 172.21.15.89:0/1636173887 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3a00ab530 con 0x7ff3b01310b0 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.298+0000 7ff3a7fff640 1 -- 172.21.15.89:0/1636173887 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a00a7050 con 0x7ff3b01310b0 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.298+0000 7ff3a7fff640 1 -- 172.21.15.89:0/1636173887 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3a00ab7e0 con 0x7ff3b01310b0 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1636173887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b01310b0 msgr2=0x7ff3b01334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 --2- 172.21.15.89:0/1636173887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b01310b0 0x7ff3b01334a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009740 tx=0x7ff3a001c310 comp rx=0 tx=0).stop 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1636173887 shutdown_connections 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 --2- 172.21.15.89:0/1636173887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b01310b0 0x7ff3b01334a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1636173887 >> 172.21.15.89:0/1636173887 conn(0x7ff3b009d400 msgr2=0x7ff3b009d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1636173887 shutdown_connections 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1636173887 wait complete. 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 Processor -- start 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- start start 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 0x7ff3b01c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01336d0 con 0x7ff3b012aba0 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b57fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 0x7ff3b01c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b57fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 0x7ff3b01c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47128/0 (socket says 172.21.15.89:47128) 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b57fd640 1 -- 172.21.15.89:0/1545447476 learned_addr learned my addr 172.21.15.89:0/1545447476 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b57fd640 1 -- 172.21.15.89:0/1545447476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0009420 con 0x7ff3b012aba0 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b57fd640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 0x7ff3b01c5600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c480 tx=0x7ff3ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac005c20 con 0x7ff3b012aba0 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac005d80 con 0x7ff3b012aba0 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.302+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b009a1c0 con 0x7ff3b012aba0 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac0071a0 con 0x7ff3b012aba0 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b012c5e0 con 0x7ff3b012aba0 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3ac0073c0 con 0x7ff3b012aba0 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3a5ffb640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3940359f0 0x7ff394037eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff3ac04a4b0 con 0x7ff3b012aba0 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3b4ffc640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3940359f0 0x7ff394037eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b012c390 con 0x7ff3b012aba0 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.306+0000 7ff3b4ffc640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3940359f0 0x7ff394037eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00ad000 tx=0x7ff3a00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.314+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff3ac017030 con 0x7ff3b012aba0 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa318411640 1 Processor -- start 2024-03-20T13:36:31.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa318411640 1 -- start start 2024-03-20T13:36:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa318411640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa31012be00 0x7fa31012c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa318411640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa310094fb0 con 0x7fa31012c720 2024-03-20T13:36:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa318411640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa310094670 con 0x7fa31012be00 2024-03-20T13:36:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3161ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa31012be00 0x7fa31012c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3161ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa31012be00 0x7fa31012c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47132/0 (socket says 172.21.15.89:47132) 2024-03-20T13:36:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3159ac640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa31012c720 0x7fa3101221c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40970/0 (socket says 172.21.15.89:40970) 2024-03-20T13:36:31.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3161ad640 1 -- 172.21.15.89:0/357315212 learned_addr learned my addr 172.21.15.89:0/357315212 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:31.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3161ad640 1 -- 172.21.15.89:0/357315212 >> v1:172.21.15.89:6789/0 conn(0x7fa31012c720 legacy=0x7fa3101221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3161ad640 1 -- 172.21.15.89:0/357315212 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31009ced0 con 0x7fa31012be00 2024-03-20T13:36:31.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3151ab640 1 -- 172.21.15.89:0/357315212 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273038786 0 0) 0x7fa310094fb0 con 0x7fa31012c720 2024-03-20T13:36:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3161ad640 1 --2- 172.21.15.89:0/357315212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa31012c1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0097f0 tx=0x7fa30c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7683223ddc6f61bb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.342+0000 7fa3151ab640 1 -- 172.21.15.89:0/357315212 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0ab530 con 0x7fa31012be00 2024-03-20T13:36:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3151ab640 1 -- 172.21.15.89:0/357315212 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0a7050 con 0x7fa31012be00 2024-03-20T13:36:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3151ab640 1 -- 172.21.15.89:0/357315212 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0ab7e0 con 0x7fa31012be00 2024-03-20T13:36:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- 172.21.15.89:0/357315212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 msgr2=0x7fa31012c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 --2- 172.21.15.89:0/357315212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa31012c1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0097f0 tx=0x7fa30c01c430 comp rx=0 tx=0).stop 2024-03-20T13:36:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- 172.21.15.89:0/357315212 shutdown_connections 2024-03-20T13:36:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 --2- 172.21.15.89:0/357315212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa31012c1e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- 172.21.15.89:0/357315212 >> 172.21.15.89:0/357315212 conn(0x7fa31009b1d0 msgr2=0x7fa31009b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- 172.21.15.89:0/357315212 shutdown_connections 2024-03-20T13:36:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- 172.21.15.89:0/357315212 wait complete. 2024-03-20T13:36:31.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 Processor -- start 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- start start 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa310090060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa318411640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101318f0 con 0x7fa31012be00 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3161ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa310090060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3161ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa310090060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47144/0 (socket says 172.21.15.89:47144) 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3161ad640 1 -- 172.21.15.89:0/399389337 learned_addr learned my addr 172.21.15.89:0/399389337 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3161ad640 1 -- 172.21.15.89:0/399389337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0094d0 con 0x7fa31012be00 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.346+0000 7fa3161ad640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa310090060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01a060 tx=0x7fa30c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0b4570 con 0x7fa31012be00 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0b46d0 con 0x7fa31012be00 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0b4990 con 0x7fa31012be00 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa318411640 1 -- 172.21.15.89:0/399389337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa310096b60 con 0x7fa31012be00 2024-03-20T13:36:31.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa318411640 1 -- 172.21.15.89:0/399389337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31012f060 con 0x7fa31012be00 2024-03-20T13:36:31.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa30c0b2070 con 0x7fa31012be00 2024-03-20T13:36:31.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa306ffd640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa2f4035a10 0x7fa2f4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa30c0e20d0 con 0x7fa31012be00 2024-03-20T13:36:31.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec005090 con 0x7fa31012be00 2024-03-20T13:36:31.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa3159ac640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa2f4035a10 0x7fa2f4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.350+0000 7fa3159ac640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa2f4035a10 0x7fa2f4037ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa300007fd0 tx=0x7fa300007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.354+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa30c0b0020 con 0x7fa31012be00 2024-03-20T13:36:31.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7faece9f9640 1 Processor -- start 2024-03-20T13:36:31.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7faece9f9640 1 -- start start 2024-03-20T13:36:31.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7f6babfa2640 1 Processor -- start 2024-03-20T13:36:31.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7f6babfa2640 1 -- start start 2024-03-20T13:36:31.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7faece9f9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faec8098b30 0x7faec81336f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7faece9f9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec809a6d0 con 0x7faec8098040 2024-03-20T13:36:31.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.374+0000 7faece9f9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec809a3c0 con 0x7faec8098b30 2024-03-20T13:36:31.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec7fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7faec8098040 0x7faec8098420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40978/0 (socket says 172.21.15.89:40978) 2024-03-20T13:36:31.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec7fff640 1 -- 172.21.15.89:0/1621092269 learned_addr learned my addr 172.21.15.89:0/1621092269 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:31.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6babfa2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ba412e0e0 0x7f6ba412e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6babfa2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba4094be0 con 0x7f6ba406c0d0 2024-03-20T13:36:31.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec77fe640 1 --2- 172.21.15.89:0/1621092269 >> v2:172.21.15.89:3300/0 conn(0x7faec8098b30 0x7faec81336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6babfa2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba4094850 con 0x7f6ba412e0e0 2024-03-20T13:36:31.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba953d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6ba406c0d0 0x7f6ba406c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40992/0 (socket says 172.21.15.89:40992) 2024-03-20T13:36:31.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba953d640 1 -- 172.21.15.89:0/2276999146 learned_addr learned my addr 172.21.15.89:0/2276999146 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:31.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba9d3e640 1 --2- 172.21.15.89:0/2276999146 >> v2:172.21.15.89:3300/0 conn(0x7f6ba412e0e0 0x7f6ba412e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec77fe640 1 -- 172.21.15.89:0/1621092269 >> v1:172.21.15.89:6789/0 conn(0x7faec8098040 legacy=0x7faec8098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec77fe640 1 -- 172.21.15.89:0/1621092269 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8099810 con 0x7faec8098b30 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310576179 0 0) 0x7f6ba4094be0 con 0x7f6ba406c0d0 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b90003530 con 0x7f6ba406c0d0 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494085924 0 0) 0x7f6b90003530 con 0x7f6ba406c0d0 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 >> v2:172.21.15.89:3300/0 conn(0x7f6ba412e0e0 msgr2=0x7f6ba412e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 --2- 172.21.15.89:0/2276999146 >> v2:172.21.15.89:3300/0 conn(0x7f6ba412e0e0 0x7f6ba412e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba412dc20 con 0x7f6ba406c0d0 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 867087403 0 0) 0x7f6b940015b0 con 0x7f6ba406c0d0 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba9d3e640 1 --2- 172.21.15.89:0/2276999146 >> v2:172.21.15.89:3300/0 conn(0x7f6ba412e0e0 0x7f6ba412e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 >> v1:172.21.15.89:6789/0 conn(0x7f6ba406c0d0 legacy=0x7f6ba406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 --2- 172.21.15.89:0/2276999146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b900039d0 0x7f6b90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4094850 con 0x7f6b900039d0 2024-03-20T13:36:31.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba9d3e640 1 --2- 172.21.15.89:0/2276999146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b900039d0 0x7f6b90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec77fe640 1 --2- 172.21.15.89:0/1621092269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098b30 0x7faec81336f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faebc009740 tx=0x7faebc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f243e19ac42ba1e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec6ffd640 1 -- 172.21.15.89:0/1621092269 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc0ab530 con 0x7faec8098b30 2024-03-20T13:36:31.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec6ffd640 1 -- 172.21.15.89:0/1621092269 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc0a7050 con 0x7faec8098b30 2024-03-20T13:36:31.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7f6ba9d3e640 1 -- 172.21.15.89:0/2276999146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90003530 con 0x7f6b900039d0 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faec6ffd640 1 -- 172.21.15.89:0/1621092269 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc0ab7e0 con 0x7faec8098b30 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 -- 172.21.15.89:0/1621092269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098b30 msgr2=0x7faec81336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 --2- 172.21.15.89:0/1621092269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098b30 0x7faec81336f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faebc009740 tx=0x7faebc01c370 comp rx=0 tx=0).stop 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 -- 172.21.15.89:0/1621092269 shutdown_connections 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 --2- 172.21.15.89:0/1621092269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098b30 0x7faec81336f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 -- 172.21.15.89:0/1621092269 >> 172.21.15.89:0/1621092269 conn(0x7faec809e870 msgr2=0x7faec809ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 -- 172.21.15.89:0/1621092269 shutdown_connections 2024-03-20T13:36:31.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.378+0000 7faece9f9640 1 -- 172.21.15.89:0/1621092269 wait complete. 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 Processor -- start 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 -- start start 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 0x7faec8091160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8125750 con 0x7faec8098040 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 0x7faec8091160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 0x7faec8091160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47192/0 (socket says 172.21.15.89:47192) 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec7fff640 1 -- 172.21.15.89:0/2010871961 learned_addr learned my addr 172.21.15.89:0/2010871961 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec7fff640 1 -- 172.21.15.89:0/2010871961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc009420 con 0x7faec8098040 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec7fff640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 0x7faec8091160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c2f0 tx=0x7faeb800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faeb8005c20 con 0x7faec8098040 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb8005d80 con 0x7faec8098040 2024-03-20T13:36:31.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8092ee0 con 0x7faec8098040 2024-03-20T13:36:31.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6ba9d3e640 1 --2- 172.21.15.89:0/2276999146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b900039d0 0x7f6b90003dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009c30 tx=0x7f6ba001cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9501c758fe575c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faeb8007200 con 0x7faec8098040 2024-03-20T13:36:31.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec8092a40 con 0x7faec8098040 2024-03-20T13:36:31.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00a5b80 con 0x7f6b900039d0 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba00a5ce0 con 0x7f6b900039d0 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6ba8d3c640 1 -- 172.21.15.89:0/2276999146 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00a5b80 con 0x7f6b900039d0 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faeb8007420 con 0x7faec8098040 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec4ff9640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7faeb40359a0 0x7faeb4037e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7faeb804b420 con 0x7faec8098040 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec8062860 con 0x7faec8098040 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 -- 172.21.15.89:0/2276999146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b900039d0 msgr2=0x7f6b90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2276999146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b900039d0 0x7f6b90003dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009c30 tx=0x7f6ba001cd30 comp rx=0 tx=0).stop 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 -- 172.21.15.89:0/2276999146 shutdown_connections 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2276999146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b900039d0 0x7f6b90003dd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2276999146 >> v2:172.21.15.89:3300/0 conn(0x7f6ba412e0e0 0x7f6ba412e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 -- 172.21.15.89:0/2276999146 >> 172.21.15.89:0/2276999146 conn(0x7f6ba409d1d0 msgr2=0x7f6ba409d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7faec77fe640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7faeb40359a0 0x7faeb4037e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 -- 172.21.15.89:0/2276999146 shutdown_connections 2024-03-20T13:36:31.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.382+0000 7f6babfa2640 1 -- 172.21.15.89:0/2276999146 wait complete. 2024-03-20T13:36:31.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7faec77fe640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7faeb40359a0 0x7faeb4037e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faebc0ad000 tx=0x7faebc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6babfa2640 1 Processor -- start 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6babfa2640 1 -- start start 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6babfa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 0x7f6ba408a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6babfa2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40969b0 con 0x7f6ba406c0d0 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6ba9d3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 0x7f6ba408a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6ba9d3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 0x7f6ba408a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47206/0 (socket says 172.21.15.89:47206) 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6ba9d3e640 1 -- 172.21.15.89:0/2184131898 learned_addr learned my addr 172.21.15.89:0/2184131898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6ba9d3e640 1 -- 172.21.15.89:0/2184131898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009420 con 0x7f6ba406c0d0 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.386+0000 7f6ba9d3e640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 0x7f6ba408a000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ba001a960 tx=0x7f6ba0019ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0004020 con 0x7f6ba406c0d0 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0004180 con 0x7f6ba406c0d0 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba412eb80 con 0x7f6ba406c0d0 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0004420 con 0x7f6ba406c0d0 2024-03-20T13:36:31.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faeb8017030 con 0x7faec8098040 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba408bd00 con 0x7f6ba406c0d0 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6ba00b4070 con 0x7f6ba406c0d0 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4124ee0 con 0x7f6ba406c0d0 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6b9a7fc640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6b88035a10 0x7f6b88037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6ba00e2590 con 0x7f6ba406c0d0 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6ba953d640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6b88035a10 0x7f6b88037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.390+0000 7f6ba953d640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6b88035a10 0x7f6b88037ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b94001e70 tx=0x7f6b94001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.398+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ba00c03e0 con 0x7f6ba406c0d0 2024-03-20T13:36:31.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3b0062860 con 0x7ff3b012aba0 2024-03-20T13:36:31.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3a5ffb640 1 -- 172.21.15.89:0/1545447476 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3ac017020 con 0x7ff3b012aba0 2024-03-20T13:36:31.475 INFO:teuthology.orchestra.run.smithi089.stdout:42949672964 2024-03-20T13:36:31.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3940359f0 msgr2=0x7ff394037eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3940359f0 0x7ff394037eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00ad000 tx=0x7ff3a00a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 msgr2=0x7ff3b01c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 0x7ff3b01c5600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c480 tx=0x7ff3ac00c940 comp rx=0 tx=0).stop 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 shutdown_connections 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3940359f0 0x7ff394037eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 --2- 172.21.15.89:0/1545447476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3b012aba0 0x7ff3b01c5600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 >> 172.21.15.89:0/1545447476 conn(0x7ff3b009d400 msgr2=0x7ff3b00954f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 shutdown_connections 2024-03-20T13:36:31.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.474+0000 7ff3b7a61640 1 -- 172.21.15.89:0/1545447476 wait complete. 2024-03-20T13:36:31.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.1 2024-03-20T13:36:31.492 DEBUG:teuthology.parallel:result is None 2024-03-20T13:36:31.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faec8093d80 con 0x7faec8098040 2024-03-20T13:36:31.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faec4ff9640 1 -- 172.21.15.89:0/2010871961 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faeb8017020 con 0x7faec8098040 2024-03-20T13:36:31.550 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7faeb40359a0 msgr2=0x7faeb4037e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7faeb40359a0 0x7faeb4037e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faebc0ad000 tx=0x7faebc0a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 msgr2=0x7faec8091160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 0x7faec8091160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c2f0 tx=0x7faeb800c7b0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 shutdown_connections 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7faeb40359a0 0x7faeb4037e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 --2- 172.21.15.89:0/2010871961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec8098040 0x7faec8091160 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 >> 172.21.15.89:0/2010871961 conn(0x7faec809e870 msgr2=0x7faec809af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 shutdown_connections 2024-03-20T13:36:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.550+0000 7faece9f9640 1 -- 172.21.15.89:0/2010871961 wait complete. 2024-03-20T13:36:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2ec005340 con 0x7fa31012be00 2024-03-20T13:36:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa306ffd640 1 -- 172.21.15.89:0/399389337 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa30c0b8070 con 0x7fa31012be00 2024-03-20T13:36:31.558 INFO:teuthology.orchestra.run.smithi089.stdout:42949672966 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa2f4035a10 msgr2=0x7fa2f4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa2f4035a10 0x7fa2f4037ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa300007fd0 tx=0x7fa300007920 comp rx=0 tx=0).stop 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 msgr2=0x7fa310090060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa310090060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01a060 tx=0x7fa30c0191d0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 shutdown_connections 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa2f4035a10 0x7fa2f4037ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 --2- 172.21.15.89:0/399389337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa31012be00 0x7fa310090060 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 >> 172.21.15.89:0/399389337 conn(0x7fa31009b1d0 msgr2=0x7fa310095930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 shutdown_connections 2024-03-20T13:36:31.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.558+0000 7fa304ff9640 1 -- 172.21.15.89:0/399389337 wait complete. 2024-03-20T13:36:31.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-03-20T13:36:31.568 DEBUG:teuthology.parallel:result is None 2024-03-20T13:36:31.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-03-20T13:36:31.576 DEBUG:teuthology.parallel:result is None 2024-03-20T13:36:31.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ba4062860 con 0x7f6ba406c0d0 2024-03-20T13:36:31.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6b9a7fc640 1 -- 172.21.15.89:0/2184131898 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ba00b2020 con 0x7f6ba406c0d0 2024-03-20T13:36:31.594 INFO:teuthology.orchestra.run.smithi089.stdout:42949672965 2024-03-20T13:36:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6b88035a10 msgr2=0x7f6b88037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6b88035a10 0x7f6b88037ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b94001e70 tx=0x7f6b94001440 comp rx=0 tx=0).stop 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 msgr2=0x7f6ba408a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 0x7f6ba408a000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ba001a960 tx=0x7f6ba0019ad0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 shutdown_connections 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6b88035a10 0x7f6b88037ed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 --2- 172.21.15.89:0/2184131898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ba406c0d0 0x7f6ba408a000 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 >> 172.21.15.89:0/2184131898 conn(0x7f6ba409d1d0 msgr2=0x7f6ba4098890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 shutdown_connections 2024-03-20T13:36:31.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.594+0000 7f6babfa2640 1 -- 172.21.15.89:0/2184131898 wait complete. 2024-03-20T13:36:31.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.3 2024-03-20T13:36:31.610 DEBUG:teuthology.parallel:result is None 2024-03-20T13:36:31.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-20T13:36:31.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 Processor -- start 2024-03-20T13:36:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- start start 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91b01290f0 0x7f91b012c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b0095ee0 con 0x7f91b0128d10 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b0096320 con 0x7f91b01290f0 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b5e8b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f91b0128d10 0x7f91b012bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40996/0 (socket says 172.21.15.89:40996) 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b5e8b640 1 -- 172.21.15.89:0/2564781965 learned_addr learned my addr 172.21.15.89:0/2564781965 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b568a640 1 --2- 172.21.15.89:0/2564781965 >> v2:172.21.15.89:3300/0 conn(0x7f91b01290f0 0x7f91b012c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b4e89640 1 -- 172.21.15.89:0/2564781965 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388617664 0 0) 0x7f91b0095ee0 con 0x7f91b0128d10 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b4e89640 1 -- 172.21.15.89:0/2564781965 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f919c003530 con 0x7f91b0128d10 2024-03-20T13:36:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b568a640 1 -- 172.21.15.89:0/2564781965 >> v1:172.21.15.89:6789/0 conn(0x7f91b0128d10 legacy=0x7f91b012bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b568a640 1 -- 172.21.15.89:0/2564781965 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0128620 con 0x7f91b01290f0 2024-03-20T13:36:31.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b568a640 1 --2- 172.21.15.89:0/2564781965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b01290f0 0x7f91b012c230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009740 tx=0x7f91a001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2ecac8e34dd263 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b4e89640 1 -- 172.21.15.89:0/2564781965 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91a00ac530 con 0x7f91b01290f0 2024-03-20T13:36:31.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b4e89640 1 -- 172.21.15.89:0/2564781965 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a00a8050 con 0x7f91b01290f0 2024-03-20T13:36:31.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b4e89640 1 -- 172.21.15.89:0/2564781965 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91a00ac7c0 con 0x7f91b01290f0 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- 172.21.15.89:0/2564781965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b01290f0 msgr2=0x7f91b012c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 --2- 172.21.15.89:0/2564781965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b01290f0 0x7f91b012c230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009740 tx=0x7f91a001c490 comp rx=0 tx=0).stop 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- 172.21.15.89:0/2564781965 shutdown_connections 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 --2- 172.21.15.89:0/2564781965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b01290f0 0x7f91b012c230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- 172.21.15.89:0/2564781965 >> 172.21.15.89:0/2564781965 conn(0x7f91b009a2f0 msgr2=0x7f91b009a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- 172.21.15.89:0/2564781965 shutdown_connections 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.758+0000 7f91b80ef640 1 -- 172.21.15.89:0/2564781965 wait complete. 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 Processor -- start 2024-03-20T13:36:31.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 -- start start 2024-03-20T13:36:31.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 0x7f91b012ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b01310d0 con 0x7f91b0128d10 2024-03-20T13:36:31.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b5e8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 0x7f91b012ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b5e8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 0x7f91b012ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47216/0 (socket says 172.21.15.89:47216) 2024-03-20T13:36:31.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b5e8b640 1 -- 172.21.15.89:0/1100853362 learned_addr learned my addr 172.21.15.89:0/1100853362 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:31.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b5e8b640 1 -- 172.21.15.89:0/1100853362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009420 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b5e8b640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 0x7f91b012ead0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00cb40 tx=0x7f91ac0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91ac00ab80 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00ace0 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b0130460 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91ac012400 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b0130c80 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f91ac007070 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b0067e00 con 0x7f91b0128d10 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91a67fc640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9194035a10 0x7f9194037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f91ac047c90 con 0x7f91b0128d10 2024-03-20T13:36:31.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b568a640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9194035a10 0x7f9194037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.762+0000 7f91b568a640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9194035a10 0x7f9194037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91a00ae000 tx=0x7f91a00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.766+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f91ac0198b0 con 0x7f91b0128d10 2024-03-20T13:36:31.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:31.910+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91b0122050 con 0x7f9194035a10 2024-03-20T13:36:32.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91a67fc640 1 -- 172.21.15.89:0/1100853362 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34638 (secure 0 0 0) 0x7f91b0122050 con 0x7f9194035a10 2024-03-20T13:36:32.017 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:32.017 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:36:32.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9194035a10 msgr2=0x7f9194037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9194035a10 0x7f9194037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91a00ae000 tx=0x7f91a00a7000 comp rx=0 tx=0).stop 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 msgr2=0x7f91b012ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 0x7f91b012ead0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00cb40 tx=0x7f91ac0021f0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 shutdown_connections 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9194035a10 0x7f9194037ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 --2- 172.21.15.89:0/1100853362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b0128d10 0x7f91b012ead0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 >> 172.21.15.89:0/1100853362 conn(0x7f91b009a2f0 msgr2=0x7f91b0121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 shutdown_connections 2024-03-20T13:36:32.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.018+0000 7f91b80ef640 1 -- 172.21.15.89:0/1100853362 wait complete. 2024-03-20T13:36:32.036 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-20T13:36:30.236486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118100,"kb_used_data":1696,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369260,"statfs":{"total":386547056640,"available":386426122240,"internally_reserved":0,"allocated":1736704,"data_stored":1347844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.502546"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754690+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:36:28.754690+0000","last_peered":"2024-03-20T13:36:28.754690+0000","last_clean":"2024-03-20T13:36:28.754690+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:36:28.754690+0000","last_undegraded":"2024-03-20T13:36:28.754690+0000","last_fullsized":"2024-03-20T13:36:28.754690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:51.587676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.750939+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:36:29.750939+0000","last_peered":"2024-03-20T13:36:29.750939+0000","last_clean":"2024-03-20T13:36:29.750939+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:36:29.750939+0000","last_undegraded":"2024-03-20T13:36:29.750939+0000","last_fullsized":"2024-03-20T13:36:29.750939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:06.931743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754168+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:36:28.754168+0000","last_peered":"2024-03-20T13:36:28.754168+0000","last_clean":"2024-03-20T13:36:28.754168+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:36:28.754168+0000","last_undegraded":"2024-03-20T13:36:28.754168+0000","last_fullsized":"2024-03-20T13:36:28.754168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:22.091459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.750891+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:36:29.750891+0000","last_peered":"2024-03-20T13:36:29.750891+0000","last_clean":"2024-03-20T13:36:29.750891+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:36:29.750891+0000","last_undegraded":"2024-03-20T13:36:29.750891+0000","last_fullsized":"2024-03-20T13:36:29.750891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:01:29.010451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754231+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:36:28.754231+0000","last_peered":"2024-03-20T13:36:28.754231+0000","last_clean":"2024-03-20T13:36:28.754231+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:36:28.754231+0000","last_undegraded":"2024-03-20T13:36:28.754231+0000","last_fullsized":"2024-03-20T13:36:28.754231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:18.974392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.122210+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:36:29.122210+0000","last_peered":"2024-03-20T13:36:29.122210+0000","last_clean":"2024-03-20T13:36:29.122210+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:36:29.122210+0000","last_undegraded":"2024-03-20T13:36:29.122210+0000","last_fullsized":"2024-03-20T13:36:29.122210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:22.091459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.755280+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:36:28.755280+0000","last_peered":"2024-03-20T13:36:28.755280+0000","last_clean":"2024-03-20T13:36:28.755280+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:36:28.755280+0000","last_undegraded":"2024-03-20T13:36:28.755280+0000","last_fullsized":"2024-03-20T13:36:28.755280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:03:07.383831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754212+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:36:28.754212+0000","last_peered":"2024-03-20T13:36:28.754212+0000","last_clean":"2024-03-20T13:36:28.754212+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:36:28.754212+0000","last_undegraded":"2024-03-20T13:36:28.754212+0000","last_fullsized":"2024-03-20T13:36:28.754212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.750605+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:36:29.750605+0000","last_peered":"2024-03-20T13:36:29.750605+0000","last_clean":"2024-03-20T13:36:29.750605+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:36:29.750605+0000","last_undegraded":"2024-03-20T13:36:29.750605+0000","last_fullsized":"2024-03-20T13:36:29.750605+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:11.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":633156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":633156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":42788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:32.037 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:32.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.154+0000 7ff251a5f640 1 Processor -- start 2024-03-20T13:36:32.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff251a5f640 1 -- start start 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff251a5f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff24c06c3f0 0x7ff24c12fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff251a5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c072390 con 0x7ff24c12b000 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff251a5f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c09c1e0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff24c06c3f0 0x7ff24c12fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff24c06c3f0 0x7ff24c12fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47222/0 (socket says 172.21.15.89:47222) 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24a7fc640 1 -- 172.21.15.89:0/243217156 learned_addr learned my addr 172.21.15.89:0/243217156 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24affd640 1 --1- 172.21.15.89:0/243217156 >> v1:172.21.15.89:6789/0 conn(0x7ff24c12b000 0x7ff24c12b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41008/0 (socket says 172.21.15.89:41008) 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24a7fc640 1 -- 172.21.15.89:0/243217156 >> v1:172.21.15.89:6789/0 conn(0x7ff24c12b000 legacy=0x7ff24c12b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24a7fc640 1 -- 172.21.15.89:0/243217156 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c06d030 con 0x7ff24c06c3f0 2024-03-20T13:36:32.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff24a7fc640 1 --2- 172.21.15.89:0/243217156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c12fe30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff244009e50 tx=0x7ff24401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38546709794b35a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff249ffb640 1 -- 172.21.15.89:0/243217156 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff244009200 con 0x7ff24c06c3f0 2024-03-20T13:36:32.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff249ffb640 1 -- 172.21.15.89:0/243217156 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2440a64d0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff249ffb640 1 -- 172.21.15.89:0/243217156 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2440a6790 con 0x7ff24c06c3f0 2024-03-20T13:36:32.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff251a5f640 1 -- 172.21.15.89:0/243217156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 msgr2=0x7ff24c12fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.158+0000 7ff251a5f640 1 --2- 172.21.15.89:0/243217156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c12fe30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff244009e50 tx=0x7ff24401c980 comp rx=0 tx=0).stop 2024-03-20T13:36:32.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/243217156 shutdown_connections 2024-03-20T13:36:32.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 --2- 172.21.15.89:0/243217156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c12fe30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/243217156 >> 172.21.15.89:0/243217156 conn(0x7ff24c09a2f0 msgr2=0x7ff24c09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/243217156 shutdown_connections 2024-03-20T13:36:32.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/243217156 wait complete. 2024-03-20T13:36:32.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 Processor -- start 2024-03-20T13:36:32.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- start start 2024-03-20T13:36:32.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c1c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c1228f0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff24affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c1c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff24affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c1c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47236/0 (socket says 172.21.15.89:47236) 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff24affd640 1 -- 172.21.15.89:0/3939823490 learned_addr learned my addr 172.21.15.89:0/3939823490 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff24affd640 1 -- 172.21.15.89:0/3939823490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009b30 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff24affd640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c1c5a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c410 tx=0x7ff23400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff234007410 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234007570 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c097480 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2340047f0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c1239d0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff234004950 con 0x7ff24c06c3f0 2024-03-20T13:36:32.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c1225d0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff243fff640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff230035a10 0x7ff230037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff234047750 con 0x7ff24c06c3f0 2024-03-20T13:36:32.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.162+0000 7ff24a7fc640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff230035a10 0x7ff230037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.166+0000 7ff24a7fc640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff230035a10 0x7ff230037ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2440ae000 tx=0x7ff2440a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.166+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2340192c0 con 0x7ff24c06c3f0 2024-03-20T13:36:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.322+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff24c067e00 con 0x7ff230035a10 2024-03-20T13:36:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff243fff640 1 -- 172.21.15.89:0/3939823490 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34630 (secure 0 0 0) 0x7ff24c067e00 con 0x7ff230035a10 2024-03-20T13:36:32.326 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff230035a10 msgr2=0x7ff230037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff230035a10 0x7ff230037ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2440ae000 tx=0x7ff2440a7000 comp rx=0 tx=0).stop 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 msgr2=0x7ff24c1c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c1c5a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c410 tx=0x7ff23400c8d0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 shutdown_connections 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff230035a10 0x7ff230037ed0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 --2- 172.21.15.89:0/3939823490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24c06c3f0 0x7ff24c1c5a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 >> 172.21.15.89:0/3939823490 conn(0x7ff24c09a2f0 msgr2=0x7ff24c12bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 shutdown_connections 2024-03-20T13:36:32.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.326+0000 7ff251a5f640 1 -- 172.21.15.89:0/3939823490 wait complete. 2024-03-20T13:36:32.343 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-20T13:36:32.237012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118144,"kb_used_data":1728,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369216,"statfs":{"total":386547056640,"available":386426077184,"internally_reserved":0,"allocated":1769472,"data_stored":1363948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.503072"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754690+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:36:28.754690+0000","last_peered":"2024-03-20T13:36:28.754690+0000","last_clean":"2024-03-20T13:36:28.754690+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:36:28.754690+0000","last_undegraded":"2024-03-20T13:36:28.754690+0000","last_fullsized":"2024-03-20T13:36:28.754690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:51.587676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.750939+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:36:29.750939+0000","last_peered":"2024-03-20T13:36:29.750939+0000","last_clean":"2024-03-20T13:36:29.750939+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:36:29.750939+0000","last_undegraded":"2024-03-20T13:36:29.750939+0000","last_fullsized":"2024-03-20T13:36:29.750939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:06.931743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754168+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:36:28.754168+0000","last_peered":"2024-03-20T13:36:28.754168+0000","last_clean":"2024-03-20T13:36:28.754168+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:36:28.754168+0000","last_undegraded":"2024-03-20T13:36:28.754168+0000","last_fullsized":"2024-03-20T13:36:28.754168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:22.091459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.750891+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:36:29.750891+0000","last_peered":"2024-03-20T13:36:29.750891+0000","last_clean":"2024-03-20T13:36:29.750891+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:36:29.750891+0000","last_undegraded":"2024-03-20T13:36:29.750891+0000","last_fullsized":"2024-03-20T13:36:29.750891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:01:29.010451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754231+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:36:28.754231+0000","last_peered":"2024-03-20T13:36:28.754231+0000","last_clean":"2024-03-20T13:36:28.754231+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:36:28.754231+0000","last_undegraded":"2024-03-20T13:36:28.754231+0000","last_fullsized":"2024-03-20T13:36:28.754231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:18.974392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:30.825526+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:36:30.825526+0000","last_peered":"2024-03-20T13:36:30.825526+0000","last_clean":"2024-03-20T13:36:30.825526+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:36:30.825526+0000","last_undegraded":"2024-03-20T13:36:30.825526+0000","last_fullsized":"2024-03-20T13:36:30.825526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.755280+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:36:28.755280+0000","last_peered":"2024-03-20T13:36:28.755280+0000","last_clean":"2024-03-20T13:36:28.755280+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:36:28.755280+0000","last_undegraded":"2024-03-20T13:36:28.755280+0000","last_fullsized":"2024-03-20T13:36:28.755280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:03:07.383831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-20T13:36:28.754212+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:36:28.754212+0000","last_peered":"2024-03-20T13:36:28.754212+0000","last_clean":"2024-03-20T13:36:28.754212+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:36:28.754212+0000","last_undegraded":"2024-03-20T13:36:28.754212+0000","last_fullsized":"2024-03-20T13:36:28.754212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-20T13:36:29.750605+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:36:29.750605+0000","last_peered":"2024-03-20T13:36:29.750605+0000","last_clean":"2024-03-20T13:36:29.750605+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:36:29.750605+0000","last_undegraded":"2024-03-20T13:36:29.750605+0000","last_fullsized":"2024-03-20T13:36:29.750605+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:11.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":46808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":637176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":741376,"data_stored":637176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":139264,"data_stored":42788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:32.344 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-20T13:36:32.344 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-20T13:36:32.344 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-20T13:36:32.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f923b640640 1 Processor -- start 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f923b640640 1 -- start start 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f923b640640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f923412b000 0x7f923412b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f923b640640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9234072390 con 0x7f923406c3f0 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f923b640640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923409c1e0 con 0x7f923412b000 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f92393dc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f923412b000 0x7f923412b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f9238bdb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f923406c3f0 0x7f92341210b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41012/0 (socket says 172.21.15.89:41012) 2024-03-20T13:36:32.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f9238bdb640 1 -- 172.21.15.89:0/2082846241 learned_addr learned my addr 172.21.15.89:0/2082846241 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:36:32.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f92393dc640 1 -- 172.21.15.89:0/2082846241 >> v1:172.21.15.89:6789/0 conn(0x7f923406c3f0 legacy=0x7f92341210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.462+0000 7f92393dc640 1 -- 172.21.15.89:0/2082846241 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923406d030 con 0x7f923412b000 2024-03-20T13:36:32.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f92393dc640 1 --2- 172.21.15.89:0/2082846241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923412b000 0x7f923412b3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f922c009740 tx=0x7f922c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e404478419de56d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f9233fff640 1 -- 172.21.15.89:0/2082846241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f922c0ab530 con 0x7f923412b000 2024-03-20T13:36:32.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f9233fff640 1 -- 172.21.15.89:0/2082846241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c0a7050 con 0x7f923412b000 2024-03-20T13:36:32.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f9233fff640 1 -- 172.21.15.89:0/2082846241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f922c0ab7e0 con 0x7f923412b000 2024-03-20T13:36:32.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/2082846241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923412b000 msgr2=0x7f923412b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 --2- 172.21.15.89:0/2082846241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923412b000 0x7f923412b3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f922c009740 tx=0x7f922c01c370 comp rx=0 tx=0).stop 2024-03-20T13:36:32.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/2082846241 shutdown_connections 2024-03-20T13:36:32.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 --2- 172.21.15.89:0/2082846241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923412b000 0x7f923412b3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/2082846241 >> 172.21.15.89:0/2082846241 conn(0x7f923409a2f0 msgr2=0x7f923409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/2082846241 shutdown_connections 2024-03-20T13:36:32.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/2082846241 wait complete. 2024-03-20T13:36:32.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 Processor -- start 2024-03-20T13:36:32.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- start start 2024-03-20T13:36:32.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 0x7f92341c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923406e540 con 0x7f923406c3f0 2024-03-20T13:36:32.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f92393dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 0x7f92341c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f92393dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 0x7f92341c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47262/0 (socket says 172.21.15.89:47262) 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f92393dc640 1 -- 172.21.15.89:0/3081734214 learned_addr learned my addr 172.21.15.89:0/3081734214 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f92393dc640 1 -- 172.21.15.89:0/3081734214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c009420 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f92393dc640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 0x7f92341c1380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f922c019fa0 tx=0x7f922c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f922c0b7580 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c0b76e0 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9234130570 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f922c0b7980 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.466+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923406e870 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.470+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923406e380 con 0x7f923406c3f0 2024-03-20T13:36:32.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.470+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f922c0b7ae0 con 0x7f923406c3f0 2024-03-20T13:36:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.470+0000 7f9231ffb640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9220035a10 0x7f9220037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.470+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f922c0e28e0 con 0x7f923406c3f0 2024-03-20T13:36:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.470+0000 7f9238bdb640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9220035a10 0x7f9220037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.470+0000 7f9238bdb640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9220035a10 0x7f9220037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9228002090 tx=0x7f9228001680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.474+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f922c0c7c00 con 0x7f923406c3f0 2024-03-20T13:36:32.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.650+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9234067e00 con 0x7f923406c3f0 2024-03-20T13:36:32.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f9231ffb640 1 -- 172.21.15.89:0/3081734214 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f922c0bb080 con 0x7f923406c3f0 2024-03-20T13:36:32.653 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:36:32.653 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-20T13:36:32.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9220035a10 msgr2=0x7f9220037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9220035a10 0x7f9220037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9228002090 tx=0x7f9228001680 comp rx=0 tx=0).stop 2024-03-20T13:36:32.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 msgr2=0x7f92341c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 0x7f92341c1380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f922c019fa0 tx=0x7f922c01abb0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 shutdown_connections 2024-03-20T13:36:32.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9220035a10 0x7f9220037ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 --2- 172.21.15.89:0/3081734214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f923406c3f0 0x7f92341c1380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 >> 172.21.15.89:0/3081734214 conn(0x7f923409a2f0 msgr2=0x7f92340971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 shutdown_connections 2024-03-20T13:36:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:36:32.654+0000 7f923b640640 1 -- 172.21.15.89:0/3081734214 wait complete. 2024-03-20T13:36:32.670 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-20T13:36:32.670 INFO:teuthology.run_tasks:Running task rgw... 2024-03-20T13:36:32.686 DEBUG:tasks.rgw:config is {'client.0': None} 2024-03-20T13:36:32.686 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-20T13:36:32.687 INFO:tasks.rgw:Creating data pools 2024-03-20T13:36:32.687 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-20T13:36:32.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-03-20T13:36:32.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.814+0000 7eff58c45640 1 Processor -- start 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.814+0000 7eff58c45640 1 -- start start 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.814+0000 7eff58c45640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff5410e020 0x7eff5410e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.814+0000 7eff58c45640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5410eb50 con 0x7eff541171a0 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.814+0000 7eff58c45640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5411bcc0 con 0x7eff5410e020 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff5259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff5410e020 0x7eff5410e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff5259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff5410e020 0x7eff5410e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34782/0 (socket says 172.21.15.123:34782) 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff5259c640 1 -- 172.21.15.123:0/3737577519 learned_addr learned my addr 172.21.15.123:0/3737577519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:32.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff51d9b640 1 --1- 172.21.15.123:0/3737577519 >> v1:172.21.15.89:6789/0 conn(0x7eff541171a0 0x7eff54119590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33996/0 (socket says 172.21.15.123:33996) 2024-03-20T13:36:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff5259c640 1 -- 172.21.15.123:0/3737577519 >> v1:172.21.15.89:6789/0 conn(0x7eff541171a0 legacy=0x7eff54119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff5259c640 1 -- 172.21.15.123:0/3737577519 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5411be00 con 0x7eff5410e020 2024-03-20T13:36:32.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.818+0000 7eff5259c640 1 --2- 172.21.15.123:0/3737577519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff5410e400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff440097f0 tx=0x7eff4401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1a9176e2204dae server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5159a640 1 -- 172.21.15.123:0/3737577519 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff440ab580 con 0x7eff5410e020 2024-03-20T13:36:32.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5159a640 1 -- 172.21.15.123:0/3737577519 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440ab6e0 con 0x7eff5410e020 2024-03-20T13:36:32.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5159a640 1 -- 172.21.15.123:0/3737577519 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff440ab9a0 con 0x7eff5410e020 2024-03-20T13:36:32.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- 172.21.15.123:0/3737577519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 msgr2=0x7eff5410e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 --2- 172.21.15.123:0/3737577519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff5410e400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff440097f0 tx=0x7eff4401c430 comp rx=0 tx=0).stop 2024-03-20T13:36:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- 172.21.15.123:0/3737577519 shutdown_connections 2024-03-20T13:36:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 --2- 172.21.15.123:0/3737577519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff5410e400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- 172.21.15.123:0/3737577519 >> 172.21.15.123:0/3737577519 conn(0x7eff5406e8d0 msgr2=0x7eff54070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- 172.21.15.123:0/3737577519 shutdown_connections 2024-03-20T13:36:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- 172.21.15.123:0/3737577519 wait complete. 2024-03-20T13:36:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 Processor -- start 2024-03-20T13:36:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- start start 2024-03-20T13:36:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff541aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff58c45640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff541aa800 con 0x7eff5410e020 2024-03-20T13:36:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff541aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff541aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34796/0 (socket says 172.21.15.123:34796) 2024-03-20T13:36:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5259c640 1 -- 172.21.15.123:0/2749617599 learned_addr learned my addr 172.21.15.123:0/2749617599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5259c640 1 -- 172.21.15.123:0/2749617599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff440094d0 con 0x7eff5410e020 2024-03-20T13:36:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff5259c640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff541aa230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff44019040 tx=0x7eff4401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.822+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff440ab530 con 0x7eff5410e020 2024-03-20T13:36:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff541aa9a0 con 0x7eff5410e020 2024-03-20T13:36:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440abe30 con 0x7eff5410e020 2024-03-20T13:36:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff440aad60 con 0x7eff5410e020 2024-03-20T13:36:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff541a40c0 con 0x7eff5410e020 2024-03-20T13:36:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff54062860 con 0x7eff5410e020 2024-03-20T13:36:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff440d3ad0 con 0x7eff5410e020 2024-03-20T13:36:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff42ffd640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7eff340359c0 0x7eff34037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7eff440e2fe0 con 0x7eff5410e020 2024-03-20T13:36:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff51d9b640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7eff340359c0 0x7eff34037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.826+0000 7eff51d9b640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7eff340359c0 0x7eff34037e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff54111120 tx=0x7eff48007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:32.838+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7eff440bc340 con 0x7eff5410e020 2024-03-20T13:36:33.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.002+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) v1 -- 0x7eff541171a0 con 0x7eff5410e020 2024-03-20T13:36:33.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.758+0000 7eff42ffd640 1 -- 172.21.15.123:0/2749617599 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7eff440c6c30 con 0x7eff5410e020 2024-03-20T13:36:33.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7eff340359c0 msgr2=0x7eff34037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7eff340359c0 0x7eff34037e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff54111120 tx=0x7eff48007a10 comp rx=0 tx=0).stop 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 msgr2=0x7eff541aa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff541aa230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff44019040 tx=0x7eff4401ac70 comp rx=0 tx=0).stop 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 shutdown_connections 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7eff340359c0 0x7eff34037e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 --2- 172.21.15.123:0/2749617599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff5410e020 0x7eff541aa230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 >> 172.21.15.123:0/2749617599 conn(0x7eff5406e8d0 msgr2=0x7eff54118b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 shutdown_connections 2024-03-20T13:36:33.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.762+0000 7eff58c45640 1 -- 172.21.15.123:0/2749617599 wait complete. 2024-03-20T13:36:33.786 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-03-20T13:36:33.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f4484405640 1 Processor -- start 2024-03-20T13:36:33.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f4484405640 1 -- start start 2024-03-20T13:36:33.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f4484405640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f447c10e020 0x7f447c10e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f4484405640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c10eb50 con 0x7f447c1171a0 2024-03-20T13:36:33.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f4484405640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c11bcc0 con 0x7f447c10e020 2024-03-20T13:36:33.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f44821a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f447c10e020 0x7f447c10e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f44821a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f447c10e020 0x7f447c10e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47790/0 (socket says 172.21.15.123:47790) 2024-03-20T13:36:33.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f44821a1640 1 -- 172.21.15.123:0/643900466 learned_addr learned my addr 172.21.15.123:0/643900466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:33.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f44819a0640 1 --1- 172.21.15.123:0/643900466 >> v1:172.21.15.89:6789/0 conn(0x7f447c1171a0 0x7f447c119590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33264/0 (socket says 172.21.15.123:33264) 2024-03-20T13:36:33.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f44821a1640 1 -- 172.21.15.123:0/643900466 >> v1:172.21.15.89:6789/0 conn(0x7f447c1171a0 legacy=0x7f447c119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.910+0000 7f44821a1640 1 -- 172.21.15.123:0/643900466 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c11be00 con 0x7f447c10e020 2024-03-20T13:36:33.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f44821a1640 1 --2- 172.21.15.123:0/643900466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c10e400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44780097f0 tx=0x7f447801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b87f3b02701376b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f448119f640 1 -- 172.21.15.123:0/643900466 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44780ab580 con 0x7f447c10e020 2024-03-20T13:36:33.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f448119f640 1 -- 172.21.15.123:0/643900466 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44780ab6e0 con 0x7f447c10e020 2024-03-20T13:36:33.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f448119f640 1 -- 172.21.15.123:0/643900466 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44780ab9a0 con 0x7f447c10e020 2024-03-20T13:36:33.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- 172.21.15.123:0/643900466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 msgr2=0x7f447c10e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 --2- 172.21.15.123:0/643900466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c10e400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44780097f0 tx=0x7f447801c430 comp rx=0 tx=0).stop 2024-03-20T13:36:33.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- 172.21.15.123:0/643900466 shutdown_connections 2024-03-20T13:36:33.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 --2- 172.21.15.123:0/643900466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c10e400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- 172.21.15.123:0/643900466 >> 172.21.15.123:0/643900466 conn(0x7f447c06e8d0 msgr2=0x7f447c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:33.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- 172.21.15.123:0/643900466 shutdown_connections 2024-03-20T13:36:33.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- 172.21.15.123:0/643900466 wait complete. 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 Processor -- start 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- start start 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c1ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f4484405640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1ac980 con 0x7f447c10e020 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f44821a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c1ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f44821a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c1ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47802/0 (socket says 172.21.15.123:47802) 2024-03-20T13:36:33.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.914+0000 7f44821a1640 1 -- 172.21.15.123:0/1062977630 learned_addr learned my addr 172.21.15.123:0/1062977630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f44821a1640 1 -- 172.21.15.123:0/1062977630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780094d0 con 0x7f447c10e020 2024-03-20T13:36:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f44821a1640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c1ac3b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f447801a060 tx=0x7f447801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44780ab530 con 0x7f447c10e020 2024-03-20T13:36:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44780abe10 con 0x7f447c10e020 2024-03-20T13:36:33.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c1acb20 con 0x7f447c10e020 2024-03-20T13:36:33.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44780aace0 con 0x7f447c10e020 2024-03-20T13:36:33.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c1a6240 con 0x7f447c10e020 2024-03-20T13:36:33.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c062860 con 0x7f447c10e020 2024-03-20T13:36:33.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f44780d3ad0 con 0x7f447c10e020 2024-03-20T13:36:33.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4472ffd640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44600359c0 0x7f4460037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3797+0+0 (secure 0 0 0) 0x7f44780e3100 con 0x7f447c10e020 2024-03-20T13:36:33.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f44819a0640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44600359c0 0x7f4460037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.918+0000 7f44819a0640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44600359c0 0x7f4460037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f447c111120 tx=0x7f446c007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:33.930+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f44780c6860 con 0x7f447c10e020 2024-03-20T13:36:34.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:34.086+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f447c1171a0 con 0x7f447c10e020 2024-03-20T13:36:35.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.770+0000 7f4472ffd640 1 -- 172.21.15.123:0/1062977630 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) v1 ==== 227+0+0 (secure 0 0 0) 0x7f44780c6860 con 0x7f447c10e020 2024-03-20T13:36:35.779 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'default.rgw.buckets.data' created 2024-03-20T13:36:35.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44600359c0 msgr2=0x7f4460037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44600359c0 0x7f4460037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f447c111120 tx=0x7f446c007a10 comp rx=0 tx=0).stop 2024-03-20T13:36:35.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 msgr2=0x7f447c1ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c1ac3b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f447801a060 tx=0x7f447801ac70 comp rx=0 tx=0).stop 2024-03-20T13:36:35.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 shutdown_connections 2024-03-20T13:36:35.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44600359c0 0x7f4460037e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 --2- 172.21.15.123:0/1062977630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f447c10e020 0x7f447c1ac3b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 >> 172.21.15.123:0/1062977630 conn(0x7f447c06e8d0 msgr2=0x7f447c114210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 shutdown_connections 2024-03-20T13:36:35.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.778+0000 7f4484405640 1 -- 172.21.15.123:0/1062977630 wait complete. 2024-03-20T13:36:35.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-20T13:36:35.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff12e311640 1 Processor -- start 2024-03-20T13:36:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff12e311640 1 -- start start 2024-03-20T13:36:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff12e311640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff12810e020 0x7ff12810e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff12e311640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12811cce0 con 0x7ff12810e940 2024-03-20T13:36:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff12e311640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12811de80 con 0x7ff12810e020 2024-03-20T13:36:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff127fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff12810e020 0x7ff12810e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff127fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff12810e020 0x7ff12810e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47814/0 (socket says 172.21.15.123:47814) 2024-03-20T13:36:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff127fff640 1 -- 172.21.15.123:0/3781772024 learned_addr learned my addr 172.21.15.123:0/3781772024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff127fff640 1 -- 172.21.15.123:0/3781772024 >> v1:172.21.15.89:6789/0 conn(0x7ff12810e940 legacy=0x7ff12811b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.934+0000 7ff127fff640 1 -- 172.21.15.123:0/3781772024 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12811dff0 con 0x7ff12810e020 2024-03-20T13:36:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff127fff640 1 --2- 172.21.15.123:0/3781772024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff12810e400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff120009e50 tx=0x7ff12001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a15e4695e70e7b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff126ffd640 1 -- 172.21.15.123:0/3781772024 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff120009200 con 0x7ff12810e020 2024-03-20T13:36:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff126ffd640 1 -- 172.21.15.123:0/3781772024 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200a57e0 con 0x7ff12810e020 2024-03-20T13:36:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff126ffd640 1 -- 172.21.15.123:0/3781772024 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1200a5aa0 con 0x7ff12810e020 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- 172.21.15.123:0/3781772024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 msgr2=0x7ff12810e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 --2- 172.21.15.123:0/3781772024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff12810e400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff120009e50 tx=0x7ff12001c980 comp rx=0 tx=0).stop 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- 172.21.15.123:0/3781772024 shutdown_connections 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 --2- 172.21.15.123:0/3781772024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff12810e400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- 172.21.15.123:0/3781772024 >> 172.21.15.123:0/3781772024 conn(0x7ff12806e870 msgr2=0x7ff128070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- 172.21.15.123:0/3781772024 shutdown_connections 2024-03-20T13:36:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- 172.21.15.123:0/3781772024 wait complete. 2024-03-20T13:36:35.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 Processor -- start 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- start start 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff1281a8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff12e311640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1281a8cd0 con 0x7ff12810e020 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff127fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff1281a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff127fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff1281a8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47816/0 (socket says 172.21.15.123:47816) 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.938+0000 7ff127fff640 1 -- 172.21.15.123:0/1374951419 learned_addr learned my addr 172.21.15.123:0/1374951419 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:35.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff127fff640 1 -- 172.21.15.123:0/1374951419 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120009b30 con 0x7ff12810e020 2024-03-20T13:36:35.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff127fff640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff1281a8790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff12001a5b0 tx=0x7ff120019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff120007a60 con 0x7ff12810e020 2024-03-20T13:36:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1281a8ed0 con 0x7ff12810e020 2024-03-20T13:36:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1281ad0b0 con 0x7ff12810e020 2024-03-20T13:36:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120007bc0 con 0x7ff12810e020 2024-03-20T13:36:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff120007e60 con 0x7ff12810e020 2024-03-20T13:36:35.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff128062860 con 0x7ff12810e020 2024-03-20T13:36:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1200b8470 con 0x7ff12810e020 2024-03-20T13:36:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff124ff9640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff108035a10 0x7ff108037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4272+0+0 (secure 0 0 0) 0x7ff1200e3f70 con 0x7ff12810e020 2024-03-20T13:36:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff1277fe640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff108035a10 0x7ff108037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.942+0000 7ff1277fe640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff108035a10 0x7ff108037ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff12810eda0 tx=0x7ff1100079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:35.954+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1200b5970 con 0x7ff12810e020 2024-03-20T13:36:36.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.118+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7ff128067620 con 0x7ff12810e020 2024-03-20T13:36:36.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff124ff9640 1 -- 172.21.15.123:0/1374951419 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff1200b53a0 con 0x7ff12810e020 2024-03-20T13:36:36.785 INFO:teuthology.orchestra.run.smithi123.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-20T13:36:36.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff108035a10 msgr2=0x7ff108037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:36.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff108035a10 0x7ff108037ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff12810eda0 tx=0x7ff1100079e0 comp rx=0 tx=0).stop 2024-03-20T13:36:36.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 msgr2=0x7ff1281a8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:36.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff1281a8790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff12001a5b0 tx=0x7ff120019720 comp rx=0 tx=0).stop 2024-03-20T13:36:36.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 shutdown_connections 2024-03-20T13:36:36.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff108035a10 0x7ff108037ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:36.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 --2- 172.21.15.123:0/1374951419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff12810e020 0x7ff1281a8790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:36.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 >> 172.21.15.123:0/1374951419 conn(0x7ff12806e870 msgr2=0x7ff12806ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:36.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 shutdown_connections 2024-03-20T13:36:36.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.782+0000 7ff12e311640 1 -- 172.21.15.123:0/1374951419 wait complete. 2024-03-20T13:36:36.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-20T13:36:36.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a7563640 1 Processor -- start 2024-03-20T13:36:36.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a7563640 1 -- start start 2024-03-20T13:36:36.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a7563640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84a010e020 0x7f84a010e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:36.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a7563640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a011cce0 con 0x7f84a010e940 2024-03-20T13:36:36.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a7563640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a011de80 con 0x7f84a010e020 2024-03-20T13:36:36.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a52ff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84a010e020 0x7f84a010e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a4afe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f84a010e940 0x7f84a011b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33284/0 (socket says 172.21.15.123:33284) 2024-03-20T13:36:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a4afe640 1 -- 172.21.15.123:0/1271045684 learned_addr learned my addr 172.21.15.123:0/1271045684 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a52ff640 1 -- 172.21.15.123:0/1271045684 >> v1:172.21.15.89:6789/0 conn(0x7f84a010e940 legacy=0x7f84a011b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.946+0000 7f84a52ff640 1 -- 172.21.15.123:0/1271045684 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a011dff0 con 0x7f84a010e020 2024-03-20T13:36:36.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a52ff640 1 --2- 172.21.15.123:0/1271045684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a010e400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f849c009740 tx=0x7f849c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad9a2c8e136a8c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f8497fff640 1 -- 172.21.15.123:0/1271045684 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f849c0a8050 con 0x7f84a010e020 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f8497fff640 1 -- 172.21.15.123:0/1271045684 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c0ac520 con 0x7f84a010e020 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f8497fff640 1 -- 172.21.15.123:0/1271045684 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f849c0ac7e0 con 0x7f84a010e020 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- 172.21.15.123:0/1271045684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 msgr2=0x7f84a010e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 --2- 172.21.15.123:0/1271045684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a010e400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f849c009740 tx=0x7f849c01c370 comp rx=0 tx=0).stop 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- 172.21.15.123:0/1271045684 shutdown_connections 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 --2- 172.21.15.123:0/1271045684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a010e400 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- 172.21.15.123:0/1271045684 >> 172.21.15.123:0/1271045684 conn(0x7f84a006e870 msgr2=0x7f84a0070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- 172.21.15.123:0/1271045684 shutdown_connections 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- 172.21.15.123:0/1271045684 wait complete. 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 Processor -- start 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- start start 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a01a8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:36.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a7563640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a01a8d40 con 0x7f84a010e020 2024-03-20T13:36:36.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a52ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a01a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:36.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a52ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a01a8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47824/0 (socket says 172.21.15.123:47824) 2024-03-20T13:36:36.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.950+0000 7f84a52ff640 1 -- 172.21.15.123:0/746925722 learned_addr learned my addr 172.21.15.123:0/746925722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:36.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a52ff640 1 -- 172.21.15.123:0/746925722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c009420 con 0x7f84a010e020 2024-03-20T13:36:36.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a52ff640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a01a8800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f849c0af040 tx=0x7f849c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:36.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f849c0ab8d0 con 0x7f84a010e020 2024-03-20T13:36:36.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c0aba30 con 0x7f84a010e020 2024-03-20T13:36:36.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f849c0abcd0 con 0x7f84a010e020 2024-03-20T13:36:36.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a01a8f40 con 0x7f84a010e020 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a01ad120 con 0x7f84a010e020 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a01a9360 con 0x7f84a010e020 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f849c0b8450 con 0x7f84a010e020 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f8495ffb640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f84840359c0 0x7f8484037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4283+0+0 (secure 0 0 0) 0x7f849c0e3230 con 0x7f84a010e020 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a4afe640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f84840359c0 0x7f8484037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.954+0000 7f84a4afe640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f84840359c0 0x7f8484037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84a010eda0 tx=0x7f8490007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:36.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:36.966+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f849c0c9390 con 0x7f84a010e020 2024-03-20T13:36:37.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.130+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f84a0062860 con 0x7f84a010e020 2024-03-20T13:36:37.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f8495ffb640 1 -- 172.21.15.123:0/746925722 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) v1 ==== 169+0+0 (secure 0 0 0) 0x7f849c0b1070 con 0x7f84a010e020 2024-03-20T13:36:37.787 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'default.rgw.buckets.index' created 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f84840359c0 msgr2=0x7f8484037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f84840359c0 0x7f8484037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84a010eda0 tx=0x7f8490007a90 comp rx=0 tx=0).stop 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 msgr2=0x7f84a01a8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a01a8800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f849c0af040 tx=0x7f849c01abb0 comp rx=0 tx=0).stop 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 shutdown_connections 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f84840359c0 0x7f8484037e80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 --2- 172.21.15.123:0/746925722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a010e020 0x7f84a01a8800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.782+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 >> 172.21.15.123:0/746925722 conn(0x7f84a006e870 msgr2=0x7f84a006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.786+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 shutdown_connections 2024-03-20T13:36:37.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.786+0000 7f84a7563640 1 -- 172.21.15.123:0/746925722 wait complete. 2024-03-20T13:36:37.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-20T13:36:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f324beb8640 1 Processor -- start 2024-03-20T13:36:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f324beb8640 1 -- start start 2024-03-20T13:36:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f324beb8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f324411a530 0x7f324411c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f324beb8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324410ec30 con 0x7f324410e020 2024-03-20T13:36:37.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f324beb8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324411de90 con 0x7f324411a530 2024-03-20T13:36:37.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f3249453640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f324411a530 0x7f324411c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:37.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f3249453640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f324411a530 0x7f324411c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47836/0 (socket says 172.21.15.123:47836) 2024-03-20T13:36:37.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f3249453640 1 -- 172.21.15.123:0/2521628245 learned_addr learned my addr 172.21.15.123:0/2521628245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:37.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f3249453640 1 -- 172.21.15.123:0/2521628245 >> v1:172.21.15.89:6789/0 conn(0x7f324410e020 legacy=0x7f324410e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:37.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.926+0000 7f3249453640 1 -- 172.21.15.123:0/2521628245 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324411e000 con 0x7f324411a530 2024-03-20T13:36:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3249453640 1 --2- 172.21.15.123:0/2521628245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324411a530 0x7f324411c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32340097f0 tx=0x7f323401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befa87c3e7e75bbe server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3248c52640 1 -- 172.21.15.123:0/2521628245 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32340ab580 con 0x7f324411a530 2024-03-20T13:36:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3248c52640 1 -- 172.21.15.123:0/2521628245 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32340ab6e0 con 0x7f324411a530 2024-03-20T13:36:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3248c52640 1 -- 172.21.15.123:0/2521628245 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32340ab9a0 con 0x7f324411a530 2024-03-20T13:36:37.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- 172.21.15.123:0/2521628245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324411a530 msgr2=0x7f324411c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:37.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 --2- 172.21.15.123:0/2521628245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324411a530 0x7f324411c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32340097f0 tx=0x7f323401c430 comp rx=0 tx=0).stop 2024-03-20T13:36:37.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- 172.21.15.123:0/2521628245 shutdown_connections 2024-03-20T13:36:37.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 --2- 172.21.15.123:0/2521628245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324411a530 0x7f324411c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:37.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- 172.21.15.123:0/2521628245 >> 172.21.15.123:0/2521628245 conn(0x7f324406e870 msgr2=0x7f3244070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- 172.21.15.123:0/2521628245 shutdown_connections 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- 172.21.15.123:0/2521628245 wait complete. 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 Processor -- start 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- start start 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 0x7f32441a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f324beb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32441a8cf0 con 0x7f324410e020 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3249c54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 0x7f32441a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3249c54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 0x7f32441a87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:47850/0 (socket says 172.21.15.123:47850) 2024-03-20T13:36:37.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.930+0000 7f3249c54640 1 -- 172.21.15.123:0/494101476 learned_addr learned my addr 172.21.15.123:0/494101476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:37.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f3249c54640 1 -- 172.21.15.123:0/494101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340094d0 con 0x7f324410e020 2024-03-20T13:36:37.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f3249c54640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 0x7f32441a87b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c3a0 tx=0x7f323c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:37.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f323c005150 con 0x7f324410e020 2024-03-20T13:36:37.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32441a8f50 con 0x7f324410e020 2024-03-20T13:36:37.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c0052b0 con 0x7f324410e020 2024-03-20T13:36:37.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f323c0067e0 con 0x7f324410e020 2024-03-20T13:36:37.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32441ad0d0 con 0x7f324410e020 2024-03-20T13:36:37.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3244062860 con 0x7f324410e020 2024-03-20T13:36:37.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f323c006a50 con 0x7f324410e020 2024-03-20T13:36:37.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f323a7fc640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f32280359c0 0x7f3228037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:37.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4647+0+0 (secure 0 0 0) 0x7f323c047810 con 0x7f324410e020 2024-03-20T13:36:37.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f3249453640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f32280359c0 0x7f3228037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:37.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.934+0000 7f3249453640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f32280359c0 0x7f3228037e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32340af000 tx=0x7f3234008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:37.950+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f323c0108d0 con 0x7f324410e020 2024-03-20T13:36:38.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.106+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f324410ec30 con 0x7f324410e020 2024-03-20T13:36:38.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.794+0000 7f323a7fc640 1 -- 172.21.15.123:0/494101476 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) v1 ==== 187+0+0 (secure 0 0 0) 0x7f324410ec30 con 0x7f324410e020 2024-03-20T13:36:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-20T13:36:38.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f32280359c0 msgr2=0x7f3228037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:38.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f32280359c0 0x7f3228037e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32340af000 tx=0x7f3234008040 comp rx=0 tx=0).stop 2024-03-20T13:36:38.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 msgr2=0x7f32441a87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:38.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 0x7f32441a87b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c3a0 tx=0x7f323c00c860 comp rx=0 tx=0).stop 2024-03-20T13:36:38.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 shutdown_connections 2024-03-20T13:36:38.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f32280359c0 0x7f3228037e80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:38.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 --2- 172.21.15.123:0/494101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324410e020 0x7f32441a87b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:38.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.798+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 >> 172.21.15.123:0/494101476 conn(0x7f324406e870 msgr2=0x7f32440710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:38.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.802+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 shutdown_connections 2024-03-20T13:36:38.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:38.802+0000 7f324beb8640 1 -- 172.21.15.123:0/494101476 wait complete. 2024-03-20T13:36:38.841 DEBUG:tasks.rgw:Pools created 2024-03-20T13:36:38.841 INFO:tasks.rgw:Starting rgw... 2024-03-20T13:36:38.841 INFO:tasks.rgw:rgw client.0 config is {} 2024-03-20T13:36:38.841 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-20T13:36:38.842 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-20T13:36:38.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-20T13:36:38.844 INFO:tasks.rgw.client.0:Started 2024-03-20T13:36:38.844 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi123.front.sepia.ceph.com:80/ 2024-03-20T13:36:38.844 DEBUG:teuthology.orchestra.run.smithi123:> curl http://smithi123.front.sepia.ceph.com:80/ 2024-03-20T13:36:38.871 INFO:teuthology.orchestra.run.smithi123.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:36:38.871 INFO:teuthology.orchestra.run.smithi123.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:36:38.873 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:36:38.873 INFO:teuthology.orchestra.run.smithi123.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:36:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:curl: (7) Failed to connect to smithi123.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-03-20T13:36:39.875 DEBUG:teuthology.orchestra.run.smithi123:> curl http://smithi123.front.sepia.ceph.com:80/ 2024-03-20T13:36:39.887 INFO:teuthology.orchestra.run.smithi123.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:36:39.887 INFO:teuthology.orchestra.run.smithi123.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:36:39.887 INFO:teuthology.orchestra.run.smithi123.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:36:39.887 INFO:teuthology.orchestra.run.smithi123.stderr:curl: (7) Failed to connect to smithi123.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-03-20T13:36:39.887 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:36:41.889 DEBUG:teuthology.orchestra.run.smithi123:> curl http://smithi123.front.sepia.ceph.com:80/ 2024-03-20T13:36:41.901 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:36:41.901 INFO:teuthology.orchestra.run.smithi123.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:36:41.901 INFO:teuthology.orchestra.run.smithi123.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:36:41.901 INFO:teuthology.orchestra.run.smithi123.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:36:41.902 INFO:teuthology.orchestra.run.smithi123.stderr:curl: (7) Failed to connect to smithi123.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-03-20T13:36:45.902 DEBUG:teuthology.orchestra.run.smithi123:> curl http://smithi123.front.sepia.ceph.com:80/ 2024-03-20T13:36:45.914 INFO:teuthology.orchestra.run.smithi123.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:36:45.914 INFO:teuthology.orchestra.run.smithi123.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:36:45.914 INFO:teuthology.orchestra.run.smithi123.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:36:45.914 INFO:teuthology.orchestra.run.smithi123.stderr:curl: (7) Failed to connect to smithi123.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-03-20T13:36:45.915 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:36:53.916 DEBUG:teuthology.orchestra.run.smithi123:> curl http://smithi123.front.sepia.ceph.com:80/ 2024-03-20T13:36:53.928 INFO:teuthology.orchestra.run.smithi123.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:36:53.928 INFO:teuthology.orchestra.run.smithi123.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:36:53.932 INFO:teuthology.orchestra.run.smithi123.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 58310 0 --:--:-- --:--:-- --:--:-- 71333 2024-03-20T13:36:53.932 INFO:teuthology.orchestra.run.smithi123.stdout:anonymous 2024-03-20T13:36:53.932 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-03-20T13:36:54.014 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-03-20T13:36:54.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-03-20T13:36:54.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-03-20T13:36:54.014 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-03-20T13:36:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65e20a8980 1 Processor -- start 2024-03-20T13:36:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65e20a8980 1 -- start start 2024-03-20T13:36:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65e20a8980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555b94cc2df0 0x555b94d56f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65e20a8980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555b94c9a510 con 0x555b94cc4130 2024-03-20T13:36:54.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65e20a8980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x555b94c610f0 con 0x555b94cc2df0 2024-03-20T13:36:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65df3c2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555b94cc2df0 0x555b94d56f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65df3c2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555b94cc2df0 0x555b94d56f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52722/0 (socket says 172.21.15.123:52722) 2024-03-20T13:36:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65df3c2640 1 -- 172.21.15.123:0/2981807504 learned_addr learned my addr 172.21.15.123:0/2981807504 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65df3c2640 1 -- 172.21.15.123:0/2981807504 >> v1:172.21.15.89:6789/0 conn(0x555b94cc4130 legacy=0x555b94cc26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.046+0000 7f65df3c2640 1 -- 172.21.15.123:0/2981807504 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94cc3200 con 0x555b94cc2df0 2024-03-20T13:36:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2981807504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94d56f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65d000a5c0 tx=0x7f65d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6609eed6944e58a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65debc1640 1 -- 172.21.15.123:0/2981807504 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d00ac460 con 0x555b94cc2df0 2024-03-20T13:36:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65debc1640 1 -- 172.21.15.123:0/2981807504 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d00ac5c0 con 0x555b94cc2df0 2024-03-20T13:36:54.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65debc1640 1 -- 172.21.15.123:0/2981807504 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d00ac880 con 0x555b94cc2df0 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 -- 172.21.15.123:0/2981807504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 msgr2=0x555b94d56f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2981807504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94d56f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65d000a5c0 tx=0x7f65d001b340 comp rx=0 tx=0).stop 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 -- 172.21.15.123:0/2981807504 shutdown_connections 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2981807504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94d56f40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 -- 172.21.15.123:0/2981807504 >> 172.21.15.123:0/2981807504 conn(0x555b94d49800 msgr2=0x555b94d4bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 -- 172.21.15.123:0/2981807504 shutdown_connections 2024-03-20T13:36:54.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.050+0000 7f65e20a8980 1 -- 172.21.15.123:0/2981807504 wait complete. 2024-03-20T13:36:54.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65e20a8980 1 Processor -- start 2024-03-20T13:36:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65e20a8980 1 -- start start 2024-03-20T13:36:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65e20a8980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e3a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65e20a8980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94c5e620 con 0x555b94cc2df0 2024-03-20T13:36:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65dfbc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e3a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65dfbc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e3a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52730/0 (socket says 172.21.15.123:52730) 2024-03-20T13:36:54.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65dfbc3640 1 -- 172.21.15.123:0/3781861598 learned_addr learned my addr 172.21.15.123:0/3781861598 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65dfbc3640 1 -- 172.21.15.123:0/3781861598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0005df0 con 0x555b94cc2df0 2024-03-20T13:36:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/3781861598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e3a370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006f60 tx=0x7f65c8006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ceb35cad88625a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f64cde0b640 1 -- 172.21.15.123:0/3781861598 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65c800f640 con 0x555b94cc2df0 2024-03-20T13:36:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f64cde0b640 1 -- 172.21.15.123:0/3781861598 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c800f7a0 con 0x555b94cc2df0 2024-03-20T13:36:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.066+0000 7f64cde0b640 1 -- 172.21.15.123:0/3781861598 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65c800fac0 con 0x555b94cc2df0 2024-03-20T13:36:54.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/3781861598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 msgr2=0x555b94e3a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 --2- 172.21.15.123:0/3781861598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e3a370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006f60 tx=0x7f65c8006f90 comp rx=0 tx=0).stop 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/3781861598 shutdown_connections 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 --2- 172.21.15.123:0/3781861598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e3a370 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/3781861598 >> 172.21.15.123:0/3781861598 conn(0x555b94d49800 msgr2=0x555b94e35f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/3781861598 shutdown_connections 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/3781861598 wait complete. 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 Processor -- start 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- start start 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94c59e00 con 0x555b94cc2df0 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65dfbc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65dfbc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52736/0 (socket says 172.21.15.123:52736) 2024-03-20T13:36:54.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2670030762 learned_addr learned my addr 172.21.15.123:0/2670030762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94c9a510 con 0x555b94cc2df0 2024-03-20T13:36:54.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e411c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f65c8001e70 tx=0x7f65c8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f64c7fff640 1 -- 172.21.15.123:0/2670030762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65c8006160 con 0x555b94cc2df0 2024-03-20T13:36:54.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f64c7fff640 1 -- 172.21.15.123:0/2670030762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c80062c0 con 0x555b94cc2df0 2024-03-20T13:36:54.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b94e41700 con 0x555b94cc2df0 2024-03-20T13:36:54.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f64c7fff640 1 -- 172.21.15.123:0/2670030762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65c801e7c0 con 0x555b94cc2df0 2024-03-20T13:36:54.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.070+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b94e41b90 con 0x555b94cc2df0 2024-03-20T13:36:54.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f64c7fff640 1 -- 172.21.15.123:0/2670030762 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65c801e920 con 0x555b94cc2df0 2024-03-20T13:36:54.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f64c7fff640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64c80342b0 0x7f64c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f64c7fff640 1 -- 172.21.15.123:0/2670030762 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f65c8049b30 con 0x555b94cc2df0 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64c80342b0 0x7f64c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94cc4130 0x555b94e47e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e48380 con 0x555b94cc4130 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e03c4640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94cc4130 0x555b94e47e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64c80342b0 0x7f64c8036770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65d00ae000 tx=0x7f65d00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e03c4640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94cc4130 0x555b94e47e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e03c4640 1 -- 172.21.15.123:0/2670030762 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65d80083f0 con 0x555b94cc4130 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e48bf0 0x555b94e4afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e4b6c0 con 0x555b94e48bf0 2024-03-20T13:36:54.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e48bf0 0x555b94e4afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e48bf0 0x555b94e4afe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2670030762 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f65c8018070 con 0x555b94e48bf0 2024-03-20T13:36:54.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e4cf20 con 0x555b94e48bf0 2024-03-20T13:36:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2670030762 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f65c8018070 con 0x555b94e48bf0 2024-03-20T13:36:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.074+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e4c120 con 0x555b94e48bf0 2024-03-20T13:36:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2670030762 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f65c8018070 con 0x555b94e48bf0 2024-03-20T13:36:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e4c530 con 0x555b94cc4130 2024-03-20T13:36:54.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e03c4640 1 -- 172.21.15.123:0/2670030762 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f65d80083f0 con 0x555b94cc4130 2024-03-20T13:36:54.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 Processor -- start 2024-03-20T13:36:54.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 -- start start 2024-03-20T13:36:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 0x555b94e5ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94bf2e30 con 0x555b94e5b600 2024-03-20T13:36:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e03c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 0x555b94e5ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e03c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 0x555b94e5ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52748/0 (socket says 172.21.15.123:52748) 2024-03-20T13:36:54.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e03c4640 1 -- 172.21.15.123:0/1986087613 learned_addr learned my addr 172.21.15.123:0/1986087613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e03c4640 1 -- 172.21.15.123:0/1986087613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94e5bf60 con 0x555b94e5b600 2024-03-20T13:36:54.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e03c4640 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 0x555b94e5ba20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65d800aae0 tx=0x7f65d8008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f64c57fa640 1 -- 172.21.15.123:0/1986087613 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d801d070 con 0x555b94e5b600 2024-03-20T13:36:54.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f64c57fa640 1 -- 172.21.15.123:0/1986087613 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8010040 con 0x555b94e5b600 2024-03-20T13:36:54.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b94e5c1b0 con 0x555b94e5b600 2024-03-20T13:36:54.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f64c57fa640 1 -- 172.21.15.123:0/1986087613 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d8007e70 con 0x555b94e5b600 2024-03-20T13:36:54.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.078+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b94e5cd00 con 0x555b94e5b600 2024-03-20T13:36:54.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f64c57fa640 1 -- 172.21.15.123:0/1986087613 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65d8018430 con 0x555b94e5b600 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f64c57fa640 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64b8034300 0x7f64b80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f64c57fa640 1 -- 172.21.15.123:0/1986087613 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f65d804a6c0 con 0x555b94e5b600 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64b8034300 0x7f64b80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 Processor -- start 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- start start 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64b8034300 0x7f64b80367c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x555b94e4bc20 tx=0x7f65c8047eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94be6790 con 0x555b94e685a0 2024-03-20T13:36:54.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e03c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e03c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52758/0 (socket says 172.21.15.123:52758) 2024-03-20T13:36:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e03c4640 1 -- 172.21.15.123:0/3138791091 learned_addr learned my addr 172.21.15.123:0/3138791091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e03c4640 1 -- 172.21.15.123:0/3138791091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94e68f90 con 0x555b94e685a0 2024-03-20T13:36:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e03c4640 1 --2- 172.21.15.123:0/3138791091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e689c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65d80489f0 tx=0x7f65d8048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed447b4420e3332b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f64beffd640 1 -- 172.21.15.123:0/3138791091 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d8047070 con 0x555b94e685a0 2024-03-20T13:36:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f64beffd640 1 -- 172.21.15.123:0/3138791091 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8022410 con 0x555b94e685a0 2024-03-20T13:36:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f64beffd640 1 -- 172.21.15.123:0/3138791091 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d8016330 con 0x555b94e685a0 2024-03-20T13:36:54.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- 172.21.15.123:0/3138791091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 msgr2=0x555b94e689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 --2- 172.21.15.123:0/3138791091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e689c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65d80489f0 tx=0x7f65d8048f00 comp rx=0 tx=0).stop 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- 172.21.15.123:0/3138791091 shutdown_connections 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 --2- 172.21.15.123:0/3138791091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e689c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- 172.21.15.123:0/3138791091 >> 172.21.15.123:0/3138791091 conn(0x555b94e648e0 msgr2=0x555b94e62940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- 172.21.15.123:0/3138791091 shutdown_connections 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.082+0000 7f65e20a8980 1 -- 172.21.15.123:0/3138791091 wait complete. 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 Processor -- start 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 -- start start 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e6f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b94e6f930 con 0x555b94e685a0 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e03c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e6f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e03c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e6f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52760/0 (socket says 172.21.15.123:52760) 2024-03-20T13:36:54.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 learned_addr learned my addr 172.21.15.123:0/2280416401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b94e5cd00 con 0x555b94e685a0 2024-03-20T13:36:54.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e03c4640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e6f3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f65d8020890 tx=0x7f65d8048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f64bd7fa640 1 -- 172.21.15.123:0/2280416401 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d8021e60 con 0x555b94e685a0 2024-03-20T13:36:54.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b94e6fb30 con 0x555b94e685a0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f64bd7fa640 1 -- 172.21.15.123:0/2280416401 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8022580 con 0x555b94e685a0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f64bd7fa640 1 -- 172.21.15.123:0/2280416401 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65d8018860 con 0x555b94e685a0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b94e6ffc0 con 0x555b94e685a0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f64bd7fa640 1 -- 172.21.15.123:0/2280416401 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65d8018a90 con 0x555b94e685a0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f64bd7fa640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64a80342b0 0x7f64a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f64bd7fa640 1 -- 172.21.15.123:0/2280416401 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f65d8037c60 con 0x555b94e685a0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64a80342b0 0x7f64a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.086+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94e7ab00 0x555b94e7cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e7d710 con 0x555b94e7ab00 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94e7ab00 0x555b94e7cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64a80342b0 0x7f64a8036770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65c8010540 tx=0x7f65c803b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94e7ab00 0x555b94e7cfc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65d00a9070 con 0x555b94e7ab00 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 realm 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e7db00 con 0x555b94e7ab00 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65d00a9070 con 0x555b94e7ab00 2024-03-20T13:36:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e7e350 con 0x555b94e7ab00 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65d00a9070 con 0x555b94e7ab00 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e7ed30 0x555b94e81160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e818d0 con 0x555b94e7ed30 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e03c4640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e7ed30 0x555b94e81160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e03c4640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e7ed30 0x555b94e81160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e82120 con 0x555b94e7ed30 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 20 searching for the correct realm 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555b94e83e40 0x555b94e86230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.090+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555b94e83e40 0x555b94e86230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65dfbc3640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555b94e83e40 0x555b94e86230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65e03c4640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f65d8036020 0x7f65d802c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x7f65d8036020 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f65d8036020 0x7f65d802c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f65d8036020 0x7f65d802c850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00a9070 con 0x7f65d8036020 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.094+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x7f65d8036020 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x7f65d8036020 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x7f65d8036020 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f65d00c9040 con 0x7f65d8036020 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.098+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00c9040 con 0x555b94e7ab00 2024-03-20T13:36:54.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x7f65d8036020 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x7f65d8036020 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x7f65d8036020 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.102+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e83e40 2024-03-20T13:36:54.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e82a50 con 0x555b94e7ab00 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.106+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e82e90 con 0x555b94e7ed30 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e83270 con 0x555b94e7ab00 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 zone default found 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 4 Realm: () 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:54.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 zonegroup default 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e88de0 con 0x555b94e83e40 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e89140 con 0x555b94e83e40 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 started sync module instance, tier type = 2024-03-20T13:36:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e883b0 con 0x555b94e7ed30 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.110+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93851828651872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e883b0 con 0x555b94e7ed30 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e89ab0 con 0x555b94e7ab00 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93851828655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e89a30 con 0x555b94e7ab00 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8a9c0 con 0x555b94e7ed30 2024-03-20T13:36:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93851828651872] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93851828655632] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93851828657760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8a980 con 0x555b94e7ed30 2024-03-20T13:36:54.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.114+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8b210 con 0x7f65d8036020 2024-03-20T13:36:54.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93851828661616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8a980 con 0x7f65d8036020 2024-03-20T13:36:54.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8bd60 con 0x555b94e7ed30 2024-03-20T13:36:54.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93851828657760] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93851828661616] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93851828662672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8bd60 con 0x555b94e7ed30 2024-03-20T13:36:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.118+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c110 con 0x555b94e83e40 2024-03-20T13:36:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93851828659360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c960 con 0x555b94e83e40 2024-03-20T13:36:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8d330 con 0x555b94e83e40 2024-03-20T13:36:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93851828662672] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93851828659360] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93851828667584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8b880 con 0x555b94e83e40 2024-03-20T13:36:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8dcf0 con 0x7f65d8036020 2024-03-20T13:36:54.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93851828667584] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93851828670000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8dcf0 con 0x7f65d8036020 2024-03-20T13:36:54.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=0 2024-03-20T13:36:54.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=1 2024-03-20T13:36:54.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=2 2024-03-20T13:36:54.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=3 2024-03-20T13:36:54.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=4 2024-03-20T13:36:54.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=5 2024-03-20T13:36:54.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.122+0000 7f65e20a8980 20 add_watcher() i=6 2024-03-20T13:36:54.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.126+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93851828670000] v32'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.126+0000 7f65e20a8980 20 add_watcher() i=7 2024-03-20T13:36:54.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.126+0000 7f65e20a8980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:54.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.126+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e91080 con 0x555b94e7ab00 2024-03-20T13:36:54.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.126+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.126+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93851828685408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8de60 con 0x555b94e7ab00 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93851828685408] v32'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f6495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e20a8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e20a8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e20a8980 5 note: GC not initialized 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f6494fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:54.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e20a8980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:54.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e20a8980 20 Filter name: none 2024-03-20T13:36:54.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f640e7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:54.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94eb27b0 con 0x555b94e83e40 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c960 con 0x555b94e7ed30 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ab00 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.130+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ed30 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ed30 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.134+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ed30 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ed30 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.138+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ab00 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e7ed30 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x555b94e83e40 2024-03-20T13:36:54.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e86c00 con 0x7f65d8036020 2024-03-20T13:36:54.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f6495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.142+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93851828685408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c960 con 0x555b94e7ab00 2024-03-20T13:36:54.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.146+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93851828685408] v32'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.146+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93851828651872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e867c0 con 0x555b94e7ed30 2024-03-20T13:36:54.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93851828651872] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 20 remove_watcher() i=0 2024-03-20T13:36:54.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 2 removed watcher, disabling cache 2024-03-20T13:36:54.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93851828655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c940 con 0x555b94e7ab00 2024-03-20T13:36:54.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93851828655632] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x555b94e7ab00 2024-03-20T13:36:54.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 20 remove_watcher() i=1 2024-03-20T13:36:54.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93851828657760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c940 con 0x555b94e7ed30 2024-03-20T13:36:54.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93851828657760] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 20 remove_watcher() i=2 2024-03-20T13:36:54.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.150+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93851828661616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c940 con 0x7f65d8036020 2024-03-20T13:36:54.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93851828661616] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65e20a8980 20 remove_watcher() i=3 2024-03-20T13:36:54.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93851828662672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c940 con 0x555b94e7ed30 2024-03-20T13:36:54.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65e03c4640 1 -- 172.21.15.123:0/2280416401 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93851828662672] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d8033070 con 0x555b94e7ed30 2024-03-20T13:36:54.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65e20a8980 20 remove_watcher() i=4 2024-03-20T13:36:54.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93851828659360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8c940 con 0x555b94e83e40 2024-03-20T13:36:54.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.154+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93851828659360] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 20 remove_watcher() i=5 2024-03-20T13:36:54.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93851828667584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e89610 con 0x555b94e83e40 2024-03-20T13:36:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65dfbc3640 1 -- 172.21.15.123:0/2280416401 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93851828667584] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65c805d040 con 0x555b94e83e40 2024-03-20T13:36:54.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 20 remove_watcher() i=6 2024-03-20T13:36:54.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93851828670000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b94e8a4a0 con 0x7f65d8036020 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93851828670000] v32'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65d00d6060 con 0x7f65d8036020 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 20 remove_watcher() i=7 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e7ed30 msgr2=0x555b94e81160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e7ed30 0x555b94e81160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94e7ab00 msgr2=0x555b94e7cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94e7ab00 0x555b94e7cfc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f65d8036020 msgr2=0x7f65d802c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f65d8036020 0x7f65d802c850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555b94e83e40 msgr2=0x555b94e86230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555b94e83e40 0x555b94e86230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64a80342b0 msgr2=0x7f64a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64a80342b0 0x7f64a8036770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65c8010540 tx=0x7f65c803b000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 msgr2=0x555b94e6f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e6f3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f65d8020890 tx=0x7f65d8048980 comp rx=0 tx=0).stop 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65df3c2640 1 -- 172.21.15.123:0/2280416401 reap_dead start 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 shutdown_connections 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2280416401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e685a0 0x555b94e6f3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 >> 172.21.15.123:0/2280416401 conn(0x555b94e648e0 msgr2=0x555b94e61f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 shutdown_connections 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/2280416401 wait complete. 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64b8034300 msgr2=0x7f64b80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64b8034300 0x7f64b80367c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x555b94e4bc20 tx=0x7f65c8047eb0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 msgr2=0x555b94e5ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 0x555b94e5ba20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65d800aae0 tx=0x7f65d8008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 shutdown_connections 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64b8034300 0x7f64b80367c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 --2- 172.21.15.123:0/1986087613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94e5b600 0x555b94e5ba20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 >> 172.21.15.123:0/1986087613 conn(0x555b94e50410 msgr2=0x555b94e50f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 shutdown_connections 2024-03-20T13:36:54.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.158+0000 7f65e20a8980 1 -- 172.21.15.123:0/1986087613 wait complete. 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e48bf0 msgr2=0x555b94e4afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e48bf0 0x555b94e4afe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94cc4130 msgr2=0x555b94e47e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94cc4130 0x555b94e47e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64c80342b0 msgr2=0x7f64c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64c80342b0 0x7f64c8036770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65d00ae000 tx=0x7f65d00a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 msgr2=0x555b94e411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e411c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f65c8001e70 tx=0x7f65c8001260 comp rx=0 tx=0).stop 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 shutdown_connections 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555b94e48bf0 0x555b94e4afe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555b94cc4130 0x555b94e47e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64c80342b0 0x7f64c8036770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 --2- 172.21.15.123:0/2670030762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555b94cc2df0 0x555b94e411c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 >> 172.21.15.123:0/2670030762 conn(0x555b94d49800 msgr2=0x555b94e34a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 shutdown_connections 2024-03-20T13:36:54.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.162+0000 7f65e20a8980 1 -- 172.21.15.123:0/2670030762 wait complete. 2024-03-20T13:36:54.177 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-03-20T13:36:54.177 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:36:54.177 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-03-20T13:36:54.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-03-20T13:36:54.178 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-03-20T13:36:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f97e4980 1 Processor -- start 2024-03-20T13:36:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f97e4980 1 -- start start 2024-03-20T13:36:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f97e4980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e15aa712d0 0x55e15aa736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f97e4980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e15a9b9520 con 0x55e15a9e10b0 2024-03-20T13:36:54.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f97e4980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e15a9800f0 con 0x55e15aa712d0 2024-03-20T13:36:54.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f6afe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e15aa712d0 0x55e15aa736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f6afe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e15aa712d0 0x55e15aa736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52762/0 (socket says 172.21.15.123:52762) 2024-03-20T13:36:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f6afe640 1 -- 172.21.15.123:0/1714239392 learned_addr learned my addr 172.21.15.123:0/1714239392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f6afe640 1 -- 172.21.15.123:0/1714239392 >> v1:172.21.15.89:6789/0 conn(0x55e15a9e10b0 legacy=0x55e15aa6fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.250+0000 7fb5f6afe640 1 -- 172.21.15.123:0/1714239392 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e15aa74cd0 con 0x55e15aa712d0 2024-03-20T13:36:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/1714239392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15aa712d0 0x55e15aa736c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00a4e0 tx=0x7fb5ec01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b012b54a783c565 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f62fd640 1 -- 172.21.15.123:0/1714239392 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0aa540 con 0x55e15aa712d0 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f62fd640 1 -- 172.21.15.123:0/1714239392 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0a6070 con 0x55e15aa712d0 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f62fd640 1 -- 172.21.15.123:0/1714239392 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5ec0aa850 con 0x55e15aa712d0 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1714239392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15aa712d0 msgr2=0x55e15aa736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/1714239392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15aa712d0 0x55e15aa736c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00a4e0 tx=0x7fb5ec01b090 comp rx=0 tx=0).stop 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1714239392 shutdown_connections 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/1714239392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15aa712d0 0x55e15aa736c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1714239392 >> 172.21.15.123:0/1714239392 conn(0x55e15aa676d0 msgr2=0x55e15aa69af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1714239392 shutdown_connections 2024-03-20T13:36:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.254+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1714239392 wait complete. 2024-03-20T13:36:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f97e4980 1 Processor -- start 2024-03-20T13:36:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f97e4980 1 -- start start 2024-03-20T13:36:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f97e4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab56ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f97e4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e15a97d620 con 0x55e15a9e10b0 2024-03-20T13:36:54.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f72ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab56ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f72ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab56ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52774/0 (socket says 172.21.15.123:52774) 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f72ff640 1 -- 172.21.15.123:0/3817147963 learned_addr learned my addr 172.21.15.123:0/3817147963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f72ff640 1 -- 172.21.15.123:0/3817147963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec00a1c0 con 0x55e15a9e10b0 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/3817147963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab56ea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8001d10 tx=0x7fb5e800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc131abf646d3ac server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb4e560a640 1 -- 172.21.15.123:0/3817147963 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8014070 con 0x55e15a9e10b0 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb4e560a640 1 -- 172.21.15.123:0/3817147963 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800f560 con 0x55e15a9e10b0 2024-03-20T13:36:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.270+0000 7fb4e560a640 1 -- 172.21.15.123:0/3817147963 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e800f840 con 0x55e15a9e10b0 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/3817147963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 msgr2=0x55e15ab56ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/3817147963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab56ea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8001d10 tx=0x7fb5e800b5c0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/3817147963 shutdown_connections 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/3817147963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab56ea0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/3817147963 >> 172.21.15.123:0/3817147963 conn(0x55e15aa676d0 msgr2=0x55e15ab52a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/3817147963 shutdown_connections 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/3817147963 wait complete. 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 Processor -- start 2024-03-20T13:36:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- start start 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab5dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e15a978e00 con 0x55e15a9e10b0 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f72ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab5dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f72ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab5dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52790/0 (socket says 172.21.15.123:52790) 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f72ff640 1 -- 172.21.15.123:0/342507585 learned_addr learned my addr 172.21.15.123:0/342507585 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f72ff640 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e15a9b9520 con 0x55e15a9e10b0 2024-03-20T13:36:54.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab5dd50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55e15ab57d30 tx=0x7fb5e8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb4e3e07640 1 -- 172.21.15.123:0/342507585 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8014050 con 0x55e15a9e10b0 2024-03-20T13:36:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e15ab5e290 con 0x55e15a9e10b0 2024-03-20T13:36:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb4e3e07640 1 -- 172.21.15.123:0/342507585 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8001520 con 0x55e15a9e10b0 2024-03-20T13:36:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e15ab5e720 con 0x55e15a9e10b0 2024-03-20T13:36:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb4e3e07640 1 -- 172.21.15.123:0/342507585 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e801bab0 con 0x55e15a9e10b0 2024-03-20T13:36:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb4e3e07640 1 -- 172.21.15.123:0/342507585 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb5e8022020 con 0x55e15a9e10b0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb4e3e07640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4dc0342b0 0x7fb4dc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.274+0000 7fb4e3e07640 1 -- 172.21.15.123:0/342507585 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb5e8049100 con 0x55e15a9e10b0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4dc0342b0 0x7fb4dc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15aa712d0 0x55e15ab64980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15ab64ec0 con 0x55e15aa712d0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15aa712d0 0x55e15ab64980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4dc0342b0 0x7fb4dc036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0ab000 tx=0x7fb5ec0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15aa712d0 0x55e15ab64980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f7b00640 1 -- 172.21.15.123:0/342507585 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5f00083f0 con 0x55e15aa712d0 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15ab65730 0x55e15ab67b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15ab68240 con 0x55e15ab65730 2024-03-20T13:36:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15ab65730 0x55e15ab67b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15ab65730 0x55e15ab67b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f72ff640 1 -- 172.21.15.123:0/342507585 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5e8016070 con 0x55e15ab65730 2024-03-20T13:36:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15ab69aa0 con 0x55e15ab65730 2024-03-20T13:36:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f72ff640 1 -- 172.21.15.123:0/342507585 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb5e8016070 con 0x55e15ab65730 2024-03-20T13:36:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.278+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15ab68be0 con 0x55e15ab65730 2024-03-20T13:36:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f72ff640 1 -- 172.21.15.123:0/342507585 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5e8016070 con 0x55e15ab65730 2024-03-20T13:36:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15ab68ff0 con 0x55e15aa712d0 2024-03-20T13:36:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f7b00640 1 -- 172.21.15.123:0/342507585 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb5f00083f0 con 0x55e15aa712d0 2024-03-20T13:36:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 Processor -- start 2024-03-20T13:36:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 -- start start 2024-03-20T13:36:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 0x55e15ab7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e15a911e30 con 0x55e15ab7e7e0 2024-03-20T13:36:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f7b00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 0x55e15ab7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f7b00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 0x55e15ab7ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52800/0 (socket says 172.21.15.123:52800) 2024-03-20T13:36:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f7b00640 1 -- 172.21.15.123:0/1158982372 learned_addr learned my addr 172.21.15.123:0/1158982372 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f7b00640 1 -- 172.21.15.123:0/1158982372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e15ab7f140 con 0x55e15ab7e7e0 2024-03-20T13:36:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 0x55e15ab7ec00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000aae0 tx=0x7fb5f0008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb4e1602640 1 -- 172.21.15.123:0/1158982372 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5f001d070 con 0x55e15ab7e7e0 2024-03-20T13:36:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e15ab7f390 con 0x55e15ab7e7e0 2024-03-20T13:36:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb4e1602640 1 -- 172.21.15.123:0/1158982372 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0010040 con 0x55e15ab7e7e0 2024-03-20T13:36:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb4e1602640 1 -- 172.21.15.123:0/1158982372 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0007e70 con 0x55e15ab7e7e0 2024-03-20T13:36:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.282+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e15ab7fee0 con 0x55e15ab7e7e0 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb4e1602640 1 -- 172.21.15.123:0/1158982372 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb5f0018430 con 0x55e15ab7e7e0 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb4e1602640 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4d00342b0 0x7fb4d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb4e1602640 1 -- 172.21.15.123:0/1158982372 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb5f004a6c0 con 0x55e15ab7e7e0 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4d00342b0 0x7fb4d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 Processor -- start 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- start start 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4d00342b0 0x7fb4d0036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55e15ab686e0 tx=0x7fb5e801bc10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab8bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e15a905790 con 0x55e15ab8b730 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f7b00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab8bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f7b00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab8bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52816/0 (socket says 172.21.15.123:52816) 2024-03-20T13:36:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f7b00640 1 -- 172.21.15.123:0/123202501 learned_addr learned my addr 172.21.15.123:0/123202501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f7b00640 1 -- 172.21.15.123:0/123202501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e15ab8c120 con 0x55e15ab8b730 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/123202501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab8bb50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00489f0 tx=0x7fb5f0020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beff9c95830694d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb4daffd640 1 -- 172.21.15.123:0/123202501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0047070 con 0x55e15ab8b730 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb4daffd640 1 -- 172.21.15.123:0/123202501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0021790 con 0x55e15ab8b730 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb4daffd640 1 -- 172.21.15.123:0/123202501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0022560 con 0x55e15ab8b730 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- 172.21.15.123:0/123202501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 msgr2=0x55e15ab8bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/123202501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab8bb50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00489f0 tx=0x7fb5f0020f00 comp rx=0 tx=0).stop 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- 172.21.15.123:0/123202501 shutdown_connections 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/123202501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab8bb50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- 172.21.15.123:0/123202501 >> 172.21.15.123:0/123202501 conn(0x55e15ab87ac0 msgr2=0x55e15ab85b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- 172.21.15.123:0/123202501 shutdown_connections 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- 172.21.15.123:0/123202501 wait complete. 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 Processor -- start 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- start start 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab92540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.286+0000 7fb5f97e4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e15ab92a80 con 0x55e15ab8b730 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f7b00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab92540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f7b00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab92540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52830/0 (socket says 172.21.15.123:52830) 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 learned_addr learned my addr 172.21.15.123:0/2044679873 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e15ab7fee0 con 0x55e15ab8b730 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab92540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0047870 tx=0x7fb5f0048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb4d97fa640 1 -- 172.21.15.123:0/2044679873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0018940 con 0x55e15ab8b730 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e15ab92c80 con 0x55e15ab8b730 2024-03-20T13:36:54.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb4d97fa640 1 -- 172.21.15.123:0/2044679873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0018aa0 con 0x55e15ab8b730 2024-03-20T13:36:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb4d97fa640 1 -- 172.21.15.123:0/2044679873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0018c10 con 0x55e15ab8b730 2024-03-20T13:36:54.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e15ab93110 con 0x55e15ab8b730 2024-03-20T13:36:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb4d97fa640 1 -- 172.21.15.123:0/2044679873 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb5f004a9a0 con 0x55e15ab8b730 2024-03-20T13:36:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb4d97fa640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4c00342b0 0x7fb4c0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb4d97fa640 1 -- 172.21.15.123:0/2044679873 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb5f004b4c0 con 0x55e15ab8b730 2024-03-20T13:36:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4c00342b0 0x7fb4c0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15ab9dc90 0x55e15aba0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba08a0 con 0x55e15ab9dc90 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15ab9dc90 0x55e15aba0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4c00342b0 0x7fb4c0036770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80016b0 tx=0x7fb5e8037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.290+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15ab9dc90 0x55e15aba0150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5ec0aa960 con 0x55e15ab9dc90 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 realm 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba0c90 con 0x55e15ab9dc90 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5ec0aa960 con 0x55e15ab9dc90 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba1510 con 0x55e15ab9dc90 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5ec0aa960 con 0x55e15ab9dc90 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15aba1ef0 0x55e15aba4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba4a90 con 0x55e15aba1ef0 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15aba1ef0 0x55e15aba4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15aba1ef0 0x55e15aba4320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba5290 con 0x55e15aba1ef0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 20 searching for the correct realm 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e15aba72e0 0x55e15aba97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.294+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e15aba72e0 0x55e15aba97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f72ff640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e15aba72e0 0x55e15aba97a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f7b00640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb5f0035070 0x7fb5f003a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x7fb5f0035070 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb5f0035070 0x7fb5f003a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb5f0035070 0x7fb5f003a1f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0aa960 con 0x7fb5f0035070 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.298+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x7fb5f0035070 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x7fb5f0035070 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x7fb5f0035070 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb5ec0c9040 con 0x7fb5f0035070 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.302+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0c9040 con 0x55e15ab9dc90 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x7fb5f0035070 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15ab9dc90 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x7fb5f0035070 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x7fb5f0035070 2024-03-20T13:36:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.306+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba72e0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba9e70 con 0x55e15aba1ef0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:54.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba6870 con 0x55e15ab9dc90 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.310+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba57d0 con 0x55e15aba1ef0 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15aba60c0 con 0x55e15ab9dc90 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 zone default found 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 4 Realm: () 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 zonegroup default 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abaa750 con 0x7fb5f0035070 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abac520 con 0x55e15aba72e0 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abac9b0 con 0x55e15aba72e0 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 started sync module instance, tier type = 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:54.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.314+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15ababd70 con 0x55e15aba1ef0 2024-03-20T13:36:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94426378189008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abac120 con 0x55e15aba1ef0 2024-03-20T13:36:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abad710 con 0x55e15ab9dc90 2024-03-20T13:36:54.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94426378195568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abac120 con 0x55e15ab9dc90 2024-03-20T13:36:54.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abae5b0 con 0x55e15aba1ef0 2024-03-20T13:36:54.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94426378189008] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.318+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94426378195568] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94426378197616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abae570 con 0x55e15aba1ef0 2024-03-20T13:36:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abaee30 con 0x7fb5f0035070 2024-03-20T13:36:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94426378201488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abae570 con 0x7fb5f0035070 2024-03-20T13:36:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abaf8e0 con 0x55e15aba1ef0 2024-03-20T13:36:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94426378197616] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94426378201488] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94426378202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abaf8a0 con 0x55e15aba1ef0 2024-03-20T13:36:54.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.322+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abafc90 con 0x55e15aba72e0 2024-03-20T13:36:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94426378199216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb0130 con 0x55e15aba72e0 2024-03-20T13:36:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb0b50 con 0x55e15aba72e0 2024-03-20T13:36:54.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94426378202544] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94426378208816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb0b10 con 0x55e15aba72e0 2024-03-20T13:36:54.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.326+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb1510 con 0x7fb5f0035070 2024-03-20T13:36:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.330+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94426378199216] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94426378206352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb1510 con 0x7fb5f0035070 2024-03-20T13:36:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94426378208816] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=0 2024-03-20T13:36:54.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=1 2024-03-20T13:36:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=2 2024-03-20T13:36:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=3 2024-03-20T13:36:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=4 2024-03-20T13:36:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=5 2024-03-20T13:36:54.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=6 2024-03-20T13:36:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94426378206352] v32'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 20 add_watcher() i=7 2024-03-20T13:36:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.334+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb1510 con 0x55e15ab9dc90 2024-03-20T13:36:54.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94426378211440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abb14c0 con 0x55e15ab9dc90 2024-03-20T13:36:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94426378211440] v32'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb4adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb5f97e4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb5f97e4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:54.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.338+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbcb90 con 0x55e15aba1ef0 2024-03-20T13:36:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.342+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.342+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbcfd0 con 0x7fb5f0035070 2024-03-20T13:36:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.342+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.342+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbcfd0 con 0x55e15aba72e0 2024-03-20T13:36:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.346+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.346+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbd500 con 0x55e15ab9dc90 2024-03-20T13:36:54.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.346+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.346+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbda30 con 0x55e15aba1ef0 2024-03-20T13:36:54.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.350+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.350+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbdf60 con 0x55e15aba72e0 2024-03-20T13:36:54.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.350+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.350+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbe490 con 0x55e15aba1ef0 2024-03-20T13:36:54.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.354+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.354+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbe9c0 con 0x55e15ab9dc90 2024-03-20T13:36:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.354+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.354+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbeef0 con 0x55e15aba1ef0 2024-03-20T13:36:54.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.358+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.358+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbeef0 con 0x55e15aba1ef0 2024-03-20T13:36:54.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.362+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.362+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbeef0 con 0x55e15aba1ef0 2024-03-20T13:36:54.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.362+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.362+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbeef0 con 0x55e15aba72e0 2024-03-20T13:36:54.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.366+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.366+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf390 con 0x55e15aba1ef0 2024-03-20T13:36:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.366+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.370+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf390 con 0x55e15ab9dc90 2024-03-20T13:36:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.370+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.370+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf420 con 0x55e15ab9dc90 2024-03-20T13:36:54.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.370+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.370+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf420 con 0x55e15aba1ef0 2024-03-20T13:36:54.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.374+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.374+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf970 con 0x55e15aba1ef0 2024-03-20T13:36:54.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.378+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.378+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15aba72e0 2024-03-20T13:36:54.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.378+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.378+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15aba1ef0 2024-03-20T13:36:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.382+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.382+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15ab9dc90 2024-03-20T13:36:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.382+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.382+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15aba1ef0 2024-03-20T13:36:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.386+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.386+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15aba1ef0 2024-03-20T13:36:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.386+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.386+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf950 con 0x55e15aba72e0 2024-03-20T13:36:54.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.390+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.390+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf730 con 0x55e15aba1ef0 2024-03-20T13:36:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.390+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.390+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf730 con 0x55e15aba72e0 2024-03-20T13:36:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.394+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.394+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf730 con 0x55e15aba72e0 2024-03-20T13:36:54.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.398+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.398+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf730 con 0x55e15aba72e0 2024-03-20T13:36:54.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.398+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.398+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15aba1ef0 2024-03-20T13:36:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.402+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.402+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15ab9dc90 2024-03-20T13:36:54.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.406+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.406+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15aba1ef0 2024-03-20T13:36:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.406+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.410+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x55e15ab9dc90 2024-03-20T13:36:54.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.410+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.410+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbf560 con 0x7fb5f0035070 2024-03-20T13:36:54.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb4acfe1640 20 reqs_thread_entry: start 2024-03-20T13:36:54.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:54.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 20 Filter name: none 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb4267fc640 20 reqs_thread_entry: start 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacf0 con 0x7fb5f0035070 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:54.421 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:36:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb4adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.414+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94426378211440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15ab9dc90 2024-03-20T13:36:54.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.418+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94426378211440] v32'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.418+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94426378189008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15aba1ef0 2024-03-20T13:36:54.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94426378189008] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 20 remove_watcher() i=0 2024-03-20T13:36:54.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 2 removed watcher, disabling cache 2024-03-20T13:36:54.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94426378195568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15ab9dc90 2024-03-20T13:36:54.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94426378195568] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x55e15ab9dc90 2024-03-20T13:36:54.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 20 remove_watcher() i=1 2024-03-20T13:36:54.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94426378197616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15aba1ef0 2024-03-20T13:36:54.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94426378197616] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 20 remove_watcher() i=2 2024-03-20T13:36:54.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.422+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94426378201488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x7fb5f0035070 2024-03-20T13:36:54.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.426+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94426378201488] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.426+0000 7fb5f97e4980 20 remove_watcher() i=3 2024-03-20T13:36:54.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.426+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94426378202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15aba1ef0 2024-03-20T13:36:54.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f7b00640 1 -- 172.21.15.123:0/2044679873 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94426378202544] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5f0041040 con 0x55e15aba1ef0 2024-03-20T13:36:54.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f97e4980 20 remove_watcher() i=4 2024-03-20T13:36:54.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94426378199216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15aba72e0 2024-03-20T13:36:54.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94426378199216] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f97e4980 20 remove_watcher() i=5 2024-03-20T13:36:54.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94426378208816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x55e15aba72e0 2024-03-20T13:36:54.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f72ff640 1 -- 172.21.15.123:0/2044679873 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94426378208816] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e8037070 con 0x55e15aba72e0 2024-03-20T13:36:54.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f97e4980 20 remove_watcher() i=6 2024-03-20T13:36:54.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.430+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94426378206352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e15abbacb0 con 0x7fb5f0035070 2024-03-20T13:36:54.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94426378206352] v32'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5ec0d6060 con 0x7fb5f0035070 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 20 remove_watcher() i=7 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15aba1ef0 msgr2=0x55e15aba4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15aba1ef0 0x55e15aba4320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15ab9dc90 msgr2=0x55e15aba0150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15ab9dc90 0x55e15aba0150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb5f0035070 msgr2=0x7fb5f003a1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb5f0035070 0x7fb5f003a1f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e15aba72e0 msgr2=0x55e15aba97a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e15aba72e0 0x55e15aba97a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4c00342b0 msgr2=0x7fb4c0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4c00342b0 0x7fb4c0036770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80016b0 tx=0x7fb5e8037000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f6afe640 1 -- 172.21.15.123:0/2044679873 reap_dead start 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 msgr2=0x55e15ab92540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab92540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0047870 tx=0x7fb5f0048980 comp rx=0 tx=0).stop 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 shutdown_connections 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/2044679873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab8b730 0x55e15ab92540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 >> 172.21.15.123:0/2044679873 conn(0x55e15ab87ac0 msgr2=0x55e15ab85120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 shutdown_connections 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/2044679873 wait complete. 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4d00342b0 msgr2=0x7fb4d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4d00342b0 0x7fb4d0036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55e15ab686e0 tx=0x7fb5e801bc10 comp rx=0 tx=0).stop 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 msgr2=0x55e15ab7ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 0x55e15ab7ec00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000aae0 tx=0x7fb5f0008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 shutdown_connections 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4d00342b0 0x7fb4d0036770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/1158982372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15ab7e7e0 0x55e15ab7ec00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 >> 172.21.15.123:0/1158982372 conn(0x55e15aa6bf30 msgr2=0x55e15aa6c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 shutdown_connections 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/1158982372 wait complete. 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15ab65730 msgr2=0x55e15ab67b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15ab65730 0x55e15ab67b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15aa712d0 msgr2=0x55e15ab64980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15aa712d0 0x55e15ab64980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4dc0342b0 msgr2=0x7fb4dc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4dc0342b0 0x7fb4dc036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0ab000 tx=0x7fb5ec0a5000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 msgr2=0x55e15ab5dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab5dd50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55e15ab57d30 tx=0x7fb5e8000bd0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 shutdown_connections 2024-03-20T13:36:54.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e15ab65730 0x55e15ab67b20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e15aa712d0 0x55e15ab64980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb4dc0342b0 0x7fb4dc036770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 --2- 172.21.15.123:0/342507585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e15a9e10b0 0x55e15ab5dd50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 >> 172.21.15.123:0/342507585 conn(0x55e15aa676d0 msgr2=0x55e15ab51540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 shutdown_connections 2024-03-20T13:36:54.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.434+0000 7fb5f97e4980 1 -- 172.21.15.123:0/342507585 wait complete. 2024-03-20T13:36:54.453 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:36:54.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-03-20T13:36:54.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-03-20T13:36:54.454 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-03-20T13:36:54.533 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:54.533 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:54.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.526+0000 7f4b83048980 1 Processor -- start 2024-03-20T13:36:54.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b83048980 1 -- start start 2024-03-20T13:36:54.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b83048980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5609bfd8d8f0 0x5609bfe1dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b83048980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5609bfd65520 con 0x5609bfe1e530 2024-03-20T13:36:54.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b83048980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5609bfd2c0f0 con 0x5609bfd8d8f0 2024-03-20T13:36:54.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80b63640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5609bfd8d8f0 0x5609bfe1dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80b63640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5609bfd8d8f0 0x5609bfe1dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52834/0 (socket says 172.21.15.123:52834) 2024-03-20T13:36:54.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80362640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5609bfe1e530 0x5609bfe20920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58868/0 (socket says 172.21.15.123:58868) 2024-03-20T13:36:54.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80b63640 1 -- 172.21.15.123:0/3843301894 learned_addr learned my addr 172.21.15.123:0/3843301894 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80b63640 1 -- 172.21.15.123:0/3843301894 >> v1:172.21.15.89:6789/0 conn(0x5609bfe1e530 legacy=0x5609bfe20920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80b63640 1 -- 172.21.15.123:0/3843301894 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609bfe23050 con 0x5609bfd8d8f0 2024-03-20T13:36:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.530+0000 7f4b80b63640 1 --2- 172.21.15.123:0/3843301894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bfe1dff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800a4e0 tx=0x7f4b7801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a7c24978ea20b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b7fb61640 1 -- 172.21.15.123:0/3843301894 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b780aa540 con 0x5609bfd8d8f0 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b7fb61640 1 -- 172.21.15.123:0/3843301894 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780a6070 con 0x5609bfd8d8f0 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b7fb61640 1 -- 172.21.15.123:0/3843301894 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b780aa850 con 0x5609bfd8d8f0 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 -- 172.21.15.123:0/3843301894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 msgr2=0x5609bfe1dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 --2- 172.21.15.123:0/3843301894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bfe1dff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800a4e0 tx=0x7f4b7801b090 comp rx=0 tx=0).stop 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 -- 172.21.15.123:0/3843301894 shutdown_connections 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 --2- 172.21.15.123:0/3843301894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bfe1dff0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 -- 172.21.15.123:0/3843301894 >> 172.21.15.123:0/3843301894 conn(0x5609bfe13710 msgr2=0x5609bfe15b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 -- 172.21.15.123:0/3843301894 shutdown_connections 2024-03-20T13:36:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.534+0000 7f4b83048980 1 -- 172.21.15.123:0/3843301894 wait complete. 2024-03-20T13:36:54.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 Processor -- start 2024-03-20T13:36:54.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- start start 2024-03-20T13:36:54.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff05040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609bfd29620 con 0x5609bfd8d8f0 2024-03-20T13:36:54.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b80b63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff05040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b80b63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff05040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52846/0 (socket says 172.21.15.123:52846) 2024-03-20T13:36:54.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b80b63640 1 -- 172.21.15.123:0/1330181836 learned_addr learned my addr 172.21.15.123:0/1330181836 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b80b63640 1 -- 172.21.15.123:0/1330181836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7800a1c0 con 0x5609bfd8d8f0 2024-03-20T13:36:54.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b80b63640 1 --2- 172.21.15.123:0/1330181836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff05040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b78017ca0 tx=0x7f4b780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a4d24f214489f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4a6ee0d640 1 -- 172.21.15.123:0/1330181836 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b780aa780 con 0x5609bfd8d8f0 2024-03-20T13:36:54.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4a6ee0d640 1 -- 172.21.15.123:0/1330181836 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780aa8e0 con 0x5609bfd8d8f0 2024-03-20T13:36:54.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4a6ee0d640 1 -- 172.21.15.123:0/1330181836 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b780aab80 con 0x5609bfd8d8f0 2024-03-20T13:36:54.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- 172.21.15.123:0/1330181836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 msgr2=0x5609bff05040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 --2- 172.21.15.123:0/1330181836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff05040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b78017ca0 tx=0x7f4b780033b0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- 172.21.15.123:0/1330181836 shutdown_connections 2024-03-20T13:36:54.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 --2- 172.21.15.123:0/1330181836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff05040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- 172.21.15.123:0/1330181836 >> 172.21.15.123:0/1330181836 conn(0x5609bfe13710 msgr2=0x5609bff00bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- 172.21.15.123:0/1330181836 shutdown_connections 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- 172.21.15.123:0/1330181836 wait complete. 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 Processor -- start 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.550+0000 7f4b83048980 1 -- start start 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b83048980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff0bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b83048980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609bfd24e00 con 0x5609bfd8d8f0 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80b63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff0bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80b63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff0bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52860/0 (socket says 172.21.15.123:52860) 2024-03-20T13:36:54.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80b63640 1 -- 172.21.15.123:0/2915705039 learned_addr learned my addr 172.21.15.123:0/2915705039 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80b63640 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609bfe23050 con 0x5609bfd8d8f0 2024-03-20T13:36:54.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80b63640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff0bd90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b7801aec0 tx=0x7f4b78017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4a6d60a640 1 -- 172.21.15.123:0/2915705039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b780c4070 con 0x5609bfd8d8f0 2024-03-20T13:36:54.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609bff0c2d0 con 0x5609bfd8d8f0 2024-03-20T13:36:54.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4a6d60a640 1 -- 172.21.15.123:0/2915705039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78005150 con 0x5609bfd8d8f0 2024-03-20T13:36:54.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4a6d60a640 1 -- 172.21.15.123:0/2915705039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b780053f0 con 0x5609bfd8d8f0 2024-03-20T13:36:54.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609bff0c700 con 0x5609bfd8d8f0 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4a6d60a640 1 -- 172.21.15.123:0/2915705039 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b780a8070 con 0x5609bfd8d8f0 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4a6d60a640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a680342b0 0x7f4a68036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4a6d60a640 1 -- 172.21.15.123:0/2915705039 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4b780e32d0 con 0x5609bfd8d8f0 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80362640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a680342b0 0x7f4a68036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bfe1e530 0x5609bff129c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff12f00 con 0x5609bfe1e530 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b81364640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bfe1e530 0x5609bff129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b80362640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a680342b0 0x7f4a68036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b74001e50 tx=0x7f4b740013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.554+0000 7f4b81364640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bfe1e530 0x5609bff129c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b81364640 1 -- 172.21.15.123:0/2915705039 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b700083f0 con 0x5609bfe1e530 2024-03-20T13:36:54.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff13770 0x5609bff15b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff16220 con 0x5609bff13770 2024-03-20T13:36:54.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b80b63640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff13770 0x5609bff15b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b80b63640 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff13770 0x5609bff15b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b80b63640 1 -- 172.21.15.123:0/2915705039 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff13770 2024-03-20T13:36:54.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff17a60 con 0x5609bff13770 2024-03-20T13:36:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b80b63640 1 -- 172.21.15.123:0/2915705039 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff13770 2024-03-20T13:36:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff16c60 con 0x5609bff13770 2024-03-20T13:36:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b80b63640 1 -- 172.21.15.123:0/2915705039 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff13770 2024-03-20T13:36:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff17070 con 0x5609bfe1e530 2024-03-20T13:36:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.558+0000 7f4b81364640 1 -- 172.21.15.123:0/2915705039 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4b700083f0 con 0x5609bfe1e530 2024-03-20T13:36:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 Processor -- start 2024-03-20T13:36:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 -- start start 2024-03-20T13:36:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 0x5609bff265c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609bfcbde30 con 0x5609bff261a0 2024-03-20T13:36:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b81364640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 0x5609bff265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b81364640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 0x5609bff265c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52868/0 (socket says 172.21.15.123:52868) 2024-03-20T13:36:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b81364640 1 -- 172.21.15.123:0/182959364 learned_addr learned my addr 172.21.15.123:0/182959364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b81364640 1 -- 172.21.15.123:0/182959364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609bff26b00 con 0x5609bff261a0 2024-03-20T13:36:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b81364640 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 0x5609bff265c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5609bff0ca30 tx=0x7f4b7000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4a667fc640 1 -- 172.21.15.123:0/182959364 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7001d070 con 0x5609bff261a0 2024-03-20T13:36:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609bff26d50 con 0x5609bff261a0 2024-03-20T13:36:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4a667fc640 1 -- 172.21.15.123:0/182959364 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70010040 con 0x5609bff261a0 2024-03-20T13:36:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4a667fc640 1 -- 172.21.15.123:0/182959364 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b70007e20 con 0x5609bff261a0 2024-03-20T13:36:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609bff278a0 con 0x5609bff261a0 2024-03-20T13:36:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4a667fc640 1 -- 172.21.15.123:0/182959364 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b70018430 con 0x5609bff261a0 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4a667fc640 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a580342b0 0x7f4a58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4a667fc640 1 -- 172.21.15.123:0/182959364 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4b7004a630 con 0x5609bff261a0 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b80b63640 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a580342b0 0x7f4a58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.562+0000 7f4b83048980 1 Processor -- start 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- start start 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b80b63640 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a580342b0 0x7f4a58036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5609bff16760 tx=0x7f4b780e3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff33550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609bfcb1790 con 0x5609bff33130 2024-03-20T13:36:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff33550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff33550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52882/0 (socket says 172.21.15.123:52882) 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 -- 172.21.15.123:0/3495599033 learned_addr learned my addr 172.21.15.123:0/3495599033 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 -- 172.21.15.123:0/3495599033 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609bff33b20 con 0x5609bff33130 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 --2- 172.21.15.123:0/3495599033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff33550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b70048960 tx=0x7f4b70020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88219e880dd9c27e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4a57fff640 1 -- 172.21.15.123:0/3495599033 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b70047070 con 0x5609bff33130 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4a57fff640 1 -- 172.21.15.123:0/3495599033 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70021530 con 0x5609bff33130 2024-03-20T13:36:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4a57fff640 1 -- 172.21.15.123:0/3495599033 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b70022410 con 0x5609bff33130 2024-03-20T13:36:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- 172.21.15.123:0/3495599033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 msgr2=0x5609bff33550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 --2- 172.21.15.123:0/3495599033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff33550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b70048960 tx=0x7f4b70020f00 comp rx=0 tx=0).stop 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- 172.21.15.123:0/3495599033 shutdown_connections 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 --2- 172.21.15.123:0/3495599033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff33550 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- 172.21.15.123:0/3495599033 >> 172.21.15.123:0/3495599033 conn(0x5609bff2f4c0 msgr2=0x5609bff2d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- 172.21.15.123:0/3495599033 shutdown_connections 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- 172.21.15.123:0/3495599033 wait complete. 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 Processor -- start 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- start start 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff39f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b83048980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609bff3a4b0 con 0x5609bff33130 2024-03-20T13:36:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff39f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff39f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52896/0 (socket says 172.21.15.123:52896) 2024-03-20T13:36:54.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 learned_addr learned my addr 172.21.15.123:0/607637041 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.566+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609bff278a0 con 0x5609bff33130 2024-03-20T13:36:54.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b81364640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff39f70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b70020890 tx=0x7f4b700488f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4a567fc640 1 -- 172.21.15.123:0/607637041 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b70032030 con 0x5609bff33130 2024-03-20T13:36:54.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609bff3a6b0 con 0x5609bff33130 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4a567fc640 1 -- 172.21.15.123:0/607637041 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b700186e0 con 0x5609bff33130 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609bff3aae0 con 0x5609bff33130 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4a567fc640 1 -- 172.21.15.123:0/607637041 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b700189c0 con 0x5609bff33130 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4a567fc640 1 -- 172.21.15.123:0/607637041 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b70035070 con 0x5609bff33130 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4a567fc640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a4c0342b0 0x7f4a4c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4a567fc640 1 -- 172.21.15.123:0/607637041 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4b70033070 con 0x5609bff33130 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80b63640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a4c0342b0 0x7f4a4c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bff45700 0x5609bff47bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff48310 con 0x5609bff45700 2024-03-20T13:36:54.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80362640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bff45700 0x5609bff47bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80b63640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a4c0342b0 0x7f4a4c036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b78004920 tx=0x7f4b780dd000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80362640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bff45700 0x5609bff47bc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 realm 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff44b60 con 0x5609bff45700 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff48d50 con 0x5609bff45700 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff49ae0 0x5609bff4bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.570+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff4c550 con 0x5609bff49ae0 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff49ae0 0x5609bff4bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff49ae0 0x5609bff4bed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff4cd50 con 0x5609bff49ae0 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:54.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 20 searching for the correct realm 2024-03-20T13:36:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609bff4edb0 0x5609bff51270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff4edb0 2024-03-20T13:36:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b80b63640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609bff4edb0 0x5609bff51270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b80b63640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609bff4edb0 0x5609bff51270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff49ae0 2024-03-20T13:36:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b70017710 0x7f4b700166c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.574+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x7f4b70017710 2024-03-20T13:36:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b70017710 0x7f4b700166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b70017710 0x7f4b700166c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff4edb0 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff49ae0 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff49ae0 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x7f4b70017710 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.578+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff51940 con 0x5609bff45700 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b7402d080 con 0x7f4b70017710 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b7402d080 con 0x5609bff49ae0 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b7402d080 con 0x5609bff4edb0 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b7402d080 con 0x5609bff45700 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b7402d080 con 0x5609bff49ae0 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff4edb0 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff45700 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff45700 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff45700 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.582+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff4edb0 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x7f4b70017710 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff45700 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x7f4b70017710 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff4edb0 2024-03-20T13:36:54.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x7f4b70017710 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff4edb0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.586+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4b70064040 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff4e340 con 0x5609bff45700 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff4d290 con 0x5609bff49ae0 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff4d260 con 0x5609bff45700 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 zone default found 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 4 Realm: () 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 zonegroup default 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff4ddb0 con 0x7f4b70017710 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff53d80 con 0x5609bff4edb0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff541e0 con 0x5609bff4edb0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 started sync module instance, tier type = 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:54.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.590+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff539b0 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.594+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7001f070 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.594+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599875210240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff54600 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.594+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff54e00 con 0x5609bff45700 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.594+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.594+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599875216896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff55600 con 0x5609bff45700 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.594+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff55f70 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599875210240] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599875216896] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599875219808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff55580 con 0x5609bff49ae0 2024-03-20T13:36:54.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff56410 con 0x7f4b70017710 2024-03-20T13:36:54.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599875223408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff56830 con 0x7f4b70017710 2024-03-20T13:36:54.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.598+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff571e0 con 0x5609bff49ae0 2024-03-20T13:36:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599875219808] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599875223408] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599875222224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff56390 con 0x5609bff49ae0 2024-03-20T13:36:54.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff57a30 con 0x5609bff4edb0 2024-03-20T13:36:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599875229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff56390 con 0x5609bff4edb0 2024-03-20T13:36:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff58460 con 0x5609bff4edb0 2024-03-20T13:36:54.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.602+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599875222224] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599875229072] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599875230128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff57fc0 con 0x5609bff4edb0 2024-03-20T13:36:54.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff58ce0 con 0x7f4b70017710 2024-03-20T13:36:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599875230128] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599875226880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff57fc0 con 0x7f4b70017710 2024-03-20T13:36:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=0 2024-03-20T13:36:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=1 2024-03-20T13:36:54.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=2 2024-03-20T13:36:54.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=3 2024-03-20T13:36:54.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=4 2024-03-20T13:36:54.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=5 2024-03-20T13:36:54.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=6 2024-03-20T13:36:54.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599875226880] v32'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 20 add_watcher() i=7 2024-03-20T13:36:54.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:54.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff5bd40 con 0x5609bff45700 2024-03-20T13:36:54.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.606+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599875233856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff59220 con 0x5609bff45700 2024-03-20T13:36:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.610+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599875233856] v32'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.610+0000 7f4a36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.610+0000 7f4b83048980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.610+0000 7f4b83048980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:54.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.610+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff5b6c0 con 0x5609bff49ae0 2024-03-20T13:36:54.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.614+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.614+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff5b710 con 0x7f4b70017710 2024-03-20T13:36:54.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.614+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.614+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff5bb80 con 0x5609bff4edb0 2024-03-20T13:36:54.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.618+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.618+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff64f70 con 0x5609bff45700 2024-03-20T13:36:54.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.618+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.618+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff65410 con 0x5609bff49ae0 2024-03-20T13:36:54.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.622+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.622+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff64400 con 0x5609bff4edb0 2024-03-20T13:36:54.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.622+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.622+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff64400 con 0x5609bff49ae0 2024-03-20T13:36:54.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.626+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.626+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66150 con 0x5609bff45700 2024-03-20T13:36:54.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.626+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.626+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff665f0 con 0x5609bff49ae0 2024-03-20T13:36:54.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.630+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.630+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff665f0 con 0x5609bff49ae0 2024-03-20T13:36:54.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.630+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.630+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff665f0 con 0x5609bff49ae0 2024-03-20T13:36:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.634+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.634+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff665f0 con 0x5609bff4edb0 2024-03-20T13:36:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.634+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.634+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66b20 con 0x5609bff49ae0 2024-03-20T13:36:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.638+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.638+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66b20 con 0x5609bff45700 2024-03-20T13:36:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.638+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.638+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66b20 con 0x5609bff45700 2024-03-20T13:36:54.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.642+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.642+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66bb0 con 0x5609bff49ae0 2024-03-20T13:36:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.642+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.642+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66d80 con 0x5609bff49ae0 2024-03-20T13:36:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.646+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.646+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66d80 con 0x5609bff4edb0 2024-03-20T13:36:54.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.646+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.646+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66d80 con 0x5609bff49ae0 2024-03-20T13:36:54.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.650+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.650+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff45700 2024-03-20T13:36:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.650+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.654+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff49ae0 2024-03-20T13:36:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.654+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.654+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff49ae0 2024-03-20T13:36:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.658+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.658+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff4edb0 2024-03-20T13:36:54.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.658+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.658+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff49ae0 2024-03-20T13:36:54.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.662+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.662+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff4edb0 2024-03-20T13:36:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.662+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.662+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff4edb0 2024-03-20T13:36:54.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.666+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.666+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff4edb0 2024-03-20T13:36:54.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.666+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.666+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff49ae0 2024-03-20T13:36:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.670+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.670+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff66cf0 con 0x5609bff45700 2024-03-20T13:36:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.674+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.674+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff671c0 con 0x5609bff49ae0 2024-03-20T13:36:54.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.678+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.678+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff671c0 con 0x5609bff45700 2024-03-20T13:36:54.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.678+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.678+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff671c0 con 0x7f4b70017710 2024-03-20T13:36:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4a35fe3640 20 reqs_thread_entry: start 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 20 Filter name: none 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f49a77fe640 20 reqs_thread_entry: start 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff626f0 con 0x7f4b70017710 2024-03-20T13:36:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-03-20T13:36:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4b83048980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:36:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:36:54.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.682+0000 7f4a36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.686+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599875233856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff626f0 con 0x5609bff45700 2024-03-20T13:36:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.686+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94599875233856] v32'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.686+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599875210240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff626f0 con 0x5609bff49ae0 2024-03-20T13:36:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94599875210240] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b83048980 20 remove_watcher() i=0 2024-03-20T13:36:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b83048980 2 removed watcher, disabling cache 2024-03-20T13:36:54.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599875216896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff62680 con 0x5609bff45700 2024-03-20T13:36:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94599875216896] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x5609bff45700 2024-03-20T13:36:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b83048980 20 remove_watcher() i=1 2024-03-20T13:36:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.690+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599875219808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff62680 con 0x5609bff49ae0 2024-03-20T13:36:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.694+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94599875219808] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.694+0000 7f4b83048980 20 remove_watcher() i=2 2024-03-20T13:36:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.694+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599875223408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff62680 con 0x7f4b70017710 2024-03-20T13:36:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.694+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94599875223408] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.694+0000 7f4b83048980 20 remove_watcher() i=3 2024-03-20T13:36:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.694+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599875222224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff62680 con 0x5609bff49ae0 2024-03-20T13:36:54.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.698+0000 7f4b81364640 1 -- 172.21.15.123:0/607637041 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94599875222224] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b70071040 con 0x5609bff49ae0 2024-03-20T13:36:54.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.698+0000 7f4b83048980 20 remove_watcher() i=4 2024-03-20T13:36:54.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.698+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599875229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff62680 con 0x5609bff4edb0 2024-03-20T13:36:54.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.698+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94599875229072] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.698+0000 7f4b83048980 20 remove_watcher() i=5 2024-03-20T13:36:54.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.698+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599875230128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff62680 con 0x5609bff4edb0 2024-03-20T13:36:54.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b80b63640 1 -- 172.21.15.123:0/607637041 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94599875230128] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b78004690 con 0x5609bff4edb0 2024-03-20T13:36:54.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 20 remove_watcher() i=6 2024-03-20T13:36:54.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599875226880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5609bff57a30 con 0x7f4b70017710 2024-03-20T13:36:54.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94599875226880] v32'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7400f6a0 con 0x7f4b70017710 2024-03-20T13:36:54.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 20 remove_watcher() i=7 2024-03-20T13:36:54.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff49ae0 msgr2=0x5609bff4bed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff49ae0 0x5609bff4bed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bff45700 msgr2=0x5609bff47bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bff45700 0x5609bff47bc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b70017710 msgr2=0x7f4b700166c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b70017710 0x7f4b700166c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609bff4edb0 msgr2=0x5609bff51270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609bff4edb0 0x5609bff51270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a4c0342b0 msgr2=0x7f4a4c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a4c0342b0 0x7f4a4c036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b78004920 tx=0x7f4b780dd000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 msgr2=0x5609bff39f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b80362640 1 -- 172.21.15.123:0/607637041 reap_dead start 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff39f70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b70020890 tx=0x7f4b700488f0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 shutdown_connections 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/607637041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff33130 0x5609bff39f70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 >> 172.21.15.123:0/607637041 conn(0x5609bff2f4c0 msgr2=0x5609bff2cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 shutdown_connections 2024-03-20T13:36:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/607637041 wait complete. 2024-03-20T13:36:54.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a580342b0 msgr2=0x7f4a58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a580342b0 0x7f4a58036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5609bff16760 tx=0x7f4b780e3040 comp rx=0 tx=0).stop 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 msgr2=0x5609bff265c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.702+0000 7f4b83048980 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 0x5609bff265c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5609bff0ca30 tx=0x7f4b7000af40 comp rx=0 tx=0).stop 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 shutdown_connections 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a580342b0 0x7f4a58036770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/182959364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bff261a0 0x5609bff265c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 >> 172.21.15.123:0/182959364 conn(0x5609bff1afb0 msgr2=0x5609bff1bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 shutdown_connections 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/182959364 wait complete. 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff13770 msgr2=0x5609bff15b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff13770 0x5609bff15b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bfe1e530 msgr2=0x5609bff129c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bfe1e530 0x5609bff129c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a680342b0 msgr2=0x7f4a68036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a680342b0 0x7f4a68036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b74001e50 tx=0x7f4b740013b0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 msgr2=0x5609bff0bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff0bd90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b7801aec0 tx=0x7f4b78017e30 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 shutdown_connections 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609bff13770 0x5609bff15b60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609bfe1e530 0x5609bff129c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a680342b0 0x7f4a68036770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 --2- 172.21.15.123:0/2915705039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609bfd8d8f0 0x5609bff0bd90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 >> 172.21.15.123:0/2915705039 conn(0x5609bfe13710 msgr2=0x5609bfeff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 shutdown_connections 2024-03-20T13:36:54.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.706+0000 7f4b83048980 1 -- 172.21.15.123:0/2915705039 wait complete. 2024-03-20T13:36:54.724 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:36:54.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-03-20T13:36:54.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-03-20T13:36:54.724 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-03-20T13:36:54.804 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:54.804 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b91406980 1 Processor -- start 2024-03-20T13:36:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b91406980 1 -- start start 2024-03-20T13:36:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b91406980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d2d4c940c0 0x55d2d4c964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b91406980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d2d4bde520 con 0x55d2d4c060b0 2024-03-20T13:36:54.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b91406980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d2d4ba50f0 con 0x55d2d4c940c0 2024-03-20T13:36:54.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b8e720640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d2d4c940c0 0x55d2d4c964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b8e720640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d2d4c940c0 0x55d2d4c964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52910/0 (socket says 172.21.15.123:52910) 2024-03-20T13:36:54.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b8e720640 1 -- 172.21.15.123:0/428740035 learned_addr learned my addr 172.21.15.123:0/428740035 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b8e720640 1 -- 172.21.15.123:0/428740035 >> v1:172.21.15.89:6789/0 conn(0x55d2d4c060b0 legacy=0x55d2d4c929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.798+0000 7f0b8e720640 1 -- 172.21.15.123:0/428740035 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d4c96ab0 con 0x55d2d4c940c0 2024-03-20T13:36:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b8e720640 1 --2- 172.21.15.123:0/428740035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c940c0 0x55d2d4c964e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400a5c0 tx=0x7f0b8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b60f6ab287aef8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b8df1f640 1 -- 172.21.15.123:0/428740035 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b840aa470 con 0x55d2d4c940c0 2024-03-20T13:36:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b8df1f640 1 -- 172.21.15.123:0/428740035 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b840aa5d0 con 0x55d2d4c940c0 2024-03-20T13:36:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b8df1f640 1 -- 172.21.15.123:0/428740035 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b840aa890 con 0x55d2d4c940c0 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 -- 172.21.15.123:0/428740035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c940c0 msgr2=0x55d2d4c964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 --2- 172.21.15.123:0/428740035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c940c0 0x55d2d4c964e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400a5c0 tx=0x7f0b8401b340 comp rx=0 tx=0).stop 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 -- 172.21.15.123:0/428740035 shutdown_connections 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 --2- 172.21.15.123:0/428740035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c940c0 0x55d2d4c964e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 -- 172.21.15.123:0/428740035 >> 172.21.15.123:0/428740035 conn(0x55d2d4c8c6d0 msgr2=0x55d2d4c8eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 -- 172.21.15.123:0/428740035 shutdown_connections 2024-03-20T13:36:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.802+0000 7f0b91406980 1 -- 172.21.15.123:0/428740035 wait complete. 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.818+0000 7f0b91406980 1 Processor -- start 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.818+0000 7f0b91406980 1 -- start start 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d82880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d4ba2620 con 0x55d2d4c060b0 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d82880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d82880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52924/0 (socket says 172.21.15.123:52924) 2024-03-20T13:36:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 -- 172.21.15.123:0/1563435963 learned_addr learned my addr 172.21.15.123:0/1563435963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 -- 172.21.15.123:0/1563435963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84005df0 con 0x55d2d4c060b0 2024-03-20T13:36:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/1563435963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d82880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b80006fb0 tx=0x7f0b80001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba5ecebe636b203 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0a7ce09640 1 -- 172.21.15.123:0/1563435963 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b8000f640 con 0x55d2d4c060b0 2024-03-20T13:36:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0a7ce09640 1 -- 172.21.15.123:0/1563435963 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000f7c0 con 0x55d2d4c060b0 2024-03-20T13:36:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0a7ce09640 1 -- 172.21.15.123:0/1563435963 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b8000fae0 con 0x55d2d4c060b0 2024-03-20T13:36:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- 172.21.15.123:0/1563435963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 msgr2=0x55d2d4d82880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 --2- 172.21.15.123:0/1563435963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d82880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b80006fb0 tx=0x7f0b80001940 comp rx=0 tx=0).stop 2024-03-20T13:36:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- 172.21.15.123:0/1563435963 shutdown_connections 2024-03-20T13:36:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 --2- 172.21.15.123:0/1563435963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d82880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- 172.21.15.123:0/1563435963 >> 172.21.15.123:0/1563435963 conn(0x55d2d4c8c6d0 msgr2=0x55d2d4d7e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- 172.21.15.123:0/1563435963 shutdown_connections 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- 172.21.15.123:0/1563435963 wait complete. 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 Processor -- start 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- start start 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d89730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b91406980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d4b9de00 con 0x55d2d4c060b0 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d89730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d89730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52940/0 (socket says 172.21.15.123:52940) 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.822+0000 7f0b8ef21640 1 -- 172.21.15.123:0/2191045612 learned_addr learned my addr 172.21.15.123:0/2191045612 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8ef21640 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d4bde520 con 0x55d2d4c060b0 2024-03-20T13:36:54.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d89730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55d2d4d83710 tx=0x7f0b80000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0a7b606640 1 -- 172.21.15.123:0/2191045612 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b80005450 con 0x55d2d4c060b0 2024-03-20T13:36:54.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0a7b606640 1 -- 172.21.15.123:0/2191045612 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b800055b0 con 0x55d2d4c060b0 2024-03-20T13:36:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2d4d89c70 con 0x55d2d4c060b0 2024-03-20T13:36:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0a7b606640 1 -- 172.21.15.123:0/2191045612 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b800058b0 con 0x55d2d4c060b0 2024-03-20T13:36:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2d4d8a0a0 con 0x55d2d4c060b0 2024-03-20T13:36:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0a7b606640 1 -- 172.21.15.123:0/2191045612 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b80005a10 con 0x55d2d4c060b0 2024-03-20T13:36:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0a7b606640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a74034300 0x7f0a740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0a7b606640 1 -- 172.21.15.123:0/2191045612 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0b800490c0 con 0x55d2d4c060b0 2024-03-20T13:36:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8e720640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a74034300 0x7f0a740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4d8e350 0x55d2d4d90740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4d90c80 con 0x55d2d4d8e350 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8f722640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4d8e350 0x55d2d4d90740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8e720640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a74034300 0x7f0a740367c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ae000 tx=0x7f0b840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8f722640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4d8e350 0x55d2d4d90740 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.826+0000 7f0b8f722640 1 -- 172.21.15.123:0/2191045612 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b880083f0 con 0x55d2d4d8e350 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4d914f0 0x55d2d4d938e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4d94010 con 0x55d2d4d914f0 2024-03-20T13:36:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4d914f0 0x55d2d4d938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4d914f0 0x55d2d4d938e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b8ef21640 1 -- 172.21.15.123:0/2191045612 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4d914f0 2024-03-20T13:36:54.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4d95870 con 0x55d2d4d914f0 2024-03-20T13:36:54.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b8ef21640 1 -- 172.21.15.123:0/2191045612 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4d914f0 2024-03-20T13:36:54.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4d94a70 con 0x55d2d4d914f0 2024-03-20T13:36:54.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b8ef21640 1 -- 172.21.15.123:0/2191045612 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4d914f0 2024-03-20T13:36:54.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4d94e80 con 0x55d2d4d8e350 2024-03-20T13:36:54.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b8f722640 1 -- 172.21.15.123:0/2191045612 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0b880083f0 con 0x55d2d4d8e350 2024-03-20T13:36:54.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.830+0000 7f0b91406980 1 Processor -- start 2024-03-20T13:36:54.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b91406980 1 -- start start 2024-03-20T13:36:54.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b91406980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 0x55d2d4da4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b91406980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d4b36e30 con 0x55d2d4da4000 2024-03-20T13:36:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b8f722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 0x55d2d4da4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b8f722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 0x55d2d4da4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52942/0 (socket says 172.21.15.123:52942) 2024-03-20T13:36:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b8f722640 1 -- 172.21.15.123:0/2719464309 learned_addr learned my addr 172.21.15.123:0/2719464309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b8f722640 1 -- 172.21.15.123:0/2719464309 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d4da4960 con 0x55d2d4da4000 2024-03-20T13:36:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b8f722640 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 0x55d2d4da4420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800aae0 tx=0x7f0b88008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0a78e01640 1 -- 172.21.15.123:0/2719464309 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b8801d070 con 0x55d2d4da4000 2024-03-20T13:36:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0a78e01640 1 -- 172.21.15.123:0/2719464309 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88010040 con 0x55d2d4da4000 2024-03-20T13:36:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2d4da4bb0 con 0x55d2d4da4000 2024-03-20T13:36:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0a78e01640 1 -- 172.21.15.123:0/2719464309 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b88007e70 con 0x55d2d4da4000 2024-03-20T13:36:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2d4da5700 con 0x55d2d4da4000 2024-03-20T13:36:54.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0a78e01640 1 -- 172.21.15.123:0/2719464309 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b88018430 con 0x55d2d4da4000 2024-03-20T13:36:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0a78e01640 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a680342b0 0x7f0a68036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0a78e01640 1 -- 172.21.15.123:0/2719464309 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0b8804a6f0 con 0x55d2d4da4000 2024-03-20T13:36:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.834+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a680342b0 0x7f0a68036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 Processor -- start 2024-03-20T13:36:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- start start 2024-03-20T13:36:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d4b2a790 con 0x55d2d4db0f50 2024-03-20T13:36:54.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a680342b0 0x7f0a68036770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55d2d4d944b0 tx=0x7f0b80018ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52944/0 (socket says 172.21.15.123:52944) 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 -- 172.21.15.123:0/3325640439 learned_addr learned my addr 172.21.15.123:0/3325640439 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 -- 172.21.15.123:0/3325640439 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d4db1940 con 0x55d2d4db0f50 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 --2- 172.21.15.123:0/3325640439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db1370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0b88048a20 tx=0x7f0b88021770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64520131f6529d9a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0a727fc640 1 -- 172.21.15.123:0/3325640439 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b88047070 con 0x55d2d4db0f50 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0a727fc640 1 -- 172.21.15.123:0/3325640439 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88039220 con 0x55d2d4db0f50 2024-03-20T13:36:54.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0a727fc640 1 -- 172.21.15.123:0/3325640439 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b880393b0 con 0x55d2d4db0f50 2024-03-20T13:36:54.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- 172.21.15.123:0/3325640439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 msgr2=0x55d2d4db1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 --2- 172.21.15.123:0/3325640439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db1370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0b88048a20 tx=0x7f0b88021770 comp rx=0 tx=0).stop 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- 172.21.15.123:0/3325640439 shutdown_connections 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 --2- 172.21.15.123:0/3325640439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db1370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- 172.21.15.123:0/3325640439 >> 172.21.15.123:0/3325640439 conn(0x55d2d4dad2e0 msgr2=0x55d2d4dab340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- 172.21.15.123:0/3325640439 shutdown_connections 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- 172.21.15.123:0/3325640439 wait complete. 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 Processor -- start 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- start start 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b91406980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2d4db8300 con 0x55d2d4db0f50 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52956/0 (socket says 172.21.15.123:52956) 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 learned_addr learned my addr 172.21.15.123:0/270989868 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:54.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.838+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2d4da5700 con 0x55d2d4db0f50 2024-03-20T13:36:54.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8f722640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db7dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b880077a0 tx=0x7f0b880489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0a70ff9640 1 -- 172.21.15.123:0/270989868 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b8804a4a0 con 0x55d2d4db0f50 2024-03-20T13:36:54.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2d4db8500 con 0x55d2d4db0f50 2024-03-20T13:36:54.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0a70ff9640 1 -- 172.21.15.123:0/270989868 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88021c40 con 0x55d2d4db0f50 2024-03-20T13:36:54.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0a70ff9640 1 -- 172.21.15.123:0/270989868 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b88021db0 con 0x55d2d4db0f50 2024-03-20T13:36:54.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2d4db88d0 con 0x55d2d4db0f50 2024-03-20T13:36:54.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0a70ff9640 1 -- 172.21.15.123:0/270989868 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0b8804a9d0 con 0x55d2d4db0f50 2024-03-20T13:36:54.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0a70ff9640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a580342b0 0x7f0a58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0a70ff9640 1 -- 172.21.15.123:0/270989868 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0b88036cb0 con 0x55d2d4db0f50 2024-03-20T13:36:54.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a580342b0 0x7f0a58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4dc34e0 0x55d2d4dc59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dc60f0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a580342b0 0x7f0a58036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55d2d4d8a490 tx=0x7f0b80039000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8e720640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4dc34e0 0x55d2d4dc59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8e720640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4dc34e0 0x55d2d4dc59a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 realm 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dc64e0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dc6900 con 0x55d2d4dc34e0 2024-03-20T13:36:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.842+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4dc7660 0x55d2d4dc9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dca0d0 con 0x55d2d4dc7660 2024-03-20T13:36:54.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4dc7660 0x55d2d4dc9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4dc7660 0x55d2d4dc9a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dca8d0 con 0x55d2d4dc7660 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:54.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 20 searching for the correct realm 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d2d4dcc810 0x55d2d4dcecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d2d4dcc810 0x55d2d4dcecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8ef21640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d2d4dcc810 0x55d2d4dcecd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0b88035070 0x7f0b88036460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.846+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x7f0b88035070 2024-03-20T13:36:54.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0b88035070 0x7f0b88036460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0b88035070 0x7f0b88036460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x7f0b88035070 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.850+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x7f0b88035070 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x7f0b88035070 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x7f0b88035070 2024-03-20T13:36:54.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0b840b0020 con 0x7f0b88035070 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840b0020 con 0x55d2d4dc34e0 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.854+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x7f0b88035070 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x7f0b88035070 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x7f0b88035070 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcf3a0 con 0x55d2d4dc7660 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b91406980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b91406980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b91406980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:54.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b91406980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b91406980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.858+0000 7f0b91406980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcb0d0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcb480 con 0x55d2d4dc7660 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcb860 con 0x55d2d4dc34e0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 zone default found 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 4 Realm: () 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 zonegroup default 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dcfc80 con 0x7f0b88035070 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd1e60 con 0x55d2d4dcc810 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd21c0 con 0x55d2d4dcc810 2024-03-20T13:36:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 started sync module instance, tier type = 2024-03-20T13:36:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:54.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.862+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd1430 con 0x55d2d4dc7660 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94364002752528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd1430 con 0x55d2d4dc7660 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd2b30 con 0x55d2d4dc34e0 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94364002756240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd2f50 con 0x55d2d4dc34e0 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd3980 con 0x55d2d4dc7660 2024-03-20T13:36:54.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94364002752528] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.866+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94364002756240] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94364002759808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd2ab0 con 0x55d2d4dc7660 2024-03-20T13:36:54.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd41d0 con 0x7f0b88035070 2024-03-20T13:36:54.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94364002762032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd2ab0 con 0x7f0b88035070 2024-03-20T13:36:54.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd4cb0 con 0x55d2d4dc7660 2024-03-20T13:36:54.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94364002759808] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.870+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94364002762032] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94364002763088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd4c70 con 0x55d2d4dc7660 2024-03-20T13:36:54.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd50a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94364002750352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd58f0 con 0x55d2d4dcc810 2024-03-20T13:36:54.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd62a0 con 0x55d2d4dcc810 2024-03-20T13:36:54.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94364002763088] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94364002750352] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364002767952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd5dc0 con 0x55d2d4dcc810 2024-03-20T13:36:54.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.874+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd6b20 con 0x7f0b88035070 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94364002772608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd6f80 con 0x7f0b88035070 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=0 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=1 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=2 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=3 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=4 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=5 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94364002767952] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=6 2024-03-20T13:36:54.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94364002772608] v32'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 20 add_watcher() i=7 2024-03-20T13:36:54.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:54.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd4880 con 0x55d2d4dc34e0 2024-03-20T13:36:54.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.878+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94364002773664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dd78f0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94364002773664] v32'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0a457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0b91406980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:54.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0b91406980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:54.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de25c0 con 0x55d2d4dc7660 2024-03-20T13:36:54.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.882+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de2a00 con 0x7f0b88035070 2024-03-20T13:36:54.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.886+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.886+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de2a00 con 0x55d2d4dcc810 2024-03-20T13:36:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.886+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.886+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de2f30 con 0x55d2d4dc34e0 2024-03-20T13:36:54.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.890+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.890+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de3460 con 0x55d2d4dc7660 2024-03-20T13:36:54.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.890+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.890+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de3990 con 0x55d2d4dcc810 2024-03-20T13:36:54.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.894+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.894+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de3ec0 con 0x55d2d4dc7660 2024-03-20T13:36:54.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.894+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.894+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de4360 con 0x55d2d4dc34e0 2024-03-20T13:36:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.898+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.898+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0600 con 0x55d2d4dc7660 2024-03-20T13:36:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.898+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.898+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0600 con 0x55d2d4dc7660 2024-03-20T13:36:54.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.902+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.902+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0430 con 0x55d2d4dc7660 2024-03-20T13:36:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.902+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.902+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0430 con 0x55d2d4dcc810 2024-03-20T13:36:54.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.906+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.906+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de4ed0 con 0x55d2d4dc7660 2024-03-20T13:36:54.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.906+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.906+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de4ed0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.910+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.910+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0330 con 0x55d2d4dc34e0 2024-03-20T13:36:54.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.910+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.910+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0330 con 0x55d2d4dc7660 2024-03-20T13:36:54.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.914+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.914+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0330 con 0x55d2d4dc7660 2024-03-20T13:36:54.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.914+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.914+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de0330 con 0x55d2d4dcc810 2024-03-20T13:36:54.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.918+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.918+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc7660 2024-03-20T13:36:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.918+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.918+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc34e0 2024-03-20T13:36:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.922+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.922+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc7660 2024-03-20T13:36:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.926+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.926+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc7660 2024-03-20T13:36:54.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.926+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.926+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dcc810 2024-03-20T13:36:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.930+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.930+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc7660 2024-03-20T13:36:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.934+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.934+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dcc810 2024-03-20T13:36:54.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.934+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.934+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dcc810 2024-03-20T13:36:54.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.938+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.938+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dcc810 2024-03-20T13:36:54.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.942+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.942+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc7660 2024-03-20T13:36:54.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.942+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.942+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc34e0 2024-03-20T13:36:54.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.946+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.946+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc7660 2024-03-20T13:36:54.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.950+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.950+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x55d2d4dc34e0 2024-03-20T13:36:54.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4de5370 con 0x7f0b88035070 2024-03-20T13:36:54.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f09bffff640 20 reqs_thread_entry: start 2024-03-20T13:36:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b91406980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b91406980 20 Filter name: none 2024-03-20T13:36:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f09bdffb640 20 reqs_thread_entry: start 2024-03-20T13:36:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b91406980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:36:54.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b91406980 20 rados->read ofs=0 len=0 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x7f0b88035070 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.954+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0b91406980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0b91406980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0b91406980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0a457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:54.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94364002773664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94364002773664] v32'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.958+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94364002752528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dc7660 2024-03-20T13:36:54.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94364002752528] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b91406980 20 remove_watcher() i=0 2024-03-20T13:36:54.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b91406980 2 removed watcher, disabling cache 2024-03-20T13:36:54.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94364002756240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dc34e0 2024-03-20T13:36:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94364002756240] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x55d2d4dc34e0 2024-03-20T13:36:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b91406980 20 remove_watcher() i=1 2024-03-20T13:36:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.962+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94364002759808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dc7660 2024-03-20T13:36:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.966+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94364002759808] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.966+0000 7f0b91406980 20 remove_watcher() i=2 2024-03-20T13:36:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.966+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94364002762032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x7f0b88035070 2024-03-20T13:36:54.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.966+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94364002762032] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.966+0000 7f0b91406980 20 remove_watcher() i=3 2024-03-20T13:36:54.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.966+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94364002763088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dc7660 2024-03-20T13:36:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.970+0000 7f0b8f722640 1 -- 172.21.15.123:0/270989868 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94364002763088] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b88041040 con 0x55d2d4dc7660 2024-03-20T13:36:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.970+0000 7f0b91406980 20 remove_watcher() i=4 2024-03-20T13:36:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.970+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94364002750352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dcc810 2024-03-20T13:36:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.970+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94364002750352] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.970+0000 7f0b91406980 20 remove_watcher() i=5 2024-03-20T13:36:54.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.970+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94364002767952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x55d2d4dcc810 2024-03-20T13:36:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b8ef21640 1 -- 172.21.15.123:0/270989868 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94364002767952] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b80023070 con 0x55d2d4dcc810 2024-03-20T13:36:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 20 remove_watcher() i=6 2024-03-20T13:36:54.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94364002772608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2d4dfeef0 con 0x7f0b88035070 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94364002772608] v32'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0b840d5060 con 0x7f0b88035070 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 20 remove_watcher() i=7 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4dc7660 msgr2=0x55d2d4dc9a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4dc7660 0x55d2d4dc9a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4dc34e0 msgr2=0x55d2d4dc59a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4dc34e0 0x55d2d4dc59a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0b88035070 msgr2=0x7f0b88036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0b88035070 0x7f0b88036460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d2d4dcc810 msgr2=0x55d2d4dcecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d2d4dcc810 0x55d2d4dcecd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a580342b0 msgr2=0x7f0a58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a580342b0 0x7f0a58036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55d2d4d8a490 tx=0x7f0b80039000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 msgr2=0x55d2d4db7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db7dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b880077a0 tx=0x7f0b880489b0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b8e720640 1 -- 172.21.15.123:0/270989868 reap_dead start 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 shutdown_connections 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 --2- 172.21.15.123:0/270989868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4db0f50 0x55d2d4db7dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.974+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 >> 172.21.15.123:0/270989868 conn(0x55d2d4dad2e0 msgr2=0x55d2d4daa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 shutdown_connections 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/270989868 wait complete. 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a680342b0 msgr2=0x7f0a68036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a680342b0 0x7f0a68036770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x55d2d4d944b0 tx=0x7f0b80018ee0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 msgr2=0x55d2d4da4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 0x55d2d4da4420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800aae0 tx=0x7f0b88008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 shutdown_connections 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a680342b0 0x7f0a68036770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2719464309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4da4000 0x55d2d4da4420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 >> 172.21.15.123:0/2719464309 conn(0x55d2d4d98e10 msgr2=0x55d2d4d99920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 shutdown_connections 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2719464309 wait complete. 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4d914f0 msgr2=0x55d2d4d938e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4d914f0 0x55d2d4d938e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4d8e350 msgr2=0x55d2d4d90740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4d8e350 0x55d2d4d90740 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a74034300 msgr2=0x7f0a740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a74034300 0x7f0a740367c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ae000 tx=0x7f0b840a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 msgr2=0x55d2d4d89730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d89730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55d2d4d83710 tx=0x7f0b80000f50 comp rx=0 tx=0).stop 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 shutdown_connections 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d2d4d914f0 0x55d2d4d938e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d2d4d8e350 0x55d2d4d90740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a74034300 0x7f0a740367c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 --2- 172.21.15.123:0/2191045612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d2d4c060b0 0x55d2d4d89730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 >> 172.21.15.123:0/2191045612 conn(0x55d2d4c8c6d0 msgr2=0x55d2d4d7ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 shutdown_connections 2024-03-20T13:36:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:54.978+0000 7f0b91406980 1 -- 172.21.15.123:0/2191045612 wait complete. 2024-03-20T13:36:54.994 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:36:54.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-03-20T13:36:54.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-03-20T13:36:54.995 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-03-20T13:36:55.072 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:55.072 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:55.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcde51980 1 Processor -- start 2024-03-20T13:36:55.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcde51980 1 -- start start 2024-03-20T13:36:55.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcde51980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5606ba5ed630 0x5606ba5efa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcde51980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5606ba533520 con 0x5606ba5e9130 2024-03-20T13:36:55.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcde51980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5606ba4fa0f0 con 0x5606ba5ed630 2024-03-20T13:36:55.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcb16b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5606ba5ed630 0x5606ba5efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcb16b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5606ba5ed630 0x5606ba5efa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52958/0 (socket says 172.21.15.123:52958) 2024-03-20T13:36:55.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcb16b640 1 -- 172.21.15.123:0/1391212348 learned_addr learned my addr 172.21.15.123:0/1391212348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcb16b640 1 -- 172.21.15.123:0/1391212348 >> v1:172.21.15.89:6789/0 conn(0x5606ba5e9130 legacy=0x5606ba5e9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.066+0000 7f4dcb16b640 1 -- 172.21.15.123:0/1391212348 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ba5f0f70 con 0x5606ba5ed630 2024-03-20T13:36:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/1391212348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba5efa20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4db400a5c0 tx=0x7f4db401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f20bb3c9f6d20 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dca96a640 1 -- 172.21.15.123:0/1391212348 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40aa470 con 0x5606ba5ed630 2024-03-20T13:36:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dca96a640 1 -- 172.21.15.123:0/1391212348 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40aa5d0 con 0x5606ba5ed630 2024-03-20T13:36:55.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dca96a640 1 -- 172.21.15.123:0/1391212348 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db40aa890 con 0x5606ba5ed630 2024-03-20T13:36:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 -- 172.21.15.123:0/1391212348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 msgr2=0x5606ba5efa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 --2- 172.21.15.123:0/1391212348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba5efa20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4db400a5c0 tx=0x7f4db401b340 comp rx=0 tx=0).stop 2024-03-20T13:36:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 -- 172.21.15.123:0/1391212348 shutdown_connections 2024-03-20T13:36:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 --2- 172.21.15.123:0/1391212348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba5efa20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 -- 172.21.15.123:0/1391212348 >> 172.21.15.123:0/1391212348 conn(0x5606ba55c850 msgr2=0x5606ba55cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 -- 172.21.15.123:0/1391212348 shutdown_connections 2024-03-20T13:36:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.070+0000 7f4dcde51980 1 -- 172.21.15.123:0/1391212348 wait complete. 2024-03-20T13:36:55.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcde51980 1 Processor -- start 2024-03-20T13:36:55.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcde51980 1 -- start start 2024-03-20T13:36:55.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcde51980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 0x5606ba6d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcde51980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ba4f7620 con 0x5606ba5e9130 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcb96c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 0x5606ba6d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcb96c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 0x5606ba6d2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52966/0 (socket says 172.21.15.123:52966) 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.086+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2449398697 learned_addr learned my addr 172.21.15.123:0/2449398697 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2449398697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4005df0 con 0x5606ba5e9130 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/2449398697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 0x5606ba6d2fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc001d10 tx=0x7f4dbc00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cd6a191ead28f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4cb9e0b640 1 -- 172.21.15.123:0/2449398697 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc014070 con 0x5606ba5e9130 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4cb9e0b640 1 -- 172.21.15.123:0/2449398697 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00f560 con 0x5606ba5e9130 2024-03-20T13:36:55.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4cb9e0b640 1 -- 172.21.15.123:0/2449398697 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc00f840 con 0x5606ba5e9130 2024-03-20T13:36:55.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/2449398697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 msgr2=0x5606ba6d2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2449398697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 0x5606ba6d2fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc001d10 tx=0x7f4dbc00b5c0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/2449398697 shutdown_connections 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2449398697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5e9130 0x5606ba6d2fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/2449398697 >> 172.21.15.123:0/2449398697 conn(0x5606ba55c850 msgr2=0x5606ba6ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/2449398697 shutdown_connections 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/2449398697 wait complete. 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 Processor -- start 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- start start 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba6da120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ba4f2e00 con 0x5606ba5ed630 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba6da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba6da120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52970/0 (socket says 172.21.15.123:52970) 2024-03-20T13:36:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 -- 172.21.15.123:0/685307187 learned_addr learned my addr 172.21.15.123:0/685307187 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ba533520 con 0x5606ba5ed630 2024-03-20T13:36:55.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba6da120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc002000 tx=0x7f4dbc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4cb3fff640 1 -- 172.21.15.123:0/685307187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc014050 con 0x5606ba5ed630 2024-03-20T13:36:55.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4cb3fff640 1 -- 172.21.15.123:0/685307187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00fe70 con 0x5606ba5ed630 2024-03-20T13:36:55.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ba6da660 con 0x5606ba5ed630 2024-03-20T13:36:55.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4cb3fff640 1 -- 172.21.15.123:0/685307187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc01b8e0 con 0x5606ba5ed630 2024-03-20T13:36:55.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.090+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ba6daaf0 con 0x5606ba5ed630 2024-03-20T13:36:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4cb3fff640 1 -- 172.21.15.123:0/685307187 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4dbc022020 con 0x5606ba5ed630 2024-03-20T13:36:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4cb3fff640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4cb40342b0 0x7f4cb4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4cb3fff640 1 -- 172.21.15.123:0/685307187 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4dbc048be0 con 0x5606ba5ed630 2024-03-20T13:36:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4cb40342b0 0x7f4cb4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba6ded40 0x5606ba6e1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba6e1670 con 0x5606ba6ded40 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba6ded40 0x5606ba6e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4cb40342b0 0x7f4cb4036770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4db40ae000 tx=0x7f4db40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba6ded40 0x5606ba6e1130 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcc16d640 1 -- 172.21.15.123:0/685307187 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba6ded40 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba6e1ee0 0x5606ba6e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba6e4a00 con 0x5606ba6e1ee0 2024-03-20T13:36:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba6e1ee0 0x5606ba6e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.094+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba6e1ee0 0x5606ba6e42d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcb96c640 1 -- 172.21.15.123:0/685307187 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba6e1ee0 2024-03-20T13:36:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba6e6260 con 0x5606ba6e1ee0 2024-03-20T13:36:55.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcb96c640 1 -- 172.21.15.123:0/685307187 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba6e1ee0 2024-03-20T13:36:55.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba6e5460 con 0x5606ba6e1ee0 2024-03-20T13:36:55.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcb96c640 1 -- 172.21.15.123:0/685307187 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba6e1ee0 2024-03-20T13:36:55.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba6e5870 con 0x5606ba6ded40 2024-03-20T13:36:55.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcc16d640 1 -- 172.21.15.123:0/685307187 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba6ded40 2024-03-20T13:36:55.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 Processor -- start 2024-03-20T13:36:55.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 -- start start 2024-03-20T13:36:55.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 0x5606ba6f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcde51980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ba48be30 con 0x5606ba6f4900 2024-03-20T13:36:55.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcc16d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 0x5606ba6f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcc16d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 0x5606ba6f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:52986/0 (socket says 172.21.15.123:52986) 2024-03-20T13:36:55.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcc16d640 1 -- 172.21.15.123:0/600551685 learned_addr learned my addr 172.21.15.123:0/600551685 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.098+0000 7f4dcc16d640 1 -- 172.21.15.123:0/600551685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ba6f5260 con 0x5606ba6f4900 2024-03-20T13:36:55.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 0x5606ba6f4d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4016cf0 tx=0x7f4dc400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4cb17fa640 1 -- 172.21.15.123:0/600551685 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4017660 con 0x5606ba6f4900 2024-03-20T13:36:55.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4cb17fa640 1 -- 172.21.15.123:0/600551685 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40177c0 con 0x5606ba6f4900 2024-03-20T13:36:55.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4cb17fa640 1 -- 172.21.15.123:0/600551685 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4017a60 con 0x5606ba6f4900 2024-03-20T13:36:55.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ba6f54b0 con 0x5606ba6f4900 2024-03-20T13:36:55.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ba6f6000 con 0x5606ba6f4900 2024-03-20T13:36:55.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4cb17fa640 1 -- 172.21.15.123:0/600551685 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4dc401d020 con 0x5606ba6f4900 2024-03-20T13:36:55.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4cb17fa640 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4ca4034350 0x7f4ca4036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4cb17fa640 1 -- 172.21.15.123:0/600551685 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4dc404b230 con 0x5606ba6f4900 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4ca4034350 0x7f4ca4036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcde51980 1 Processor -- start 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcde51980 1 -- start start 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4ca4034350 0x7f4ca4036810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5606ba6e4f60 tx=0x7f4dbc00e4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcde51980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba701ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcde51980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ba47f790 con 0x5606ba701880 2024-03-20T13:36:55.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcc16d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba701ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcc16d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba701ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53002/0 (socket says 172.21.15.123:53002) 2024-03-20T13:36:55.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcc16d640 1 -- 172.21.15.123:0/1848383400 learned_addr learned my addr 172.21.15.123:0/1848383400 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcc16d640 1 -- 172.21.15.123:0/1848383400 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ba702270 con 0x5606ba701880 2024-03-20T13:36:55.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.102+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/1848383400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba701ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4016ff0 tx=0x7f4dc4028db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139c09ba04155388 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4caaffd640 1 -- 172.21.15.123:0/1848383400 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc403b2a0 con 0x5606ba701880 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4caaffd640 1 -- 172.21.15.123:0/1848383400 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4017bc0 con 0x5606ba701880 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4caaffd640 1 -- 172.21.15.123:0/1848383400 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4011cb0 con 0x5606ba701880 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/1848383400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 msgr2=0x5606ba701ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 --2- 172.21.15.123:0/1848383400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba701ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4016ff0 tx=0x7f4dc4028db0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/1848383400 shutdown_connections 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 --2- 172.21.15.123:0/1848383400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba701ca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/1848383400 >> 172.21.15.123:0/1848383400 conn(0x5606ba6fdbc0 msgr2=0x5606ba6fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/1848383400 shutdown_connections 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/1848383400 wait complete. 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 Processor -- start 2024-03-20T13:36:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- start start 2024-03-20T13:36:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba7086c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ba708c00 con 0x5606ba701880 2024-03-20T13:36:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcc16d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba7086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcc16d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba7086c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53006/0 (socket says 172.21.15.123:53006) 2024-03-20T13:36:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 learned_addr learned my addr 172.21.15.123:0/2641694838 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ba6f6000 con 0x5606ba701880 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba7086c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4dc401ffd0 tx=0x7f4dc40494f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4ca97fa640 1 -- 172.21.15.123:0/2641694838 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4028860 con 0x5606ba701880 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ba708e00 con 0x5606ba701880 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4ca97fa640 1 -- 172.21.15.123:0/2641694838 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4017d30 con 0x5606ba701880 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4ca97fa640 1 -- 172.21.15.123:0/2641694838 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4011500 con 0x5606ba701880 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.106+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ba709290 con 0x5606ba701880 2024-03-20T13:36:55.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4ca97fa640 1 -- 172.21.15.123:0/2641694838 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4dc4011660 con 0x5606ba701880 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4ca97fa640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4c940342b0 0x7f4c94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4ca97fa640 1 -- 172.21.15.123:0/2641694838 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4dc404cce0 con 0x5606ba701880 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4c940342b0 0x7f4c94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba713e70 0x5606ba716330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba716a80 con 0x5606ba713e70 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba713e70 0x5606ba716330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4c940342b0 0x7f4c94036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc047230 tx=0x7f4dbc033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba713e70 0x5606ba716330 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 realm 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba716e70 con 0x5606ba713e70 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7176c0 con 0x5606ba713e70 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba7180a0 0x5606ba71a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71ac60 con 0x5606ba7180a0 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba7180a0 0x5606ba71a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba7180a0 0x5606ba71a4f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.110+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71b460 con 0x5606ba7180a0 2024-03-20T13:36:55.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcde51980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcde51980 20 searching for the correct realm 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5606ba71d460 0x5606ba71f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5606ba71d460 0x5606ba71f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb96c640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5606ba71d460 0x5606ba71f920 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcc16d640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4dc4020420 0x7f4dc404c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x7f4dc4020420 2024-03-20T13:36:55.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4dc4020420 0x7f4dc404c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4dc4020420 0x7f4dc404c490 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x7f4dc4020420 2024-03-20T13:36:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.114+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x7f4dc4020420 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x7f4dc4020420 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x7f4dc4020420 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4db40b0020 con 0x7f4dc4020420 2024-03-20T13:36:55.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.118+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40b0020 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x7f4dc4020420 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x7f4dc4020420 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x7f4dc4020420 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.122+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba71d460 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71fff0 con 0x5606ba7180a0 2024-03-20T13:36:55.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71bd20 con 0x5606ba713e70 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.126+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71c0d0 con 0x5606ba7180a0 2024-03-20T13:36:55.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba71c0d0 con 0x5606ba713e70 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 zone default found 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 4 Realm: () 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 zonegroup default 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba720430 con 0x7f4dc4020420 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba722610 con 0x5606ba71d460 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba722970 con 0x5606ba71d460 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 started sync module instance, tier type = 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:55.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba721be0 con 0x5606ba7180a0 2024-03-20T13:36:55.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94586897833920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba721be0 con 0x5606ba7180a0 2024-03-20T13:36:55.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.130+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba723320 con 0x5606ba713e70 2024-03-20T13:36:55.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.134+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.134+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94586897837632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba723260 con 0x5606ba713e70 2024-03-20T13:36:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.134+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba724200 con 0x5606ba7180a0 2024-03-20T13:36:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.134+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94586897837632] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.134+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94586897833920] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94586897831744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba724200 con 0x5606ba7180a0 2024-03-20T13:36:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba723e80 con 0x7f4dc4020420 2024-03-20T13:36:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94586897843632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba723e80 con 0x7f4dc4020420 2024-03-20T13:36:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7255b0 con 0x5606ba7180a0 2024-03-20T13:36:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94586897843632] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94586897831744] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94586897839824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba725570 con 0x5606ba7180a0 2024-03-20T13:36:55.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.138+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7259d0 con 0x5606ba71d460 2024-03-20T13:36:55.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94586897844896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba725990 con 0x5606ba71d460 2024-03-20T13:36:55.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba726850 con 0x5606ba71d460 2024-03-20T13:36:55.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94586897839824] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94586897851280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba726850 con 0x5606ba71d460 2024-03-20T13:36:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba727210 con 0x7f4dc4020420 2024-03-20T13:36:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.142+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94586897844896] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94586897849728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba727210 con 0x7f4dc4020420 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=0 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=1 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=2 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=3 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=4 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=5 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94586897851280] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=6 2024-03-20T13:36:55.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94586897849728] v32'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 20 add_watcher() i=7 2024-03-20T13:36:55.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:55.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7250b0 con 0x5606ba713e70 2024-03-20T13:36:55.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.146+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94586897853808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7250b0 con 0x5606ba713e70 2024-03-20T13:36:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94586897853808] v32'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4dcde51980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4dcde51980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7327c0 con 0x5606ba7180a0 2024-03-20T13:36:55.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.150+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba732c00 con 0x7f4dc4020420 2024-03-20T13:36:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.154+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.154+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba732c00 con 0x5606ba71d460 2024-03-20T13:36:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.154+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.154+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7331c0 con 0x5606ba713e70 2024-03-20T13:36:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.158+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.158+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7336f0 con 0x5606ba7180a0 2024-03-20T13:36:55.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.158+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.158+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba733c20 con 0x5606ba71d460 2024-03-20T13:36:55.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.162+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.162+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba734150 con 0x5606ba7180a0 2024-03-20T13:36:55.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.162+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.162+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba734680 con 0x5606ba713e70 2024-03-20T13:36:55.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.166+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.166+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba734bb0 con 0x5606ba7180a0 2024-03-20T13:36:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.166+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.166+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba734bb0 con 0x5606ba7180a0 2024-03-20T13:36:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.170+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.170+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba734bb0 con 0x5606ba7180a0 2024-03-20T13:36:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.170+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.170+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba734bb0 con 0x5606ba71d460 2024-03-20T13:36:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.170+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.170+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735050 con 0x5606ba7180a0 2024-03-20T13:36:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.174+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.174+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735050 con 0x5606ba713e70 2024-03-20T13:36:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.174+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.174+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735050 con 0x5606ba713e70 2024-03-20T13:36:55.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.178+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.178+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735140 con 0x5606ba7180a0 2024-03-20T13:36:55.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.178+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.178+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba7180a0 2024-03-20T13:36:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.182+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.182+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba71d460 2024-03-20T13:36:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.182+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.182+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba7180a0 2024-03-20T13:36:55.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.186+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.186+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba713e70 2024-03-20T13:36:55.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.186+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.186+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba7180a0 2024-03-20T13:36:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.190+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.190+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba7180a0 2024-03-20T13:36:55.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.190+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.190+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba71d460 2024-03-20T13:36:55.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.194+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.194+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba7180a0 2024-03-20T13:36:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.194+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.194+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba71d460 2024-03-20T13:36:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.194+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.198+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba71d460 2024-03-20T13:36:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.198+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.198+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba71d460 2024-03-20T13:36:55.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.198+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.198+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba7180a0 2024-03-20T13:36:55.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.202+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.202+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7355a0 con 0x5606ba713e70 2024-03-20T13:36:55.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.202+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.202+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735770 con 0x5606ba7180a0 2024-03-20T13:36:55.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.206+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.206+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735770 con 0x5606ba713e70 2024-03-20T13:36:55.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.206+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.206+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba735770 con 0x7f4dc4020420 2024-03-20T13:36:55.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4c80fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:55.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:55.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 20 Filter name: none 2024-03-20T13:36:55.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4bfa7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:55.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:55.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba730ad0 con 0x5606ba713e70 2024-03-20T13:36:55.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-03-20T13:36:55.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:55.219 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:36:55.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.210+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94586897853808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba730ad0 con 0x5606ba713e70 2024-03-20T13:36:55.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.214+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94586897853808] v32'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.214+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94586897833920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba730ad0 con 0x5606ba7180a0 2024-03-20T13:36:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.214+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94586897833920] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.214+0000 7f4dcde51980 20 remove_watcher() i=0 2024-03-20T13:36:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.214+0000 7f4dcde51980 2 removed watcher, disabling cache 2024-03-20T13:36:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.214+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94586897837632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba721fc0 con 0x5606ba713e70 2024-03-20T13:36:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.218+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94586897837632] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x5606ba713e70 2024-03-20T13:36:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.218+0000 7f4dcde51980 20 remove_watcher() i=1 2024-03-20T13:36:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.218+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94586897831744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba722e40 con 0x5606ba7180a0 2024-03-20T13:36:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.218+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94586897831744] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.218+0000 7f4dcde51980 20 remove_watcher() i=2 2024-03-20T13:36:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.218+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94586897843632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba722e40 con 0x7f4dc4020420 2024-03-20T13:36:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94586897843632] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcde51980 20 remove_watcher() i=3 2024-03-20T13:36:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94586897839824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7245b0 con 0x5606ba7180a0 2024-03-20T13:36:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcc16d640 1 -- 172.21.15.123:0/2641694838 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94586897839824] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dc400a4d0 con 0x5606ba7180a0 2024-03-20T13:36:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcde51980 20 remove_watcher() i=4 2024-03-20T13:36:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94586897844896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba722e40 con 0x5606ba71d460 2024-03-20T13:36:55.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94586897844896] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcde51980 20 remove_watcher() i=5 2024-03-20T13:36:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.222+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94586897851280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7236d0 con 0x5606ba71d460 2024-03-20T13:36:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcb96c640 1 -- 172.21.15.123:0/2641694838 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94586897851280] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4dbc016070 con 0x5606ba71d460 2024-03-20T13:36:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 20 remove_watcher() i=6 2024-03-20T13:36:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94586897849728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ba7245b0 con 0x7f4dc4020420 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94586897849728] v32'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db40d5060 con 0x7f4dc4020420 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 20 remove_watcher() i=7 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba7180a0 msgr2=0x5606ba71a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba7180a0 0x5606ba71a4f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba713e70 msgr2=0x5606ba716330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba713e70 0x5606ba716330 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4dc4020420 msgr2=0x7f4dc404c490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4dc4020420 0x7f4dc404c490 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5606ba71d460 msgr2=0x5606ba71f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5606ba71d460 0x5606ba71f920 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4c940342b0 msgr2=0x7f4c94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4c940342b0 0x7f4c94036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc047230 tx=0x7f4dbc033000 comp rx=0 tx=0).stop 2024-03-20T13:36:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 msgr2=0x5606ba7086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcb16b640 1 -- 172.21.15.123:0/2641694838 reap_dead start 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba7086c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4dc401ffd0 tx=0x7f4dc40494f0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 shutdown_connections 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/2641694838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba701880 0x5606ba7086c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 >> 172.21.15.123:0/2641694838 conn(0x5606ba6fdbc0 msgr2=0x5606ba6fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 shutdown_connections 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/2641694838 wait complete. 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4ca4034350 msgr2=0x7f4ca4036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4ca4034350 0x7f4ca4036810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5606ba6e4f60 tx=0x7f4dbc00e4a0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 msgr2=0x5606ba6f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 0x5606ba6f4d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4016cf0 tx=0x7f4dc400d790 comp rx=0 tx=0).stop 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 shutdown_connections 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4ca4034350 0x7f4ca4036810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/600551685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba6f4900 0x5606ba6f4d20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 >> 172.21.15.123:0/600551685 conn(0x5606ba6e9710 msgr2=0x5606ba6ea220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 shutdown_connections 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/600551685 wait complete. 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba6e1ee0 msgr2=0x5606ba6e42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba6e1ee0 0x5606ba6e42d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba6ded40 msgr2=0x5606ba6e1130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.226+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba6ded40 0x5606ba6e1130 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4cb40342b0 msgr2=0x7f4cb4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4cb40342b0 0x7f4cb4036770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4db40ae000 tx=0x7f4db40a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 msgr2=0x5606ba6da120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba6da120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc002000 tx=0x7f4dbc000bd0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 shutdown_connections 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5606ba6e1ee0 0x5606ba6e42d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5606ba6ded40 0x5606ba6e1130 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4cb40342b0 0x7f4cb4036770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 --2- 172.21.15.123:0/685307187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606ba5ed630 0x5606ba6da120 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 >> 172.21.15.123:0/685307187 conn(0x5606ba55c850 msgr2=0x5606ba6cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 shutdown_connections 2024-03-20T13:36:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.230+0000 7f4dcde51980 1 -- 172.21.15.123:0/685307187 wait complete. 2024-03-20T13:36:55.244 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:36:55.244 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:36:55.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:36:55.244 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-03-20T13:36:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5b006d980 1 Processor -- start 2024-03-20T13:36:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5b006d980 1 -- start start 2024-03-20T13:36:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5b006d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562199675150 0x562199675530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5b006d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5621995bf4c0 con 0x562199675a70 2024-03-20T13:36:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5b006d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5621995860f0 con 0x562199675150 2024-03-20T13:36:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5adb88640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562199675150 0x562199675530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5adb88640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562199675150 0x562199675530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53010/0 (socket says 172.21.15.123:53010) 2024-03-20T13:36:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5ad387640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x562199675a70 0x562199676430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58892/0 (socket says 172.21.15.123:58892) 2024-03-20T13:36:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5adb88640 1 -- 172.21.15.123:0/712565218 learned_addr learned my addr 172.21.15.123:0/712565218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5adb88640 1 -- 172.21.15.123:0/712565218 >> v1:172.21.15.89:6789/0 conn(0x562199675a70 legacy=0x562199676430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.318+0000 7ff5adb88640 1 -- 172.21.15.123:0/712565218 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562199676c60 con 0x562199675150 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5adb88640 1 --2- 172.21.15.123:0/712565218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199675530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000a5c0 tx=0x7ff5a001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4f8bb84d7e7e9c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5acb86640 1 -- 172.21.15.123:0/712565218 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00aa470 con 0x562199675150 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5acb86640 1 -- 172.21.15.123:0/712565218 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00aa5d0 con 0x562199675150 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5acb86640 1 -- 172.21.15.123:0/712565218 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00aa890 con 0x562199675150 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 -- 172.21.15.123:0/712565218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 msgr2=0x562199675530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 --2- 172.21.15.123:0/712565218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199675530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000a5c0 tx=0x7ff5a001b340 comp rx=0 tx=0).stop 2024-03-20T13:36:55.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 -- 172.21.15.123:0/712565218 shutdown_connections 2024-03-20T13:36:55.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 --2- 172.21.15.123:0/712565218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199675530 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 -- 172.21.15.123:0/712565218 >> 172.21.15.123:0/712565218 conn(0x5621995e88a0 msgr2=0x5621995e8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 -- 172.21.15.123:0/712565218 shutdown_connections 2024-03-20T13:36:55.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.322+0000 7ff5b006d980 1 -- 172.21.15.123:0/712565218 wait complete. 2024-03-20T13:36:55.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5b006d980 1 Processor -- start 2024-03-20T13:36:55.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5b006d980 1 -- start start 2024-03-20T13:36:55.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5b006d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x56219975f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5b006d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562199583620 con 0x562199675150 2024-03-20T13:36:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5adb88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x56219975f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5adb88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x56219975f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53020/0 (socket says 172.21.15.123:53020) 2024-03-20T13:36:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.334+0000 7ff5adb88640 1 -- 172.21.15.123:0/3432177433 learned_addr learned my addr 172.21.15.123:0/3432177433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 -- 172.21.15.123:0/3432177433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0005df0 con 0x562199675150 2024-03-20T13:36:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 --2- 172.21.15.123:0/3432177433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x56219975f6c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0018f70 tx=0x7ff5a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed882d3fd8889a49 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff49be07640 1 -- 172.21.15.123:0/3432177433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00aa9c0 con 0x562199675150 2024-03-20T13:36:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff49be07640 1 -- 172.21.15.123:0/3432177433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00aab20 con 0x562199675150 2024-03-20T13:36:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff49be07640 1 -- 172.21.15.123:0/3432177433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00aadc0 con 0x562199675150 2024-03-20T13:36:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/3432177433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 msgr2=0x56219975f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 --2- 172.21.15.123:0/3432177433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x56219975f6c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0018f70 tx=0x7ff5a0003030 comp rx=0 tx=0).stop 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/3432177433 shutdown_connections 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 --2- 172.21.15.123:0/3432177433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x56219975f6c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/3432177433 >> 172.21.15.123:0/3432177433 conn(0x5621995e88a0 msgr2=0x56219975b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/3432177433 shutdown_connections 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/3432177433 wait complete. 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 Processor -- start 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- start start 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199766470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56219957ee00 con 0x562199675150 2024-03-20T13:36:55.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199766470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199766470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53024/0 (socket says 172.21.15.123:53024) 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 -- 172.21.15.123:0/54166421 learned_addr learned my addr 172.21.15.123:0/54166421 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 -- 172.21.15.123:0/54166421 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562199676c60 con 0x562199675150 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5adb88640 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199766470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0018f70 tx=0x7ff5a00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff49a604640 1 -- 172.21.15.123:0/54166421 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00cb070 con 0x562199675150 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff49a604640 1 -- 172.21.15.123:0/54166421 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00c6690 con 0x562199675150 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621997669b0 con 0x562199675150 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff49a604640 1 -- 172.21.15.123:0/54166421 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00c6930 con 0x562199675150 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.338+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562199766de0 con 0x562199675150 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 Processor -- start 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- start start 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x562199773630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562199517e30 con 0x562199773210 2024-03-20T13:36:55.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff49a604640 1 -- 172.21.15.123:0/54166421 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff5a00c6b60 con 0x562199675150 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x562199773630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x562199773630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53036/0 (socket says 172.21.15.123:53036) 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 -- 172.21.15.123:0/3083364738 learned_addr learned my addr 172.21.15.123:0/3083364738 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff49a604640 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4940342b0 0x7ff494036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff49a604640 1 -- 172.21.15.123:0/54166421 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff5a00e4a10 con 0x562199675150 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5adb88640 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4940342b0 0x7ff494036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 -- 172.21.15.123:0/3083364738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562199773b70 con 0x562199773210 2024-03-20T13:36:55.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5adb88640 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4940342b0 0x7ff494036770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5a001b360 tx=0x7ff5a00c6af0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 --2- 172.21.15.123:0/3083364738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x562199773630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800a430 tx=0x7ff5a800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21b601ade1acfa server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff493fff640 1 -- 172.21.15.123:0/3083364738 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a800f6e0 con 0x562199773210 2024-03-20T13:36:55.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff493fff640 1 -- 172.21.15.123:0/3083364738 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a800f860 con 0x562199773210 2024-03-20T13:36:55.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff493fff640 1 -- 172.21.15.123:0/3083364738 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a800fb40 con 0x562199773210 2024-03-20T13:36:55.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- 172.21.15.123:0/3083364738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 msgr2=0x562199773630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 --2- 172.21.15.123:0/3083364738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x562199773630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800a430 tx=0x7ff5a800a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- 172.21.15.123:0/3083364738 shutdown_connections 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 --2- 172.21.15.123:0/3083364738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x562199773630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- 172.21.15.123:0/3083364738 >> 172.21.15.123:0/3083364738 conn(0x562199675a70 msgr2=0x56219976e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- 172.21.15.123:0/3083364738 shutdown_connections 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- 172.21.15.123:0/3083364738 wait complete. 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 Processor -- start 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- start start 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x56219977a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5b006d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56219950b790 con 0x562199773210 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x56219977a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x56219977a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53038/0 (socket says 172.21.15.123:53038) 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.342+0000 7ff5ae389640 1 -- 172.21.15.123:0/2746358695 learned_addr learned my addr 172.21.15.123:0/2746358695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5ae389640 1 -- 172.21.15.123:0/2746358695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a800a0e0 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5ae389640 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x56219977a160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x562199773ff0 tx=0x7ff5a8003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff4927fc640 1 -- 172.21.15.123:0/2746358695 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8010a20 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff4927fc640 1 -- 172.21.15.123:0/2746358695 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8010b80 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56219977a6a0 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff4927fc640 1 -- 172.21.15.123:0/2746358695 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a801a480 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56219977ab30 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff4927fc640 1 -- 172.21.15.123:0/2746358695 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff5a801a6f0 con 0x562199773210 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 1 Processor -- start 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 1 -- start start 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff4927fc640 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4880342b0 0x7ff488036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff4927fc640 1 -- 172.21.15.123:0/2746358695 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff5a8049e90 con 0x562199773210 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5ae389640 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4880342b0 0x7ff488036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 0x5621997942b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5b006d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621997947f0 con 0x562199793e90 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5ae389640 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4880342b0 0x7ff488036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5a801ab60 tx=0x7ff5a801a9f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5adb88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 0x5621997942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5adb88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 0x5621997942b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53050/0 (socket says 172.21.15.123:53050) 2024-03-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5adb88640 1 -- 172.21.15.123:0/664364311 learned_addr learned my addr 172.21.15.123:0/664364311 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5adb88640 1 -- 172.21.15.123:0/664364311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562199794930 con 0x562199793e90 2024-03-20T13:36:55.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.346+0000 7ff5adb88640 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 0x5621997942b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00abf40 tx=0x7ff5a00b34c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff4727e4640 1 -- 172.21.15.123:0/664364311 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00e9070 con 0x562199793e90 2024-03-20T13:36:55.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff4727e4640 1 -- 172.21.15.123:0/664364311 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a00bdc10 con 0x562199793e90 2024-03-20T13:36:55.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562199795330 con 0x562199793e90 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff4727e4640 1 -- 172.21.15.123:0/664364311 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5a00c6e10 con 0x562199793e90 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621997957c0 con 0x562199793e90 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff4727e4640 1 -- 172.21.15.123:0/664364311 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff5a00b3960 con 0x562199793e90 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff4727e4640 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3f0034260 0x7ff3f0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff4727e4640 1 -- 172.21.15.123:0/664364311 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff5a00f9ca0 con 0x562199793e90 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5ad387640 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3f0034260 0x7ff3f0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff3e3fff640 20 reqs_thread_entry: start 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562199798a70 0x56219979ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56219979b510 con 0x562199798a70 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5ad387640 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3f0034260 0x7ff3f0036720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000f70 tx=0x7ff5a4001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5ae389640 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562199798a70 0x56219979ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5ae389640 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562199798a70 0x56219979ae60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5ae389640 1 -- 172.21.15.123:0/54166421 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff5a8016020 con 0x562199798a70 2024-03-20T13:36:55.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.350+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56219979cd70 con 0x562199798a70 2024-03-20T13:36:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.354+0000 7ff5ae389640 1 -- 172.21.15.123:0/54166421 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(2 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff5a8016020 con 0x562199798a70 2024-03-20T13:36:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.354+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5621997a15b0 con 0x562199798a70 2024-03-20T13:36:55.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.354+0000 7ff5ae389640 1 -- 172.21.15.123:0/54166421 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [stat,call,call,writefull 0~874] v32'2 uv2 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7ff5a8016020 con 0x562199798a70 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4880342b0 msgr2=0x7ff488036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4880342b0 0x7ff488036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5a801ab60 tx=0x7ff5a801a9f0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 msgr2=0x56219977a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x56219977a160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x562199773ff0 tx=0x7ff5a8003380 comp rx=0 tx=0).stop 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 shutdown_connections 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4880342b0 0x7ff488036770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/2746358695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199773210 0x56219977a160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 >> 172.21.15.123:0/2746358695 conn(0x562199675a70 msgr2=0x56219976d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 shutdown_connections 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/2746358695 wait complete. 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3f0034260 msgr2=0x7ff3f0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3f0034260 0x7ff3f0036720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000f70 tx=0x7ff5a4001300 comp rx=0 tx=0).stop 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 msgr2=0x5621997942b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 0x5621997942b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00abf40 tx=0x7ff5a00b34c0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 shutdown_connections 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3f0034260 0x7ff3f0036720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/664364311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199793e90 0x5621997942b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 >> 172.21.15.123:0/664364311 conn(0x562199788c00 msgr2=0x562199789620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 shutdown_connections 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/664364311 wait complete. 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562199798a70 msgr2=0x56219979ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562199798a70 0x56219979ae60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4940342b0 msgr2=0x7ff494036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4940342b0 0x7ff494036770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5a001b360 tx=0x7ff5a00c6af0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 msgr2=0x562199766470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199766470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0018f70 tx=0x7ff5a00180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 shutdown_connections 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562199798a70 0x56219979ae60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff4940342b0 0x7ff494036770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 --2- 172.21.15.123:0/54166421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562199675150 0x562199766470 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 >> 172.21.15.123:0/54166421 conn(0x5621995e88a0 msgr2=0x562199759d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 shutdown_connections 2024-03-20T13:36:55.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.358+0000 7ff5b006d980 1 -- 172.21.15.123:0/54166421 wait complete. 2024-03-20T13:36:55.373 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:36:55.373 DEBUG:tasks.util.rgw: json result: {'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:36:55.375 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-03-20T13:36:55.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-03-20T13:36:55.375 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-03-20T13:36:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:55.444 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b86b65980 1 Processor -- start 2024-03-20T13:36:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b86b65980 1 -- start start 2024-03-20T13:36:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b86b65980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d2cb0e340 0x557d2cb10730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b86b65980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557d2ca56510 con 0x557d2ca7e8a0 2024-03-20T13:36:55.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b86b65980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557d2ca1d0f0 con 0x557d2cb0e340 2024-03-20T13:36:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b7be7f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d2cb0e340 0x557d2cb10730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b7be7f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d2cb0e340 0x557d2cb10730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53066/0 (socket says 172.21.15.123:53066) 2024-03-20T13:36:55.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b7be7f640 1 -- 172.21.15.123:0/4084918444 learned_addr learned my addr 172.21.15.123:0/4084918444 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b84680640 1 --1- 172.21.15.123:0/4084918444 >> v1:172.21.15.89:6789/0 conn(0x557d2ca7e8a0 0x557d2cb0cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58900/0 (socket says 172.21.15.123:58900) 2024-03-20T13:36:55.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b7be7f640 1 -- 172.21.15.123:0/4084918444 >> v1:172.21.15.89:6789/0 conn(0x557d2ca7e8a0 legacy=0x557d2cb0cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.438+0000 7f4b7be7f640 1 -- 172.21.15.123:0/4084918444 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2cb11cb0 con 0x557d2cb0e340 2024-03-20T13:36:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/4084918444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0e340 0x557d2cb10730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00a5c0 tx=0x7f4b6c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2075063644021233 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b83e7f640 1 -- 172.21.15.123:0/4084918444 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b6c0aa470 con 0x557d2cb0e340 2024-03-20T13:36:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b83e7f640 1 -- 172.21.15.123:0/4084918444 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0aa5d0 con 0x557d2cb0e340 2024-03-20T13:36:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b83e7f640 1 -- 172.21.15.123:0/4084918444 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b6c0aa890 con 0x557d2cb0e340 2024-03-20T13:36:55.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 -- 172.21.15.123:0/4084918444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0e340 msgr2=0x557d2cb10730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 --2- 172.21.15.123:0/4084918444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0e340 0x557d2cb10730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00a5c0 tx=0x7f4b6c01b340 comp rx=0 tx=0).stop 2024-03-20T13:36:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 -- 172.21.15.123:0/4084918444 shutdown_connections 2024-03-20T13:36:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 --2- 172.21.15.123:0/4084918444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0e340 0x557d2cb10730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 -- 172.21.15.123:0/4084918444 >> 172.21.15.123:0/4084918444 conn(0x557d2cb04700 msgr2=0x557d2cb06b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 -- 172.21.15.123:0/4084918444 shutdown_connections 2024-03-20T13:36:55.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.442+0000 7f4b86b65980 1 -- 172.21.15.123:0/4084918444 wait complete. 2024-03-20T13:36:55.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 Processor -- start 2024-03-20T13:36:55.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- start start 2024-03-20T13:36:55.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbf3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ca1a620 con 0x557d2ca7e8a0 2024-03-20T13:36:55.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbf3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbf3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53074/0 (socket says 172.21.15.123:53074) 2024-03-20T13:36:55.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 -- 172.21.15.123:0/1615418448 learned_addr learned my addr 172.21.15.123:0/1615418448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 -- 172.21.15.123:0/1615418448 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c005df0 con 0x557d2ca7e8a0 2024-03-20T13:36:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 --2- 172.21.15.123:0/1615418448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbf3e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4b74001cc0 tx=0x7f4b7400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174f7000e3473cda server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4a7260c640 1 -- 172.21.15.123:0/1615418448 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74014070 con 0x557d2ca7e8a0 2024-03-20T13:36:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4a7260c640 1 -- 172.21.15.123:0/1615418448 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7400f590 con 0x557d2ca7e8a0 2024-03-20T13:36:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4a7260c640 1 -- 172.21.15.123:0/1615418448 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74007040 con 0x557d2ca7e8a0 2024-03-20T13:36:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- 172.21.15.123:0/1615418448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 msgr2=0x557d2cbf3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1615418448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbf3e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4b74001cc0 tx=0x7f4b7400b610 comp rx=0 tx=0).stop 2024-03-20T13:36:55.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- 172.21.15.123:0/1615418448 shutdown_connections 2024-03-20T13:36:55.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1615418448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbf3e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- 172.21.15.123:0/1615418448 >> 172.21.15.123:0/1615418448 conn(0x557d2cb04700 msgr2=0x557d2cbef9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- 172.21.15.123:0/1615418448 shutdown_connections 2024-03-20T13:36:55.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- 172.21.15.123:0/1615418448 wait complete. 2024-03-20T13:36:55.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 Processor -- start 2024-03-20T13:36:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- start start 2024-03-20T13:36:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbfacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b86b65980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ca15e00 con 0x557d2ca7e8a0 2024-03-20T13:36:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbfacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbfacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53086/0 (socket says 172.21.15.123:53086) 2024-03-20T13:36:55.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 -- 172.21.15.123:0/124492517 learned_addr learned my addr 172.21.15.123:0/124492517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.458+0000 7f4b84680640 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2ca56510 con 0x557d2ca7e8a0 2024-03-20T13:36:55.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b84680640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbfacb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x557d2cbf4cf0 tx=0x7f4b74000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4a70e09640 1 -- 172.21.15.123:0/124492517 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74014030 con 0x557d2ca7e8a0 2024-03-20T13:36:55.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4a70e09640 1 -- 172.21.15.123:0/124492517 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7401c840 con 0x557d2ca7e8a0 2024-03-20T13:36:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d2cbfb1f0 con 0x557d2ca7e8a0 2024-03-20T13:36:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4a70e09640 1 -- 172.21.15.123:0/124492517 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7401cb40 con 0x557d2ca7e8a0 2024-03-20T13:36:55.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d2cbfb620 con 0x557d2ca7e8a0 2024-03-20T13:36:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4a70e09640 1 -- 172.21.15.123:0/124492517 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b7401cca0 con 0x557d2ca7e8a0 2024-03-20T13:36:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4a70e09640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a6c0342b0 0x7f4a6c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4a70e09640 1 -- 172.21.15.123:0/124492517 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4b74006070 con 0x557d2ca7e8a0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a6c0342b0 0x7f4a6c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cb0e340 0x557d2cc01930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc01e70 con 0x557d2cb0e340 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b84e81640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cb0e340 0x557d2cc01930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a6c0342b0 0x7f4a6c036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ae000 tx=0x7f4b6c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b84e81640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cb0e340 0x557d2cc01930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b84e81640 1 -- 172.21.15.123:0/124492517 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cb0e340 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc026e0 0x557d2cc04ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc05190 con 0x557d2cc026e0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b84680640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc026e0 0x557d2cc04ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.462+0000 7f4b84680640 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc026e0 0x557d2cc04ad0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84680640 1 -- 172.21.15.123:0/124492517 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc026e0 2024-03-20T13:36:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc069f0 con 0x557d2cc026e0 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84680640 1 -- 172.21.15.123:0/124492517 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc026e0 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc05bf0 con 0x557d2cc026e0 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84680640 1 -- 172.21.15.123:0/124492517 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc026e0 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc06000 con 0x557d2cb0e340 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84e81640 1 -- 172.21.15.123:0/124492517 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cb0e340 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 Processor -- start 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 -- start start 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 0x557d2cb08c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b86b65980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2c9aee30 con 0x557d2cb0a780 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84e81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 0x557d2cb08c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84e81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 0x557d2cb08c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53090/0 (socket says 172.21.15.123:53090) 2024-03-20T13:36:55.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84e81640 1 -- 172.21.15.123:0/2377258192 learned_addr learned my addr 172.21.15.123:0/2377258192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.466+0000 7f4b84e81640 1 -- 172.21.15.123:0/2377258192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2cb09160 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84e81640 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 0x557d2cb08c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c016cf0 tx=0x7f4b7c00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a69ffb640 1 -- 172.21.15.123:0/2377258192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c017660 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a69ffb640 1 -- 172.21.15.123:0/2377258192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0177c0 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d2cb093b0 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a69ffb640 1 -- 172.21.15.123:0/2377258192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c017a60 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d2cb09840 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a69ffb640 1 -- 172.21.15.123:0/2377258192 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b7c01d020 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a69ffb640 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a5c034300 0x7f4a5c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a69ffb640 1 -- 172.21.15.123:0/2377258192 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4b7c04b3f0 con 0x557d2cb0a780 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84680640 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a5c034300 0x7f4a5c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b86b65980 1 Processor -- start 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b86b65980 1 -- start start 2024-03-20T13:36:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84680640 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a5c034300 0x7f4a5c0367c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557d2cc056f0 tx=0x7f4b74018e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b86b65980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc24850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b86b65980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2c9a2790 con 0x557d2cc24430 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84e81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc24850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84e81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc24850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53104/0 (socket says 172.21.15.123:53104) 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84e81640 1 -- 172.21.15.123:0/3903491564 learned_addr learned my addr 172.21.15.123:0/3903491564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84e81640 1 -- 172.21.15.123:0/3903491564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2cc24e20 con 0x557d2cc24430 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4b84e81640 1 --2- 172.21.15.123:0/3903491564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc24850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c049910 tx=0x7f4b7c049a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6be12e556a94d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a637fe640 1 -- 172.21.15.123:0/3903491564 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c048070 con 0x557d2cc24430 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a637fe640 1 -- 172.21.15.123:0/3903491564 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c04b200 con 0x557d2cc24430 2024-03-20T13:36:55.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.470+0000 7f4a637fe640 1 -- 172.21.15.123:0/3903491564 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c03b460 con 0x557d2cc24430 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/3903491564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 msgr2=0x557d2cc24850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 --2- 172.21.15.123:0/3903491564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc24850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c049910 tx=0x7f4b7c049a00 comp rx=0 tx=0).stop 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/3903491564 shutdown_connections 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 --2- 172.21.15.123:0/3903491564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc24850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/3903491564 >> 172.21.15.123:0/3903491564 conn(0x557d2cc207c0 msgr2=0x557d2cc1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/3903491564 shutdown_connections 2024-03-20T13:36:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/3903491564 wait complete. 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 Processor -- start 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- start start 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc2b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cc2b840 con 0x557d2cc24430 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b84e81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc2b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b84e81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc2b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53116/0 (socket says 172.21.15.123:53116) 2024-03-20T13:36:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 learned_addr learned my addr 172.21.15.123:0/1888481824 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2cb09840 con 0x557d2cc24430 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b84e81640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc2b300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c014c70 tx=0x7f4b7c0496b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4a61ffb640 1 -- 172.21.15.123:0/1888481824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c0286d0 con 0x557d2cc24430 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d2cc2ba40 con 0x557d2cc24430 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4a61ffb640 1 -- 172.21.15.123:0/1888481824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c028830 con 0x557d2cc24430 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4a61ffb640 1 -- 172.21.15.123:0/1888481824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c048070 con 0x557d2cc24430 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d2cc2be70 con 0x557d2cc24430 2024-03-20T13:36:55.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4a61ffb640 1 -- 172.21.15.123:0/1888481824 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b7c0481d0 con 0x557d2cc24430 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4a61ffb640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a540342b0 0x7f4a54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4a61ffb640 1 -- 172.21.15.123:0/1888481824 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4b7c04d8c0 con 0x557d2cc24430 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b84680640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a540342b0 0x7f4a54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cc36a40 0x557d2cc38f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc39650 con 0x557d2cc36a40 2024-03-20T13:36:55.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.474+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cc36a40 0x557d2cc38f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84680640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a540342b0 0x7f4a54036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b74013fd0 tx=0x7f4b74031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cc36a40 0x557d2cc38f00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 realm 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc39a40 con 0x557d2cc36a40 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc3a290 con 0x557d2cc36a40 2024-03-20T13:36:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc3ac70 0x557d2cc3d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc3d810 con 0x557d2cc3ac70 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84e81640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc3ac70 0x557d2cc3d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84e81640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc3ac70 0x557d2cc3d0a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cc3ac70 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc3e060 con 0x557d2cc3ac70 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cc3ac70 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 20 searching for the correct realm 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557d2cc3fd80 0x557d2cc42170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84680640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557d2cc3fd80 0x557d2cc42170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84680640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557d2cc3fd80 0x557d2cc42170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.478+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cc3ac70 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84e81640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b7c01fc20 0x7f4b7c04b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x7f4b7c01fc20 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b7c01fc20 0x7f4b7c04b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b7c01fc20 0x7f4b7c04b650 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x7f4b7c01fc20 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cc3ac70 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.482+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c00a4d0 con 0x557d2cc3ac70 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x7f4b7c01fc20 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x7f4b7c01fc20 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x7f4b7c01fc20 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4b6c0b0020 con 0x7f4b7c01fc20 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0b0020 con 0x557d2cc36a40 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.486+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x7f4b7c01fc20 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc36a40 2024-03-20T13:36:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x7f4b7c01fc20 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x7f4b7c01fc20 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3fd80 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.490+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42700 con 0x557d2cc3ac70 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc3e960 con 0x557d2cc36a40 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc3ed40 con 0x557d2cc3ac70 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc3f120 con 0x557d2cc36a40 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 zone default found 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 4 Realm: () 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 zonegroup default 2024-03-20T13:36:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc42b40 con 0x7f4b7c01fc20 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc44d20 con 0x557d2cc3fd80 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc45080 con 0x557d2cc3fd80 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 started sync module instance, tier type = 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.494+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc442f0 con 0x557d2cc3ac70 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996110333600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc442f0 con 0x557d2cc3ac70 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc459f0 con 0x557d2cc36a40 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996110337360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc45970 con 0x557d2cc36a40 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc468d0 con 0x557d2cc3ac70 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996110337360] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.498+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996110333600] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996110331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc46890 con 0x557d2cc3ac70 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc47120 con 0x7f4b7c01fc20 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996110343296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc46890 con 0x7f4b7c01fc20 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc47c70 con 0x557d2cc3ac70 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996110331472] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.502+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996110343296] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996110344352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc47c70 con 0x557d2cc3ac70 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc48020 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996110341040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc48820 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc492c0 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996110344352] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996110341040] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996110351776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc48380 con 0x557d2cc3fd80 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.506+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc49b10 con 0x7f4b7c01fc20 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996110354032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc49f30 con 0x7f4b7c01fc20 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=0 2024-03-20T13:36:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996110351776] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=1 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=2 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=3 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=4 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=5 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=6 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996110354032] v32'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 20 add_watcher() i=7 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc4cf60 con 0x557d2cc36a40 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.510+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996110355088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc4a350 con 0x557d2cc36a40 2024-03-20T13:36:55.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996110355088] v32'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4a3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:55.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:55.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 5 note: GC not initialized 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4a397e2640 20 reqs_thread_entry: start 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 20 Filter name: none 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f49aaffd640 20 reqs_thread_entry: start 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.514+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x7f4b7c01fc20 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x7f4b7c01fc20 2024-03-20T13:36:55.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.518+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.522+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3fd80 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc3ac70 2024-03-20T13:36:55.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc6f340 con 0x557d2cc36a40 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4a3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.526+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996110355088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc4f300 con 0x557d2cc36a40 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93996110355088] v32'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996110333600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc4f300 con 0x557d2cc3ac70 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93996110333600] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b86b65980 20 remove_watcher() i=0 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b86b65980 2 removed watcher, disabling cache 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996110337360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc446a0 con 0x557d2cc36a40 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93996110337360] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x557d2cc36a40 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b86b65980 20 remove_watcher() i=1 2024-03-20T13:36:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.530+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996110331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc446a0 con 0x557d2cc3ac70 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.534+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93996110331472] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.534+0000 7f4b86b65980 20 remove_watcher() i=2 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.534+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996110343296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc43e50 con 0x7f4b7c01fc20 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.534+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93996110343296] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.534+0000 7f4b86b65980 20 remove_watcher() i=3 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.534+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996110344352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc46c80 con 0x557d2cc3ac70 2024-03-20T13:36:55.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.538+0000 7f4b84e81640 1 -- 172.21.15.123:0/1888481824 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93996110344352] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b7c063040 con 0x557d2cc3ac70 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.538+0000 7f4b86b65980 20 remove_watcher() i=4 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.538+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996110341040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc45550 con 0x557d2cc3fd80 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.538+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93996110341040] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.538+0000 7f4b86b65980 20 remove_watcher() i=5 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.538+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996110351776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc45550 con 0x557d2cc3fd80 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b84680640 1 -- 172.21.15.123:0/1888481824 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93996110351776] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b74016070 con 0x557d2cc3fd80 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 20 remove_watcher() i=6 2024-03-20T13:36:55.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996110354032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d2cc45550 con 0x7f4b7c01fc20 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93996110354032] v32'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b6c0d5060 con 0x7f4b7c01fc20 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 20 remove_watcher() i=7 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc3ac70 msgr2=0x557d2cc3d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc3ac70 0x557d2cc3d0a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cc36a40 msgr2=0x557d2cc38f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cc36a40 0x557d2cc38f00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b7c01fc20 msgr2=0x7f4b7c04b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b7c01fc20 0x7f4b7c04b650 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557d2cc3fd80 msgr2=0x557d2cc42170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557d2cc3fd80 0x557d2cc42170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a540342b0 msgr2=0x7f4a54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a540342b0 0x7f4a54036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b74013fd0 tx=0x7f4b74031000 comp rx=0 tx=0).stop 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 msgr2=0x557d2cc2b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 --2- 172.21.15.123:0/1888481824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cc24430 0x557d2cc2b300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c014c70 tx=0x7f4b7c0496b0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 reap_dead start 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b7be7f640 1 -- 172.21.15.123:0/1888481824 reap_dead start 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 shutdown_connections 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 >> 172.21.15.123:0/1888481824 conn(0x557d2cc207c0 msgr2=0x557d2cc1de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 shutdown_connections 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.542+0000 7f4b86b65980 1 -- 172.21.15.123:0/1888481824 wait complete. 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a5c034300 msgr2=0x7f4a5c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a5c034300 0x7f4a5c0367c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557d2cc056f0 tx=0x7f4b74018e50 comp rx=0 tx=0).stop 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 msgr2=0x557d2cb08c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 0x557d2cb08c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c016cf0 tx=0x7f4b7c00d790 comp rx=0 tx=0).stop 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 shutdown_connections 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a5c034300 0x7f4a5c0367c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/2377258192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2cb0a780 0x557d2cb08c20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 >> 172.21.15.123:0/2377258192 conn(0x557d2cc09ee0 msgr2=0x557d2cc0a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 shutdown_connections 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/2377258192 wait complete. 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc026e0 msgr2=0x557d2cc04ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc026e0 0x557d2cc04ad0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cb0e340 msgr2=0x557d2cc01930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cb0e340 0x557d2cc01930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a6c0342b0 msgr2=0x7f4a6c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a6c0342b0 0x7f4a6c036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ae000 tx=0x7f4b6c0a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 msgr2=0x557d2cbfacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbfacb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x557d2cbf4cf0 tx=0x7f4b74000bd0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 shutdown_connections 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557d2cc026e0 0x557d2cc04ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557d2cb0e340 0x557d2cc01930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a6c0342b0 0x7f4a6c036770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 --2- 172.21.15.123:0/124492517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2ca7e8a0 0x557d2cbfacb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 >> 172.21.15.123:0/124492517 conn(0x557d2cb04700 msgr2=0x557d2cbee500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 shutdown_connections 2024-03-20T13:36:55.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.546+0000 7f4b86b65980 1 -- 172.21.15.123:0/124492517 wait complete. 2024-03-20T13:36:55.560 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[],"summary":[]} 2024-03-20T13:36:55.560 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-03-20T13:36:55.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:55.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:55.560 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:55.639 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:55.640 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:55.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b29308980 1 Processor -- start 2024-03-20T13:36:55.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b29308980 1 -- start start 2024-03-20T13:36:55.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b29308980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5585e16d33c0 0x5585e16d37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b29308980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5585e1621520 con 0x5585e16d3ce0 2024-03-20T13:36:55.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b29308980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5585e15e80f0 con 0x5585e16d33c0 2024-03-20T13:36:55.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b26e23640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5585e16d33c0 0x5585e16d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b26e23640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5585e16d33c0 0x5585e16d37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53128/0 (socket says 172.21.15.123:53128) 2024-03-20T13:36:55.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b26e23640 1 -- 172.21.15.123:0/33864886 learned_addr learned my addr 172.21.15.123:0/33864886 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b26622640 1 --1- 172.21.15.123:0/33864886 >> v1:172.21.15.89:6789/0 conn(0x5585e16d3ce0 0x5585e16da4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58904/0 (socket says 172.21.15.123:58904) 2024-03-20T13:36:55.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b26e23640 1 -- 172.21.15.123:0/33864886 >> v1:172.21.15.89:6789/0 conn(0x5585e16d3ce0 legacy=0x5585e16da4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.634+0000 7f1b26e23640 1 -- 172.21.15.123:0/33864886 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e16dccc0 con 0x5585e16d33c0 2024-03-20T13:36:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b26e23640 1 --2- 172.21.15.123:0/33864886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e16d37a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800a5c0 tx=0x7f1b1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5a38c8072624f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b25e21640 1 -- 172.21.15.123:0/33864886 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b180aa470 con 0x5585e16d33c0 2024-03-20T13:36:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b25e21640 1 -- 172.21.15.123:0/33864886 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b180aa5d0 con 0x5585e16d33c0 2024-03-20T13:36:55.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b25e21640 1 -- 172.21.15.123:0/33864886 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b180aa890 con 0x5585e16d33c0 2024-03-20T13:36:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 -- 172.21.15.123:0/33864886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 msgr2=0x5585e16d37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 --2- 172.21.15.123:0/33864886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e16d37a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800a5c0 tx=0x7f1b1801b340 comp rx=0 tx=0).stop 2024-03-20T13:36:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 -- 172.21.15.123:0/33864886 shutdown_connections 2024-03-20T13:36:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 --2- 172.21.15.123:0/33864886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e16d37a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 -- 172.21.15.123:0/33864886 >> 172.21.15.123:0/33864886 conn(0x5585e16cee50 msgr2=0x5585e16d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 -- 172.21.15.123:0/33864886 shutdown_connections 2024-03-20T13:36:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.638+0000 7f1b29308980 1 -- 172.21.15.123:0/33864886 wait complete. 2024-03-20T13:36:55.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.650+0000 7f1b29308980 1 Processor -- start 2024-03-20T13:36:55.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.650+0000 7f1b29308980 1 -- start start 2024-03-20T13:36:55.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.650+0000 7f1b29308980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.650+0000 7f1b29308980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e15e5620 con 0x5585e16d33c0 2024-03-20T13:36:55.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53136/0 (socket says 172.21.15.123:53136) 2024-03-20T13:36:55.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 -- 172.21.15.123:0/3405731739 learned_addr learned my addr 172.21.15.123:0/3405731739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 -- 172.21.15.123:0/3405731739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18005df0 con 0x5585e16d33c0 2024-03-20T13:36:55.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 --2- 172.21.15.123:0/3405731739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17beec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b18018f70 tx=0x7f1b18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309fadccc418d96f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1a14e09640 1 -- 172.21.15.123:0/3405731739 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b180aa9c0 con 0x5585e16d33c0 2024-03-20T13:36:55.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1a14e09640 1 -- 172.21.15.123:0/3405731739 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b180aab20 con 0x5585e16d33c0 2024-03-20T13:36:55.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1a14e09640 1 -- 172.21.15.123:0/3405731739 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b180aadc0 con 0x5585e16d33c0 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- 172.21.15.123:0/3405731739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 msgr2=0x5585e17beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 --2- 172.21.15.123:0/3405731739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17beec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b18018f70 tx=0x7f1b18003030 comp rx=0 tx=0).stop 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- 172.21.15.123:0/3405731739 shutdown_connections 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 --2- 172.21.15.123:0/3405731739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17beec0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- 172.21.15.123:0/3405731739 >> 172.21.15.123:0/3405731739 conn(0x5585e16cee50 msgr2=0x5585e17baa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- 172.21.15.123:0/3405731739 shutdown_connections 2024-03-20T13:36:55.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- 172.21.15.123:0/3405731739 wait complete. 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 Processor -- start 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- start start 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b29308980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e15e0e00 con 0x5585e16d33c0 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53144/0 (socket says 172.21.15.123:53144) 2024-03-20T13:36:55.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 -- 172.21.15.123:0/1907907085 learned_addr learned my addr 172.21.15.123:0/1907907085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e16dccc0 con 0x5585e16d33c0 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.654+0000 7f1b26e23640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17c5c10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1b18018f70 tx=0x7f1b180180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1a13606640 1 -- 172.21.15.123:0/1907907085 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b180cb070 con 0x5585e16d33c0 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5585e17c6150 con 0x5585e16d33c0 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585e17c6520 con 0x5585e16d33c0 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1a13606640 1 -- 172.21.15.123:0/1907907085 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b180bd810 con 0x5585e16d33c0 2024-03-20T13:36:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1a13606640 1 -- 172.21.15.123:0/1907907085 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b180bdab0 con 0x5585e16d33c0 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1a13606640 1 -- 172.21.15.123:0/1907907085 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1b180bdc10 con 0x5585e16d33c0 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1a13606640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a0c0342b0 0x7f1a0c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1a13606640 1 -- 172.21.15.123:0/1907907085 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1b180e4a30 con 0x5585e16d33c0 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b26622640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a0c0342b0 0x7f1a0c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e16d3ce0 0x5585e17cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e17ccd80 con 0x5585e16d3ce0 2024-03-20T13:36:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b27624640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e16d3ce0 0x5585e17cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b26622640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a0c0342b0 0x7f1a0c036770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b10000f70 tx=0x7f1b10001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b27624640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e16d3ce0 0x5585e17cc840 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b27624640 1 -- 172.21.15.123:0/1907907085 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e16d3ce0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e17cd5f0 0x5585e17cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e17d0090 con 0x5585e17cd5f0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b26e23640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e17cd5f0 0x5585e17cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.658+0000 7f1b26e23640 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e17cd5f0 0x5585e17cf9e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b26e23640 1 -- 172.21.15.123:0/1907907085 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e17cd5f0 2024-03-20T13:36:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e17d18f0 con 0x5585e17cd5f0 2024-03-20T13:36:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b26e23640 1 -- 172.21.15.123:0/1907907085 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e17cd5f0 2024-03-20T13:36:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e17d0af0 con 0x5585e17cd5f0 2024-03-20T13:36:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b26e23640 1 -- 172.21.15.123:0/1907907085 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e17cd5f0 2024-03-20T13:36:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e17d0f00 con 0x5585e16d3ce0 2024-03-20T13:36:55.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b27624640 1 -- 172.21.15.123:0/1907907085 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e16d3ce0 2024-03-20T13:36:55.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 Processor -- start 2024-03-20T13:36:55.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 -- start start 2024-03-20T13:36:55.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 0x5585e17e03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b29308980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e1579e30 con 0x5585e17dffd0 2024-03-20T13:36:55.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b27624640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 0x5585e17e03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b27624640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 0x5585e17e03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53148/0 (socket says 172.21.15.123:53148) 2024-03-20T13:36:55.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.662+0000 7f1b27624640 1 -- 172.21.15.123:0/790173271 learned_addr learned my addr 172.21.15.123:0/790173271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 -- 172.21.15.123:0/790173271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e17e0930 con 0x5585e17dffd0 2024-03-20T13:36:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 0x5585e17e03f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b20016cf0 tx=0x7f1b2000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a10e01640 1 -- 172.21.15.123:0/790173271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b20017660 con 0x5585e17dffd0 2024-03-20T13:36:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5585e17e0b80 con 0x5585e17dffd0 2024-03-20T13:36:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585e17e16d0 con 0x5585e17dffd0 2024-03-20T13:36:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a10e01640 1 -- 172.21.15.123:0/790173271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b200177c0 con 0x5585e17dffd0 2024-03-20T13:36:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a10e01640 1 -- 172.21.15.123:0/790173271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b20017a60 con 0x5585e17dffd0 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a10e01640 1 -- 172.21.15.123:0/790173271 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1b2001d020 con 0x5585e17dffd0 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a10e01640 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a000342b0 0x7f1a00036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a10e01640 1 -- 172.21.15.123:0/790173271 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1b2004b540 con 0x5585e17dffd0 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b26e23640 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a000342b0 0x7f1a00036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b29308980 1 Processor -- start 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b29308980 1 -- start start 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b26e23640 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a000342b0 0x7f1a00036770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5585e17d05f0 tx=0x7f1b180e2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b29308980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17ed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b29308980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e156d790 con 0x5585e17ecf20 2024-03-20T13:36:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17ed340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53152/0 (socket says 172.21.15.123:53152) 2024-03-20T13:36:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 -- 172.21.15.123:0/3440425256 learned_addr learned my addr 172.21.15.123:0/3440425256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 -- 172.21.15.123:0/3440425256 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e17ed910 con 0x5585e17ecf20 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1b27624640 1 --2- 172.21.15.123:0/3440425256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17ed340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b20015010 tx=0x7f1b200206d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4b3cac99cf816a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.666+0000 7f1a0a7fc640 1 -- 172.21.15.123:0/3440425256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b20011cb0 con 0x5585e17ecf20 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a0a7fc640 1 -- 172.21.15.123:0/3440425256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20011e10 con 0x5585e17ecf20 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a0a7fc640 1 -- 172.21.15.123:0/3440425256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b2004b0d0 con 0x5585e17ecf20 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3440425256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 msgr2=0x5585e17ed340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 --2- 172.21.15.123:0/3440425256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17ed340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b20015010 tx=0x7f1b200206d0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3440425256 shutdown_connections 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 --2- 172.21.15.123:0/3440425256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17ed340 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3440425256 >> 172.21.15.123:0/3440425256 conn(0x5585e17e92b0 msgr2=0x5585e17e7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3440425256 shutdown_connections 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3440425256 wait complete. 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 Processor -- start 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- start start 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e17f4300 con 0x5585e17ecf20 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b27624640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b27624640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53164/0 (socket says 172.21.15.123:53164) 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 learned_addr learned my addr 172.21.15.123:0/3299821300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e17e16d0 con 0x5585e17ecf20 2024-03-20T13:36:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b27624640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17f3dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b20029e60 tx=0x7f1b200498c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a08ff9640 1 -- 172.21.15.123:0/3299821300 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b20031070 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5585e17f4500 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585e17f4930 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a08ff9640 1 -- 172.21.15.123:0/3299821300 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20049c80 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a08ff9640 1 -- 172.21.15.123:0/3299821300 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b20048130 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a08ff9640 1 -- 172.21.15.123:0/3299821300 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1b20048290 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a08ff9640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f19f00342b0 0x7f19f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1a08ff9640 1 -- 172.21.15.123:0/3299821300 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1b20037c80 con 0x5585e17ecf20 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b26e23640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f19f00342b0 0x7f19f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.670+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e17ff4c0 0x5585e1801960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e18020b0 con 0x5585e17ff4c0 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b26622640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e17ff4c0 0x5585e1801960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b26e23640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f19f00342b0 0x7f19f0036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b180c6fd0 tx=0x7f1b1801b340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b26622640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e17ff4c0 0x5585e1801960 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 realm 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e17fe9a0 con 0x5585e17ff4c0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1802b30 con 0x5585e17ff4c0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e18036a0 0x5585e1805b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e18062d0 con 0x5585e18036a0 2024-03-20T13:36:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b27624640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e18036a0 0x5585e1805b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b27624640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e18036a0 0x5585e1805b60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e18036a0 2024-03-20T13:36:55.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1806b20 con 0x5585e18036a0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e18036a0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.674+0000 7f1b29308980 20 searching for the correct realm 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5585e1808840 0x5585e180ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e1808840 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26e23640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5585e1808840 0x5585e180ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26e23640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5585e1808840 0x5585e180ac30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e18036a0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e18036a0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b27624640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1b20018bd0 0x7f1b20013800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x7f1b20018bd0 2024-03-20T13:36:55.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1b20018bd0 0x7f1b20013800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1b20018bd0 0x7f1b20013800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e17ff4c0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e17ff4c0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e1808840 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e17ff4c0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e18036a0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e18036a0 2024-03-20T13:36:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.678+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e18036a0 2024-03-20T13:36:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b2000a4d0 con 0x5585e18036a0 2024-03-20T13:36:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e17ff4c0 2024-03-20T13:36:55.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x7f1b20018bd0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b1c0 con 0x5585e17ff4c0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x7f1b20018bd0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e18036a0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e1808840 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e17ff4c0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e18036a0 2024-03-20T13:36:55.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e1808840 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.682+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e17ff4c0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e17ff4c0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e17ff4c0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e1808840 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x7f1b20018bd0 2024-03-20T13:36:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e17ff4c0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x7f1b20018bd0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e1808840 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x7f1b20018bd0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e18036a0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e18036a0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e1808840 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.686+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e18036a0 2024-03-20T13:36:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1b1002d080 con 0x5585e18036a0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1807420 con 0x5585e17ff4c0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1807860 con 0x5585e18036a0 2024-03-20T13:36:55.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1807c40 con 0x5585e17ff4c0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 zone default found 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 4 Realm: () 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 zonegroup default 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180b650 con 0x7f1b20018bd0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180d830 con 0x5585e1808840 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180db90 con 0x5585e1808840 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 started sync module instance, tier type = 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.690+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180ce00 con 0x5585e18036a0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94033502327216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180ce00 con 0x5585e18036a0 2024-03-20T13:36:55.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180e540 con 0x5585e17ff4c0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94033502330976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180e980 con 0x5585e17ff4c0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180f440 con 0x5585e18036a0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.694+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94033502327216] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94033502330976] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94033502332032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180f400 con 0x5585e18036a0 2024-03-20T13:36:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180fc90 con 0x7f1b20018bd0 2024-03-20T13:36:55.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94033502337008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e180f400 con 0x7f1b20018bd0 2024-03-20T13:36:55.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.698+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1810720 con 0x5585e18036a0 2024-03-20T13:36:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.702+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94033502337008] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.702+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94033502332032] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.702+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.702+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94033502334720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e18106e0 con 0x5585e18036a0 2024-03-20T13:36:55.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.702+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1810b00 con 0x5585e1808840 2024-03-20T13:36:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94033502338064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1811300 con 0x5585e1808840 2024-03-20T13:36:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1811d00 con 0x5585e1808840 2024-03-20T13:36:55.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94033502345216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1812220 con 0x5585e1808840 2024-03-20T13:36:55.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1812cf0 con 0x7f1b20018bd0 2024-03-20T13:36:55.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.706+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94033502334720] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.710+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94033502338064] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94033502345216] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94033502342752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1812cb0 con 0x7f1b20018bd0 2024-03-20T13:36:55.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=0 2024-03-20T13:36:55.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=1 2024-03-20T13:36:55.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=2 2024-03-20T13:36:55.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=3 2024-03-20T13:36:55.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=4 2024-03-20T13:36:55.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=5 2024-03-20T13:36:55.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=6 2024-03-20T13:36:55.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94033502342752] v32'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 20 add_watcher() i=7 2024-03-20T13:36:55.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:55.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1811cc0 con 0x5585e17ff4c0 2024-03-20T13:36:55.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.714+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94033502339616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1811d30 con 0x5585e17ff4c0 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94033502339616] v32'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f19dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 5 note: GC not initialized 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1957fff640 20 reqs_thread_entry: start 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 20 Filter name: none 2024-03-20T13:36:55.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1955ffb640 20 reqs_thread_entry: start 2024-03-20T13:36:55.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e18371c0 con 0x5585e17ff4c0 2024-03-20T13:36:55.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.718+0000 7f1b29308980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.727 INFO:teuthology.orchestra.run.smithi123.stderr:could not fetch user info: no user info saved 2024-03-20T13:36:55.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.722+0000 7f19dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.722+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94033502339616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e17ff4c0 2024-03-20T13:36:55.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.722+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94033502339616] v32'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.722+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94033502327216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e18036a0 2024-03-20T13:36:55.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94033502327216] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b29308980 20 remove_watcher() i=0 2024-03-20T13:36:55.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b29308980 2 removed watcher, disabling cache 2024-03-20T13:36:55.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94033502330976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e17ff4c0 2024-03-20T13:36:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94033502330976] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x5585e17ff4c0 2024-03-20T13:36:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b29308980 20 remove_watcher() i=1 2024-03-20T13:36:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.726+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94033502332032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e18036a0 2024-03-20T13:36:55.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.730+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94033502332032] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.730+0000 7f1b29308980 20 remove_watcher() i=2 2024-03-20T13:36:55.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.730+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94033502337008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x7f1b20018bd0 2024-03-20T13:36:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.730+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94033502337008] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.730+0000 7f1b29308980 20 remove_watcher() i=3 2024-03-20T13:36:55.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.730+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94033502334720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e18036a0 2024-03-20T13:36:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.734+0000 7f1b27624640 1 -- 172.21.15.123:0/3299821300 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94033502334720] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b20064040 con 0x5585e18036a0 2024-03-20T13:36:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.734+0000 7f1b29308980 20 remove_watcher() i=4 2024-03-20T13:36:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.734+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94033502338064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e1808840 2024-03-20T13:36:55.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.734+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94033502338064] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.734+0000 7f1b29308980 20 remove_watcher() i=5 2024-03-20T13:36:55.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.734+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94033502345216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x5585e1808840 2024-03-20T13:36:55.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.738+0000 7f1b26e23640 1 -- 172.21.15.123:0/3299821300 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94033502345216] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b180cd070 con 0x5585e1808840 2024-03-20T13:36:55.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.738+0000 7f1b29308980 20 remove_watcher() i=6 2024-03-20T13:36:55.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.738+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94033502342752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585e1837180 con 0x7f1b20018bd0 2024-03-20T13:36:55.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94033502342752] v32'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b1000f620 con 0x7f1b20018bd0 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 20 remove_watcher() i=7 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e18036a0 msgr2=0x5585e1805b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e18036a0 0x5585e1805b60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e17ff4c0 msgr2=0x5585e1801960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e17ff4c0 0x5585e1801960 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1b20018bd0 msgr2=0x7f1b20013800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1b20018bd0 0x7f1b20013800 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5585e1808840 msgr2=0x5585e180ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5585e1808840 0x5585e180ac30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f19f00342b0 msgr2=0x7f19f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f19f00342b0 0x7f19f0036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b180c6fd0 tx=0x7f1b1801b340 comp rx=0 tx=0).stop 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 msgr2=0x5585e17f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b26622640 1 -- 172.21.15.123:0/3299821300 reap_dead start 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17f3dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b20029e60 tx=0x7f1b200498c0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 shutdown_connections 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/3299821300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17ecf20 0x5585e17f3dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 >> 172.21.15.123:0/3299821300 conn(0x5585e17e92b0 msgr2=0x5585e17e6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 shutdown_connections 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/3299821300 wait complete. 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a000342b0 msgr2=0x7f1a00036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a000342b0 0x7f1a00036770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5585e17d05f0 tx=0x7f1b180e2040 comp rx=0 tx=0).stop 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 msgr2=0x5585e17e03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 0x5585e17e03f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b20016cf0 tx=0x7f1b2000d790 comp rx=0 tx=0).stop 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 shutdown_connections 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a000342b0 0x7f1a00036770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/790173271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e17dffd0 0x5585e17e03f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 >> 172.21.15.123:0/790173271 conn(0x5585e17d4de0 msgr2=0x5585e17d58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 shutdown_connections 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/790173271 wait complete. 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e17cd5f0 msgr2=0x5585e17cf9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e17cd5f0 0x5585e17cf9e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e16d3ce0 msgr2=0x5585e17cc840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e16d3ce0 0x5585e17cc840 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a0c0342b0 msgr2=0x7f1a0c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a0c0342b0 0x7f1a0c036770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b10000f70 tx=0x7f1b10001380 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 msgr2=0x5585e17c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17c5c10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1b18018f70 tx=0x7f1b180180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 shutdown_connections 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5585e17cd5f0 0x5585e17cf9e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5585e16d3ce0 0x5585e17cc840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1a0c0342b0 0x7f1a0c036770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 --2- 172.21.15.123:0/1907907085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5585e16d33c0 0x5585e17c5c10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 >> 172.21.15.123:0/1907907085 conn(0x5585e16cee50 msgr2=0x5585e17b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 shutdown_connections 2024-03-20T13:36:55.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.742+0000 7f1b29308980 1 -- 172.21.15.123:0/1907907085 wait complete. 2024-03-20T13:36:55.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-20T13:36:55.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-03-20T13:36:55.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-03-20T13:36:55.757 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-03-20T13:36:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:55.841 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8f14a980 1 Processor -- start 2024-03-20T13:36:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8f14a980 1 -- start start 2024-03-20T13:36:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8f14a980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5592bb40b3f0 0x5592bb40d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8f14a980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5592bb3534c0 con 0x5592bb406ee0 2024-03-20T13:36:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8f14a980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5592bb31a0f0 con 0x5592bb40b3f0 2024-03-20T13:36:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8c464640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5592bb40b3f0 0x5592bb40d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8c464640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5592bb40b3f0 0x5592bb40d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53174/0 (socket says 172.21.15.123:53174) 2024-03-20T13:36:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8cc65640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5592bb406ee0 0x5592bb4072c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58908/0 (socket says 172.21.15.123:58908) 2024-03-20T13:36:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8c464640 1 -- 172.21.15.123:0/2766857130 learned_addr learned my addr 172.21.15.123:0/2766857130 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8c464640 1 -- 172.21.15.123:0/2766857130 >> v1:172.21.15.89:6789/0 conn(0x5592bb406ee0 legacy=0x5592bb4072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8c464640 1 -- 172.21.15.123:0/2766857130 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bb40ed30 con 0x5592bb40b3f0 2024-03-20T13:36:55.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8c464640 1 --2- 172.21.15.123:0/2766857130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb40b3f0 0x5592bb40d7e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400a5c0 tx=0x7f8d8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05faae2f01d5751 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.838+0000 7f8d8bc63640 1 -- 172.21.15.123:0/2766857130 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d840aa470 con 0x5592bb40b3f0 2024-03-20T13:36:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8bc63640 1 -- 172.21.15.123:0/2766857130 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d840aa5d0 con 0x5592bb40b3f0 2024-03-20T13:36:55.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8bc63640 1 -- 172.21.15.123:0/2766857130 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d840aa890 con 0x5592bb40b3f0 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 -- 172.21.15.123:0/2766857130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb40b3f0 msgr2=0x5592bb40d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/2766857130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb40b3f0 0x5592bb40d7e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400a5c0 tx=0x7f8d8401b340 comp rx=0 tx=0).stop 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 -- 172.21.15.123:0/2766857130 shutdown_connections 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/2766857130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb40b3f0 0x5592bb40d7e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 -- 172.21.15.123:0/2766857130 >> 172.21.15.123:0/2766857130 conn(0x5592bb4027b0 msgr2=0x5592bb404bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 -- 172.21.15.123:0/2766857130 shutdown_connections 2024-03-20T13:36:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.842+0000 7f8d8f14a980 1 -- 172.21.15.123:0/2766857130 wait complete. 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8f14a980 1 Processor -- start 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8f14a980 1 -- start start 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8f14a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb37ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8f14a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bb317620 con 0x5592bb406ee0 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8cc65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb37ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8cc65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb37ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53176/0 (socket says 172.21.15.123:53176) 2024-03-20T13:36:55.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8cc65640 1 -- 172.21.15.123:0/3966821287 learned_addr learned my addr 172.21.15.123:0/3966821287 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8cc65640 1 -- 172.21.15.123:0/3966821287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84005df0 con 0x5592bb406ee0 2024-03-20T13:36:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.854+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/3966821287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb37ce90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006fb0 tx=0x7f8d7c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f04fffd66731606 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8c7ae0d640 1 -- 172.21.15.123:0/3966821287 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c013420 con 0x5592bb406ee0 2024-03-20T13:36:55.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8c7ae0d640 1 -- 172.21.15.123:0/3966821287 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c013580 con 0x5592bb406ee0 2024-03-20T13:36:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8c7ae0d640 1 -- 172.21.15.123:0/3966821287 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c013860 con 0x5592bb406ee0 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/3966821287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 msgr2=0x5592bb37ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/3966821287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb37ce90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006fb0 tx=0x7f8d7c001940 comp rx=0 tx=0).stop 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/3966821287 shutdown_connections 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/3966821287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb37ce90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/3966821287 >> 172.21.15.123:0/3966821287 conn(0x5592bb4027b0 msgr2=0x5592bb4ec9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/3966821287 shutdown_connections 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/3966821287 wait complete. 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 Processor -- start 2024-03-20T13:36:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- start start 2024-03-20T13:36:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb4f9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bb312e00 con 0x5592bb406ee0 2024-03-20T13:36:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8cc65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb4f9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8cc65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb4f9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53190/0 (socket says 172.21.15.123:53190) 2024-03-20T13:36:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8cc65640 1 -- 172.21.15.123:0/1259472336 learned_addr learned my addr 172.21.15.123:0/1259472336 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8cc65640 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bb3534c0 con 0x5592bb406ee0 2024-03-20T13:36:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb4f9f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5592bb37c6c0 tx=0x7f8d7c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8c7960a640 1 -- 172.21.15.123:0/1259472336 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c0037a0 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5592bb4fa4b0 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592bb4fa8e0 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8c7960a640 1 -- 172.21.15.123:0/1259472336 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c003900 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.858+0000 7f8c7960a640 1 -- 172.21.15.123:0/1259472336 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c003ba0 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8c7960a640 1 -- 172.21.15.123:0/1259472336 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8d7c003d00 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8c7960a640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c74034300 0x7f8c740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8c7960a640 1 -- 172.21.15.123:0/1259472336 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8d7c0495e0 con 0x5592bb406ee0 2024-03-20T13:36:55.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8c464640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c74034300 0x7f8c740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb40b3f0 0x5592bb500bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb501130 con 0x5592bb40b3f0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8d466640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb40b3f0 0x5592bb500bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8c464640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c74034300 0x7f8c740367c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8d840ae000 tx=0x7f8d840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8d466640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb40b3f0 0x5592bb500bf0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8d466640 1 -- 172.21.15.123:0/1259472336 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d740083f0 con 0x5592bb40b3f0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb5019a0 0x5592bb503d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb504470 con 0x5592bb5019a0 2024-03-20T13:36:55.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb5019a0 0x5592bb503d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb5019a0 0x5592bb503d90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8cc65640 1 -- 172.21.15.123:0/1259472336 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb5019a0 2024-03-20T13:36:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.862+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb505cd0 con 0x5592bb5019a0 2024-03-20T13:36:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8cc65640 1 -- 172.21.15.123:0/1259472336 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb5019a0 2024-03-20T13:36:55.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb504e10 con 0x5592bb5019a0 2024-03-20T13:36:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8cc65640 1 -- 172.21.15.123:0/1259472336 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb5019a0 2024-03-20T13:36:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb505220 con 0x5592bb40b3f0 2024-03-20T13:36:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8d466640 1 -- 172.21.15.123:0/1259472336 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8d740083f0 con 0x5592bb40b3f0 2024-03-20T13:36:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 Processor -- start 2024-03-20T13:36:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 -- start start 2024-03-20T13:36:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 0x5592bb514780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bb2abe30 con 0x5592bb514360 2024-03-20T13:36:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8d466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 0x5592bb514780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8d466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 0x5592bb514780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53206/0 (socket says 172.21.15.123:53206) 2024-03-20T13:36:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8d466640 1 -- 172.21.15.123:0/449760723 learned_addr learned my addr 172.21.15.123:0/449760723 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8d466640 1 -- 172.21.15.123:0/449760723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bb514cc0 con 0x5592bb514360 2024-03-20T13:36:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8d466640 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 0x5592bb514780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400aae0 tx=0x7f8d74008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8c727fc640 1 -- 172.21.15.123:0/449760723 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7401d070 con 0x5592bb514360 2024-03-20T13:36:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8c727fc640 1 -- 172.21.15.123:0/449760723 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74010040 con 0x5592bb514360 2024-03-20T13:36:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5592bb514f10 con 0x5592bb514360 2024-03-20T13:36:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8c727fc640 1 -- 172.21.15.123:0/449760723 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d74007e70 con 0x5592bb514360 2024-03-20T13:36:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.866+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592bb515a60 con 0x5592bb514360 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8c727fc640 1 -- 172.21.15.123:0/449760723 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8d74018430 con 0x5592bb514360 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8c727fc640 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c64034300 0x7f8c640367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8c727fc640 1 -- 172.21.15.123:0/449760723 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8d7404a6f0 con 0x5592bb514360 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c64034300 0x7f8c640367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 Processor -- start 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- start start 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c64034300 0x7f8c640367c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5592bb504910 tx=0x7f8d7c012f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb5216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bb29f790 con 0x5592bb5212e0 2024-03-20T13:36:55.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8d466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb5216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8d466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb5216e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53220/0 (socket says 172.21.15.123:53220) 2024-03-20T13:36:55.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8d466640 1 -- 172.21.15.123:0/1602602898 learned_addr learned my addr 172.21.15.123:0/1602602898 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8d466640 1 -- 172.21.15.123:0/1602602898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bb521cb0 con 0x5592bb5212e0 2024-03-20T13:36:55.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8d466640 1 --2- 172.21.15.123:0/1602602898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb5216e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8d74048a20 tx=0x7f8d74021970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e1f857fd6a3102 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8c63fff640 1 -- 172.21.15.123:0/1602602898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d74047070 con 0x5592bb5212e0 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8c63fff640 1 -- 172.21.15.123:0/1602602898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74022590 con 0x5592bb5212e0 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8c63fff640 1 -- 172.21.15.123:0/1602602898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d74016330 con 0x5592bb5212e0 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1602602898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 msgr2=0x5592bb5216e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1602602898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb5216e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8d74048a20 tx=0x7f8d74021970 comp rx=0 tx=0).stop 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1602602898 shutdown_connections 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1602602898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb5216e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1602602898 >> 172.21.15.123:0/1602602898 conn(0x5592bb51d620 msgr2=0x5592bb51b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1602602898 shutdown_connections 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1602602898 wait complete. 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 Processor -- start 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- start start 2024-03-20T13:36:55.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb528140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.870+0000 7f8d8f14a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bb528680 con 0x5592bb5212e0 2024-03-20T13:36:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8d466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb528140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8d466640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb528140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53222/0 (socket says 172.21.15.123:53222) 2024-03-20T13:36:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 learned_addr learned my addr 172.21.15.123:0/630363922 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bb515a60 con 0x5592bb5212e0 2024-03-20T13:36:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8d466640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb528140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d74022720 tx=0x7f8d740489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8c627fc640 1 -- 172.21.15.123:0/630363922 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7404a200 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5592bb528880 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8c627fc640 1 -- 172.21.15.123:0/630363922 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7404a360 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592bb528d10 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8c627fc640 1 -- 172.21.15.123:0/630363922 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d74021a30 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8c627fc640 1 -- 172.21.15.123:0/630363922 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8d74021b90 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8c627fc640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c58034300 0x7f8c580367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8c627fc640 1 -- 172.21.15.123:0/630363922 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8d74037c60 con 0x5592bb5212e0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c58034300 0x7f8c580367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb533830 0x5592bb535cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb536440 con 0x5592bb533830 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8c464640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb533830 0x5592bb535cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c58034300 0x7f8c580367c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c049890 tx=0x7f8d7c034030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8c464640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb533830 0x5592bb535cf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.874+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 realm 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb536830 con 0x5592bb533830 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5370b0 con 0x5592bb533830 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb537a90 0x5592bb539ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53a630 con 0x5592bb537a90 2024-03-20T13:36:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8d466640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb537a90 0x5592bb539ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8d466640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb537a90 0x5592bb539ec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53ae30 con 0x5592bb537a90 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 20 searching for the correct realm 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5592bb53ce30 0x5592bb53f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5592bb53ce30 0x5592bb53f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.878+0000 7f8d8cc65640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5592bb53ce30 0x5592bb53f2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8d74055040 0x7f8d7403c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x7f8d74055040 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8d74055040 0x7f8d7403c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8d74055040 0x7f8d7403c030 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x7f8d74055040 2024-03-20T13:36:55.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.882+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x7f8d74055040 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x7f8d74055040 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x7f8d74055040 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8d840b0020 con 0x7f8d74055040 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840b0020 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.886+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x7f8d74055040 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x7f8d74055040 2024-03-20T13:36:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x7f8d74055040 2024-03-20T13:36:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb53ce30 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.890+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53f9c0 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53c390 con 0x5592bb533830 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53b310 con 0x5592bb537a90 2024-03-20T13:36:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb53bc20 con 0x5592bb533830 2024-03-20T13:36:55.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 zone default found 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 4 Realm: () 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 zonegroup default 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5402a0 con 0x7f8d74055040 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb542480 con 0x5592bb53ce30 2024-03-20T13:36:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5427e0 con 0x5592bb53ce30 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 started sync module instance, tier type = 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.894+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb541a50 con 0x5592bb537a90 2024-03-20T13:36:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.898+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.898+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088696438320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb541a50 con 0x5592bb537a90 2024-03-20T13:36:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.898+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb543150 con 0x5592bb533830 2024-03-20T13:36:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.898+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.898+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088696442032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb543570 con 0x5592bb533830 2024-03-20T13:36:55.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.898+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb543f80 con 0x5592bb537a90 2024-03-20T13:36:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.902+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088696442032] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.902+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088696438320] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.902+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.902+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088696436144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5430d0 con 0x5592bb537a90 2024-03-20T13:36:55.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.902+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5447d0 con 0x7f8d74055040 2024-03-20T13:36:55.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.906+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.906+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088696447792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5430d0 con 0x7f8d74055040 2024-03-20T13:36:55.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.906+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5452c0 con 0x5592bb537a90 2024-03-20T13:36:55.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088696436144] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088696447792] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088696450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb545280 con 0x5592bb537a90 2024-03-20T13:36:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb545670 con 0x5592bb53ce30 2024-03-20T13:36:55.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088696448848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb545ec0 con 0x5592bb53ce30 2024-03-20T13:36:55.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb546870 con 0x5592bb53ce30 2024-03-20T13:36:55.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.910+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088696450496] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088696448848] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088696453664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb546390 con 0x5592bb53ce30 2024-03-20T13:36:55.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5470c0 con 0x7f8d74055040 2024-03-20T13:36:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088696458272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5470c0 con 0x7f8d74055040 2024-03-20T13:36:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=0 2024-03-20T13:36:55.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=1 2024-03-20T13:36:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=2 2024-03-20T13:36:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=3 2024-03-20T13:36:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=4 2024-03-20T13:36:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=5 2024-03-20T13:36:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088696453664] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.914+0000 7f8d8f14a980 20 add_watcher() i=6 2024-03-20T13:36:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088696458272] v32'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 add_watcher() i=7 2024-03-20T13:36:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb543a70 con 0x5592bb533830 2024-03-20T13:36:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088696460128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb543a70 con 0x5592bb533830 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088696460128] v32'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8c437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 5 note: GC not initialized 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8c427e4640 20 reqs_thread_entry: start 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 Filter name: none 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8c3b7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56c560 con 0x5592bb533830 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.918+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56c560 con 0x5592bb533830 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-03-20T13:36:55.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 20 rados->read ofs=0 len=0 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56ad80 con 0x5592bb533830 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-03-20T13:36:55.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56b5f0 con 0x5592bb533830 2024-03-20T13:36:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~357] v32'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:55.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94088696607056 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56b570 con 0x5592bb537a90 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94088696450496 notify 137438953472 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f8d74069040 con 0x5592bb537a90 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8c63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94088696450496 notifier 4290 bl.length()=533 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8c63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8c63fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8c63fff640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8c50003ea0 con 0x5592bb537a90 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.4 [notify cookie 94088696607056 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94088696607056 notify 137438953472 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5592bb528d10 con 0x5592bb537a90 2024-03-20T13:36:55.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.922+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56daa0 con 0x5592bb533830 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8f14a980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8f14a980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8f14a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94088696606944 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56ff60 con 0x7f8d74055040 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== watch-notify(notify (1) cookie 94088696447792 notify 137438953472 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x7f8d840d0040 con 0x7f8d74055040 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8c637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94088696447792 notifier 4290 bl.length()=169 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8c637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8c637fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:36:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(69 notify.3 [notify cookie 94088696606944 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8c637fe640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8bb4003400 con 0x7f8d74055040 2024-03-20T13:36:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== watch-notify(notify_complete (2) cookie 94088696606944 notify 137438953472 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8d840b9070 con 0x7f8d74055040 2024-03-20T13:36:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.926+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56b0b0 con 0x5592bb533830 2024-03-20T13:36:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8f14a980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-03-20T13:36:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8f14a980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-03-20T13:36:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8f14a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-03-20T13:36:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94088696606896 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb56ff60 con 0x7f8d74055040 2024-03-20T13:36:55.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== watch-notify(notify (1) cookie 94088696447792 notify 137438953473 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f8d840b9070 con 0x7f8d74055040 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8c637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94088696447792 notifier 4290 bl.length()=177 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8c637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8c637fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8c637fe640 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8bb4003430 con 0x7f8d74055040 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(72 notify.3 [notify cookie 94088696606896 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== watch-notify(notify_complete (2) cookie 94088696606896 notify 137438953473 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5592bb40ed30 con 0x7f8d74055040 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.936 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8c437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:55.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.930+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088696460128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb54c910 con 0x5592bb533830 2024-03-20T13:36:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94088696460128] v32'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088696438320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb547360 con 0x5592bb537a90 2024-03-20T13:36:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94088696438320] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8f14a980 20 remove_watcher() i=0 2024-03-20T13:36:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8f14a980 2 removed watcher, disabling cache 2024-03-20T13:36:55.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088696442032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb541e30 con 0x5592bb533830 2024-03-20T13:36:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94088696442032] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x5592bb533830 2024-03-20T13:36:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.934+0000 7f8d8f14a980 20 remove_watcher() i=1 2024-03-20T13:36:55.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.938+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088696436144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb541e30 con 0x5592bb537a90 2024-03-20T13:36:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.938+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94088696436144] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.938+0000 7f8d8f14a980 20 remove_watcher() i=2 2024-03-20T13:36:55.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.938+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088696447792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5415b0 con 0x7f8d74055040 2024-03-20T13:36:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94088696447792] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8f14a980 20 remove_watcher() i=3 2024-03-20T13:36:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088696450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb541e30 con 0x5592bb537a90 2024-03-20T13:36:55.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8d466640 1 -- 172.21.15.123:0/630363922 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94088696450496] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d74033070 con 0x5592bb537a90 2024-03-20T13:36:55.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8f14a980 20 remove_watcher() i=4 2024-03-20T13:36:55.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088696448848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb544330 con 0x5592bb53ce30 2024-03-20T13:36:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94088696448848] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8f14a980 20 remove_watcher() i=5 2024-03-20T13:36:55.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.942+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088696453664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb5415b0 con 0x5592bb53ce30 2024-03-20T13:36:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8cc65640 1 -- 172.21.15.123:0/630363922 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94088696453664] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d7c024020 con 0x5592bb53ce30 2024-03-20T13:36:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 20 remove_watcher() i=6 2024-03-20T13:36:55.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088696458272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5592bb541e30 con 0x7f8d74055040 2024-03-20T13:36:55.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94088696458272] v32'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8d840d5060 con 0x7f8d74055040 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 20 remove_watcher() i=7 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb537a90 msgr2=0x5592bb539ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb537a90 0x5592bb539ec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb533830 msgr2=0x5592bb535cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb533830 0x5592bb535cf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8d74055040 msgr2=0x7f8d7403c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8d74055040 0x7f8d7403c030 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5592bb53ce30 msgr2=0x5592bb53f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5592bb53ce30 0x5592bb53f2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c58034300 msgr2=0x7f8c580367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c58034300 0x7f8c580367c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c049890 tx=0x7f8d7c034030 comp rx=0 tx=0).stop 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 msgr2=0x5592bb528140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb528140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d74022720 tx=0x7f8d740489b0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8c464640 1 -- 172.21.15.123:0/630363922 reap_dead start 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 shutdown_connections 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/630363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb5212e0 0x5592bb528140 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 >> 172.21.15.123:0/630363922 conn(0x5592bb51d620 msgr2=0x5592bb51ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 shutdown_connections 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/630363922 wait complete. 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c64034300 msgr2=0x7f8c640367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c64034300 0x7f8c640367c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5592bb504910 tx=0x7f8d7c012f20 comp rx=0 tx=0).stop 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 msgr2=0x5592bb514780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 0x5592bb514780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400aae0 tx=0x7f8d74008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 shutdown_connections 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c64034300 0x7f8c640367c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/449760723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb514360 0x5592bb514780 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 >> 172.21.15.123:0/449760723 conn(0x5592bb509170 msgr2=0x5592bb509c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 shutdown_connections 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/449760723 wait complete. 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb5019a0 msgr2=0x5592bb503d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb5019a0 0x5592bb503d90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb40b3f0 msgr2=0x5592bb500bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb40b3f0 0x5592bb500bf0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c74034300 msgr2=0x7f8c740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c74034300 0x7f8c740367c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8d840ae000 tx=0x7f8d840a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 msgr2=0x5592bb4f9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb4f9f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5592bb37c6c0 tx=0x7f8d7c000f50 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 shutdown_connections 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5592bb5019a0 0x5592bb503d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5592bb40b3f0 0x5592bb500bf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8c74034300 0x7f8c740367c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 --2- 172.21.15.123:0/1259472336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5592bb406ee0 0x5592bb4f9f70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 >> 172.21.15.123:0/1259472336 conn(0x5592bb4027b0 msgr2=0x5592bb37b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 shutdown_connections 2024-03-20T13:36:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:55.946+0000 7f8d8f14a980 1 -- 172.21.15.123:0/1259472336 wait complete. 2024-03-20T13:36:55.964 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:55.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-03-20T13:36:55.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-03-20T13:36:55.964 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-03-20T13:36:56.041 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:56.041 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:56.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d931b980 1 Processor -- start 2024-03-20T13:36:56.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d931b980 1 -- start start 2024-03-20T13:36:56.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d931b980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558335b052f0 0x558335b076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d931b980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558335a4e4c0 con 0x558335b00de0 2024-03-20T13:36:56.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d931b980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558335a150f0 con 0x558335b052f0 2024-03-20T13:36:56.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d6635640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558335b052f0 0x558335b076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d6635640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558335b052f0 0x558335b076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53236/0 (socket says 172.21.15.123:53236) 2024-03-20T13:36:56.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d6635640 1 -- 172.21.15.123:0/257694566 learned_addr learned my addr 172.21.15.123:0/257694566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d6635640 1 -- 172.21.15.123:0/257694566 >> v1:172.21.15.89:6789/0 conn(0x558335b00de0 legacy=0x558335b011c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d6635640 1 -- 172.21.15.123:0/257694566 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558335a75c90 con 0x558335b052f0 2024-03-20T13:36:56.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.038+0000 7fe6d6635640 1 --2- 172.21.15.123:0/257694566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b052f0 0x558335b076e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000a5c0 tx=0x7fe6c001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb3eb737d7edb0a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d5e34640 1 -- 172.21.15.123:0/257694566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00aa470 con 0x558335b052f0 2024-03-20T13:36:56.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d5e34640 1 -- 172.21.15.123:0/257694566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c00aa5d0 con 0x558335b052f0 2024-03-20T13:36:56.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d5e34640 1 -- 172.21.15.123:0/257694566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6c00aa890 con 0x558335b052f0 2024-03-20T13:36:56.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 -- 172.21.15.123:0/257694566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b052f0 msgr2=0x558335b076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 --2- 172.21.15.123:0/257694566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b052f0 0x558335b076e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000a5c0 tx=0x7fe6c001b340 comp rx=0 tx=0).stop 2024-03-20T13:36:56.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 -- 172.21.15.123:0/257694566 shutdown_connections 2024-03-20T13:36:56.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 --2- 172.21.15.123:0/257694566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b052f0 0x558335b076e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 -- 172.21.15.123:0/257694566 >> 172.21.15.123:0/257694566 conn(0x558335afc6b0 msgr2=0x558335afead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 -- 172.21.15.123:0/257694566 shutdown_connections 2024-03-20T13:36:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.042+0000 7fe6d931b980 1 -- 172.21.15.123:0/257694566 wait complete. 2024-03-20T13:36:56.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d931b980 1 Processor -- start 2024-03-20T13:36:56.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d931b980 1 -- start start 2024-03-20T13:36:56.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d931b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d931b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558335a12620 con 0x558335b00de0 2024-03-20T13:36:56.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d6e36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d6e36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bebdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53242/0 (socket says 172.21.15.123:53242) 2024-03-20T13:36:56.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.054+0000 7fe6d6e36640 1 -- 172.21.15.123:0/30679032 learned_addr learned my addr 172.21.15.123:0/30679032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 -- 172.21.15.123:0/30679032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0005df0 con 0x558335b00de0 2024-03-20T13:36:56.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/30679032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bebdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8006fb0 tx=0x7fe6c8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82f0b6c5075a393 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe5c4e09640 1 -- 172.21.15.123:0/30679032 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6c800f640 con 0x558335b00de0 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe5c4e09640 1 -- 172.21.15.123:0/30679032 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800f7c0 con 0x558335b00de0 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe5c4e09640 1 -- 172.21.15.123:0/30679032 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6c800fae0 con 0x558335b00de0 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- 172.21.15.123:0/30679032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 msgr2=0x558335bebdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 --2- 172.21.15.123:0/30679032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bebdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8006fb0 tx=0x7fe6c8001940 comp rx=0 tx=0).stop 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- 172.21.15.123:0/30679032 shutdown_connections 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 --2- 172.21.15.123:0/30679032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bebdc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- 172.21.15.123:0/30679032 >> 172.21.15.123:0/30679032 conn(0x558335afc6b0 msgr2=0x558335be7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- 172.21.15.123:0/30679032 shutdown_connections 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- 172.21.15.123:0/30679032 wait complete. 2024-03-20T13:36:56.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 Processor -- start 2024-03-20T13:36:56.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- start start 2024-03-20T13:36:56.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bf2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558335a0de00 con 0x558335b00de0 2024-03-20T13:36:56.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bf2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bf2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53256/0 (socket says 172.21.15.123:53256) 2024-03-20T13:36:56.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 -- 172.21.15.123:0/650555513 learned_addr learned my addr 172.21.15.123:0/650555513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558335a4e4c0 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bf2d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x558335becc50 tx=0x7fe6c8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe5c3606640 1 -- 172.21.15.123:0/650555513 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6c8005450 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.058+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558335bf3270 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe5c3606640 1 -- 172.21.15.123:0/650555513 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c80055b0 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558335bf3720 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe5c3606640 1 -- 172.21.15.123:0/650555513 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6c8005890 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe5c3606640 1 -- 172.21.15.123:0/650555513 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe6c80059f0 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe5c3606640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5bc034300 0x7fe5bc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe5c3606640 1 -- 172.21.15.123:0/650555513 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe6c8048e70 con 0x558335b00de0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d6635640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5bc034300 0x7fe5bc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335b052f0 0x558335bf9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335bf9e50 con 0x558335b052f0 2024-03-20T13:36:56.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d7637640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335b052f0 0x558335bf9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d6635640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5bc034300 0x7fe5bc0367c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ae000 tx=0x7fe6c00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d7637640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335b052f0 0x558335bf9910 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d7637640 1 -- 172.21.15.123:0/650555513 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe6d00083f0 con 0x558335b052f0 2024-03-20T13:36:56.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335bfa6c0 0x558335bfcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335bfd200 con 0x558335bfa6c0 2024-03-20T13:36:56.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335bfa6c0 0x558335bfcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.062+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335bfa6c0 0x558335bfcab0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d6e36640 1 -- 172.21.15.123:0/650555513 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe6c8023070 con 0x558335bfa6c0 2024-03-20T13:36:56.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335bfea60 con 0x558335bfa6c0 2024-03-20T13:36:56.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d6e36640 1 -- 172.21.15.123:0/650555513 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe6c8023070 con 0x558335bfa6c0 2024-03-20T13:36:56.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335bfdc60 con 0x558335bfa6c0 2024-03-20T13:36:56.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d6e36640 1 -- 172.21.15.123:0/650555513 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe6c8023070 con 0x558335bfa6c0 2024-03-20T13:36:56.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335bfe070 con 0x558335b052f0 2024-03-20T13:36:56.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d7637640 1 -- 172.21.15.123:0/650555513 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe6d00083f0 con 0x558335b052f0 2024-03-20T13:36:56.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 Processor -- start 2024-03-20T13:36:56.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 -- start start 2024-03-20T13:36:56.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 0x558335c0d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d931b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583359a6e30 con 0x558335c0d160 2024-03-20T13:36:56.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d7637640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 0x558335c0d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d7637640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 0x558335c0d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53266/0 (socket says 172.21.15.123:53266) 2024-03-20T13:36:56.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.066+0000 7fe6d7637640 1 -- 172.21.15.123:0/3638828552 learned_addr learned my addr 172.21.15.123:0/3638828552 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 -- 172.21.15.123:0/3638828552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558335c0dac0 con 0x558335c0d160 2024-03-20T13:36:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 0x558335c0d580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000aae0 tx=0x7fe6d0008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe5c0e01640 1 -- 172.21.15.123:0/3638828552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d001d070 con 0x558335c0d160 2024-03-20T13:36:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558335c0dd10 con 0x558335c0d160 2024-03-20T13:36:56.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe5c0e01640 1 -- 172.21.15.123:0/3638828552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d0010040 con 0x558335c0d160 2024-03-20T13:36:56.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558335c0e860 con 0x558335c0d160 2024-03-20T13:36:56.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe5c0e01640 1 -- 172.21.15.123:0/3638828552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0007e50 con 0x558335c0d160 2024-03-20T13:36:56.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe5c0e01640 1 -- 172.21.15.123:0/3638828552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe6d0018430 con 0x558335c0d160 2024-03-20T13:36:56.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe5c0e01640 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5b0034260 0x7fe5b0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe5c0e01640 1 -- 172.21.15.123:0/3638828552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe6d004a650 con 0x558335c0d160 2024-03-20T13:36:56.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5b0034260 0x7fe5b0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d931b980 1 Processor -- start 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d931b980 1 -- start start 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5b0034260 0x7fe5b0036720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x558335bfd760 tx=0x7fe6c8010e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d931b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335b0a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d931b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833599a790 con 0x558335b0a400 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335b0a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335b0a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53276/0 (socket says 172.21.15.123:53276) 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 -- 172.21.15.123:0/2961771556 learned_addr learned my addr 172.21.15.123:0/2961771556 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 -- 172.21.15.123:0/2961771556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558335b08c30 con 0x558335b0a400 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.070+0000 7fe6d7637640 1 --2- 172.21.15.123:0/2961771556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335b0a820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0048a70 tx=0x7fe6d00218e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea908673c2b80a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2961771556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0047070 con 0x558335b0a400 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2961771556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d0016330 con 0x558335b0a400 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2961771556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d00225f0 con 0x558335b0a400 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2961771556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 msgr2=0x558335b0a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2961771556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335b0a820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0048a70 tx=0x7fe6d00218e0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2961771556 shutdown_connections 2024-03-20T13:36:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2961771556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335b0a820 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2961771556 >> 172.21.15.123:0/2961771556 conn(0x558335c16440 msgr2=0x558335c144a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2961771556 shutdown_connections 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2961771556 wait complete. 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 Processor -- start 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- start start 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335c230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558335c23610 con 0x558335b0a400 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d7637640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335c230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d7637640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335c230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53284/0 (socket says 172.21.15.123:53284) 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 learned_addr learned my addr 172.21.15.123:0/2804254949 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558335c0e860 con 0x558335b0a400 2024-03-20T13:36:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d7637640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335c230d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00478c0 tx=0x7fe6d00489d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe5b8ff9640 1 -- 172.21.15.123:0/2804254949 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0020e30 con 0x558335b0a400 2024-03-20T13:36:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558335c23810 con 0x558335b0a400 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe5b8ff9640 1 -- 172.21.15.123:0/2804254949 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00164a0 con 0x558335b0a400 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe5b8ff9640 1 -- 172.21.15.123:0/2804254949 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0021b60 con 0x558335b0a400 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.074+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558335c23c40 con 0x558335b0a400 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe5b8ff9640 1 -- 172.21.15.123:0/2804254949 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe6d0021cc0 con 0x558335b0a400 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe5b8ff9640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5a00342b0 0x7fe5a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe5b8ff9640 1 -- 172.21.15.123:0/2804254949 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe6d002ecd0 con 0x558335b0a400 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5a00342b0 0x7fe5a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335c2e830 0x558335c30cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c31440 con 0x558335c2e830 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6635640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335c2e830 0x558335c30cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5a00342b0 0x7fe5a0036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8010560 tx=0x7fe6c8033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6635640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335c2e830 0x558335c30cf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 realm 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c31830 con 0x558335c2e830 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c320b0 con 0x558335c2e830 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335c32a90 0x558335c34ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c35630 con 0x558335c32a90 2024-03-20T13:36:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d7637640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335c32a90 0x558335c34ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d7637640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335c32a90 0x558335c34ec0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe6d0033020 con 0x558335c32a90 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.078+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c35e30 con 0x558335c32a90 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe6d0033020 con 0x558335c32a90 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d931b980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d931b980 20 searching for the correct realm 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558335c37e90 0x558335c3a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558335c37e90 0x558335c3a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6e36640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558335c37e90 0x558335c3a350 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0033020 con 0x558335c32a90 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d7637640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe6d0021370 0x7fe6d0039480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x7fe6d0021370 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe6d0021370 0x7fe6d0039480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe6d0021370 0x7fe6d0039480 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x7fe6d0021370 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.082+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0033020 con 0x558335c32a90 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0033020 con 0x558335c32a90 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x7fe6d0021370 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x7fe6d0021370 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x7fe6d0021370 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe6c00b0020 con 0x7fe6d0021370 2024-03-20T13:36:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.086+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00b0020 con 0x558335c2e830 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x7fe6d0021370 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c2e830 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x7fe6d0021370 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x7fe6d0021370 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.090+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c37e90 2024-03-20T13:36:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3aa20 con 0x558335c32a90 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c37420 con 0x558335c2e830 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.094+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c363a0 con 0x558335c32a90 2024-03-20T13:36:56.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c36c90 con 0x558335c2e830 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 zone default found 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 4 Realm: () 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 zonegroup default 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3b300 con 0x7fe6d0021370 2024-03-20T13:36:56.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3d4e0 con 0x558335c37e90 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3d840 con 0x558335c37e90 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 started sync module instance, tier type = 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.098+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3c920 con 0x558335c32a90 2024-03-20T13:36:56.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94022031101184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3c920 con 0x558335c32a90 2024-03-20T13:36:56.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3e080 con 0x558335c2e830 2024-03-20T13:36:56.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94022031104928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3e8d0 con 0x558335c2e830 2024-03-20T13:36:56.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3f2a0 con 0x558335c32a90 2024-03-20T13:36:56.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94022031101184] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.102+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94022031104928] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94022031109536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3e430 con 0x558335c32a90 2024-03-20T13:36:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3faf0 con 0x7fe6d0021370 2024-03-20T13:36:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94022031111760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3e430 con 0x7fe6d0021370 2024-03-20T13:36:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c405e0 con 0x558335c32a90 2024-03-20T13:36:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.106+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94022031109536] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.110+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94022031111760] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.110+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.110+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94022031114464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c405a0 con 0x558335c32a90 2024-03-20T13:36:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.110+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c409c0 con 0x558335c37e90 2024-03-20T13:36:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94022031112816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c41210 con 0x558335c37e90 2024-03-20T13:36:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c41bc0 con 0x558335c37e90 2024-03-20T13:36:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94022031114464] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94022031099008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c41f70 con 0x558335c37e90 2024-03-20T13:36:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c428e0 con 0x7fe6d0021370 2024-03-20T13:36:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.114+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94022031112816] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94022031117680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c428e0 con 0x7fe6d0021370 2024-03-20T13:36:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=0 2024-03-20T13:36:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=1 2024-03-20T13:36:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=2 2024-03-20T13:36:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=3 2024-03-20T13:36:56.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=4 2024-03-20T13:36:56.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=5 2024-03-20T13:36:56.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94022031099008] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=6 2024-03-20T13:36:56.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94022031117680] v32'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 20 add_watcher() i=7 2024-03-20T13:36:56.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:56.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c417f0 con 0x558335c2e830 2024-03-20T13:36:56.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.118+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94022031123520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c431f0 con 0x558335c2e830 2024-03-20T13:36:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94022031123520] v32'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe58d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 5 note: GC not initialized 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe507fff640 20 reqs_thread_entry: start 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 Filter name: none 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe505ffb640 20 reqs_thread_entry: start 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c67870 con 0x7fe6d0021370 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:36:56.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:36:56.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-03-20T13:36:56.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c67870 con 0x558335c2e830 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rados_obj.operate() r=0 bl.length=7 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c68e00 con 0x558335c2e830 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 foo [call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+405 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe58d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.122+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94022031123520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c288b0 con 0x558335c2e830 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.126+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94022031123520] v32'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.126+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94022031101184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c42440 con 0x558335c32a90 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.126+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94022031101184] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.126+0000 7fe6d931b980 20 remove_watcher() i=0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.126+0000 7fe6d931b980 2 removed watcher, disabling cache 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.126+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94022031104928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3cd00 con 0x558335c2e830 2024-03-20T13:36:56.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.130+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94022031104928] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x558335c2e830 2024-03-20T13:36:56.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.130+0000 7fe6d931b980 20 remove_watcher() i=1 2024-03-20T13:36:56.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.130+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94022031109536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3cd00 con 0x558335c32a90 2024-03-20T13:36:56.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.130+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94022031109536] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.130+0000 7fe6d931b980 20 remove_watcher() i=2 2024-03-20T13:36:56.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.130+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94022031111760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3eda0 con 0x7fe6d0021370 2024-03-20T13:36:56.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.134+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94022031111760] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.134+0000 7fe6d931b980 20 remove_watcher() i=3 2024-03-20T13:36:56.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.134+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94022031114464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3eda0 con 0x558335c32a90 2024-03-20T13:36:56.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.134+0000 7fe6d7637640 1 -- 172.21.15.123:0/2804254949 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94022031114464] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6d0063040 con 0x558335c32a90 2024-03-20T13:36:56.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.134+0000 7fe6d931b980 20 remove_watcher() i=4 2024-03-20T13:36:56.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.134+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94022031112816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c400e0 con 0x558335c37e90 2024-03-20T13:36:56.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94022031112816] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 20 remove_watcher() i=5 2024-03-20T13:36:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94022031099008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c400e0 con 0x558335c37e90 2024-03-20T13:36:56.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d6e36640 1 -- 172.21.15.123:0/2804254949 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94022031099008] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c8023070 con 0x558335c37e90 2024-03-20T13:36:56.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 20 remove_watcher() i=6 2024-03-20T13:36:56.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94022031117680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558335c3c480 con 0x7fe6d0021370 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94022031117680] v32'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe6c00d5060 con 0x7fe6d0021370 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 20 remove_watcher() i=7 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335c32a90 msgr2=0x558335c34ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335c32a90 0x558335c34ec0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335c2e830 msgr2=0x558335c30cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335c2e830 0x558335c30cf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe6d0021370 msgr2=0x7fe6d0039480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe6d0021370 0x7fe6d0039480 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558335c37e90 msgr2=0x558335c3a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558335c37e90 0x558335c3a350 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5a00342b0 msgr2=0x7fe5a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5a00342b0 0x7fe5a0036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8010560 tx=0x7fe6c8033000 comp rx=0 tx=0).stop 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d6635640 1 -- 172.21.15.123:0/2804254949 reap_dead start 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 msgr2=0x558335c230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335c230d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00478c0 tx=0x7fe6d00489d0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 shutdown_connections 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/2804254949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b0a400 0x558335c230d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 >> 172.21.15.123:0/2804254949 conn(0x558335c16440 msgr2=0x558335c13aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 shutdown_connections 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/2804254949 wait complete. 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5b0034260 msgr2=0x7fe5b0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5b0034260 0x7fe5b0036720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x558335bfd760 tx=0x7fe6c8010e80 comp rx=0 tx=0).stop 2024-03-20T13:36:56.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 msgr2=0x558335c0d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 0x558335c0d580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000aae0 tx=0x7fe6d0008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 shutdown_connections 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5b0034260 0x7fe5b0036720 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 --2- 172.21.15.123:0/3638828552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335c0d160 0x558335c0d580 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 >> 172.21.15.123:0/3638828552 conn(0x558335c01f70 msgr2=0x558335c02a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.138+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 shutdown_connections 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/3638828552 wait complete. 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335bfa6c0 msgr2=0x558335bfcab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335bfa6c0 0x558335bfcab0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335b052f0 msgr2=0x558335bf9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335b052f0 0x558335bf9910 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5bc034300 msgr2=0x7fe5bc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5bc034300 0x7fe5bc0367c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ae000 tx=0x7fe6c00a6000 comp rx=0 tx=0).stop 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 msgr2=0x558335bf2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bf2d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x558335becc50 tx=0x7fe6c8000f50 comp rx=0 tx=0).stop 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 shutdown_connections 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558335bfa6c0 0x558335bfcab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558335b052f0 0x558335bf9910 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe5bc034300 0x7fe5bc0367c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 --2- 172.21.15.123:0/650555513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558335b00de0 0x558335bf2d30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 >> 172.21.15.123:0/650555513 conn(0x558335afc6b0 msgr2=0x558335be6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 shutdown_connections 2024-03-20T13:36:56.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.142+0000 7fe6d931b980 1 -- 172.21.15.123:0/650555513 wait complete. 2024-03-20T13:36:56.157 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-03-20T13:36:56.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:56.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:56.158 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:56.238 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:56.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191e5b3980 1 Processor -- start 2024-03-20T13:36:56.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191e5b3980 1 -- start start 2024-03-20T13:36:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191e5b3980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x559a42097980 0x559a42095f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191e5b3980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559a4206d520 con 0x559a420964c0 2024-03-20T13:36:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191e5b3980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x559a420340f0 con 0x559a42097980 2024-03-20T13:36:56.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191c0ce640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x559a42097980 0x559a42095f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191c0ce640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x559a42097980 0x559a42095f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53294/0 (socket says 172.21.15.123:53294) 2024-03-20T13:36:56.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f19138cd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x559a420964c0 0x559a42128f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58930/0 (socket says 172.21.15.123:58930) 2024-03-20T13:36:56.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191c0ce640 1 -- 172.21.15.123:0/1056119932 learned_addr learned my addr 172.21.15.123:0/1056119932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191c0ce640 1 -- 172.21.15.123:0/1056119932 >> v1:172.21.15.89:6789/0 conn(0x559a420964c0 legacy=0x559a42128f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191c0ce640 1 -- 172.21.15.123:0/1056119932 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a420968d0 con 0x559a42097980 2024-03-20T13:36:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.234+0000 7f191c0ce640 1 --2- 172.21.15.123:0/1056119932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a42097980 0x559a42095f80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f190c00a5c0 tx=0x7f190c01b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1625e3734a583242 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191b8cd640 1 -- 172.21.15.123:0/1056119932 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190c0aa530 con 0x559a42097980 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191b8cd640 1 -- 172.21.15.123:0/1056119932 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0a6050 con 0x559a42097980 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191b8cd640 1 -- 172.21.15.123:0/1056119932 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190c0aa7e0 con 0x559a42097980 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 -- 172.21.15.123:0/1056119932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a42097980 msgr2=0x559a42095f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 --2- 172.21.15.123:0/1056119932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a42097980 0x559a42095f80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f190c00a5c0 tx=0x7f190c01b2e0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 -- 172.21.15.123:0/1056119932 shutdown_connections 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 --2- 172.21.15.123:0/1056119932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a42097980 0x559a42095f80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 -- 172.21.15.123:0/1056119932 >> 172.21.15.123:0/1056119932 conn(0x559a4211c850 msgr2=0x559a4211ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 -- 172.21.15.123:0/1056119932 shutdown_connections 2024-03-20T13:36:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.238+0000 7f191e5b3980 1 -- 172.21.15.123:0/1056119932 wait complete. 2024-03-20T13:36:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 Processor -- start 2024-03-20T13:36:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- start start 2024-03-20T13:36:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a4220d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a42031620 con 0x559a420964c0 2024-03-20T13:36:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191c0ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a4220d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191c0ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a4220d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53304/0 (socket says 172.21.15.123:53304) 2024-03-20T13:36:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191c0ce640 1 -- 172.21.15.123:0/3640003440 learned_addr learned my addr 172.21.15.123:0/3640003440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191c0ce640 1 -- 172.21.15.123:0/3640003440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c005df0 con 0x559a420964c0 2024-03-20T13:36:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191c0ce640 1 --2- 172.21.15.123:0/3640003440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a4220d6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f190c018f70 tx=0x7f190c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c63d7692c195ae6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f180a60c640 1 -- 172.21.15.123:0/3640003440 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190c0aa780 con 0x559a420964c0 2024-03-20T13:36:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f180a60c640 1 -- 172.21.15.123:0/3640003440 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0aa8e0 con 0x559a420964c0 2024-03-20T13:36:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f180a60c640 1 -- 172.21.15.123:0/3640003440 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190c0aab80 con 0x559a420964c0 2024-03-20T13:36:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- 172.21.15.123:0/3640003440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 msgr2=0x559a4220d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 --2- 172.21.15.123:0/3640003440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a4220d6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f190c018f70 tx=0x7f190c003030 comp rx=0 tx=0).stop 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- 172.21.15.123:0/3640003440 shutdown_connections 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 --2- 172.21.15.123:0/3640003440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a4220d6d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- 172.21.15.123:0/3640003440 >> 172.21.15.123:0/3640003440 conn(0x559a4211c850 msgr2=0x559a422091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- 172.21.15.123:0/3640003440 shutdown_connections 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- 172.21.15.123:0/3640003440 wait complete. 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 Processor -- start 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- start start 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a422143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.254+0000 7f191e5b3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a4202ce00 con 0x559a420964c0 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c0ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a422143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c0ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a422143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53318/0 (socket says 172.21.15.123:53318) 2024-03-20T13:36:56.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c0ce640 1 -- 172.21.15.123:0/2158146833 learned_addr learned my addr 172.21.15.123:0/2158146833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c0ce640 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a420968d0 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c0ce640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a422143e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f190c01bb80 tx=0x7f190c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f1808e09640 1 -- 172.21.15.123:0/2158146833 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190c0c2070 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f1808e09640 1 -- 172.21.15.123:0/2158146833 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0bdae0 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559a42214920 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f1808e09640 1 -- 172.21.15.123:0/2158146833 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f190c0bdda0 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a42214db0 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f1808e09640 1 -- 172.21.15.123:0/2158146833 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f190c0b1070 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f1808e09640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1804034300 0x7f18040367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f1808e09640 1 -- 172.21.15.123:0/2158146833 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f190c0e3af0 con 0x559a420964c0 2024-03-20T13:36:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f19138cd640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1804034300 0x7f18040367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a42219050 0x559a4221b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4221b980 con 0x559a42219050 2024-03-20T13:36:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c8cf640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a42219050 0x559a4221b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f19138cd640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1804034300 0x7f18040367c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1904000f70 tx=0x7f1904001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.258+0000 7f191c8cf640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a42219050 0x559a4221b440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c8cf640 1 -- 172.21.15.123:0/2158146833 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a42219050 2024-03-20T13:36:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a4221c1f0 0x559a4221e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4221ed30 con 0x559a4221c1f0 2024-03-20T13:36:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c0ce640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a4221c1f0 0x559a4221e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c0ce640 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a4221c1f0 0x559a4221e5e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c0ce640 1 -- 172.21.15.123:0/2158146833 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f190c0cf960 con 0x559a4221c1f0 2024-03-20T13:36:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42220590 con 0x559a4221c1f0 2024-03-20T13:36:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c0ce640 1 -- 172.21.15.123:0/2158146833 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f190c0cf960 con 0x559a4221c1f0 2024-03-20T13:36:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4221f790 con 0x559a4221c1f0 2024-03-20T13:36:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c0ce640 1 -- 172.21.15.123:0/2158146833 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f190c0cf960 con 0x559a4221c1f0 2024-03-20T13:36:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4221fba0 con 0x559a42219050 2024-03-20T13:36:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.262+0000 7f191c8cf640 1 -- 172.21.15.123:0/2158146833 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f191400a4d0 con 0x559a42219050 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 Processor -- start 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 -- start start 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 0x559a4222f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a41fc5e30 con 0x559a4222ec70 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191c8cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 0x559a4222f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191c8cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 0x559a4222f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53332/0 (socket says 172.21.15.123:53332) 2024-03-20T13:36:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191c8cf640 1 -- 172.21.15.123:0/1774550791 learned_addr learned my addr 172.21.15.123:0/1774550791 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191c8cf640 1 -- 172.21.15.123:0/1774550791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a4222f5d0 con 0x559a4222ec70 2024-03-20T13:36:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191c8cf640 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 0x559a4222f090 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1914016cf0 tx=0x7f191400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f1801ffb640 1 -- 172.21.15.123:0/1774550791 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1914017660 con 0x559a4222ec70 2024-03-20T13:36:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559a4222f820 con 0x559a4222ec70 2024-03-20T13:36:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f1801ffb640 1 -- 172.21.15.123:0/1774550791 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140177c0 con 0x559a4222ec70 2024-03-20T13:36:56.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f1801ffb640 1 -- 172.21.15.123:0/1774550791 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1914017a60 con 0x559a4222ec70 2024-03-20T13:36:56.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a42230370 con 0x559a4222ec70 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f1801ffb640 1 -- 172.21.15.123:0/1774550791 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f191401d020 con 0x559a4222ec70 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f1801ffb640 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17f40342b0 0x7f17f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f1801ffb640 1 -- 172.21.15.123:0/1774550791 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f191404b610 con 0x559a4222ec70 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191c0ce640 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17f40342b0 0x7f17f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 Processor -- start 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.266+0000 7f191e5b3980 1 -- start start 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a4223c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c0ce640 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17f40342b0 0x7f17f4036770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x559a4221f290 tx=0x7f190c0db040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a41fb9790 con 0x559a4223bc10 2024-03-20T13:36:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a4223c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a4223c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53342/0 (socket says 172.21.15.123:53342) 2024-03-20T13:36:56.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 -- 172.21.15.123:0/4022983187 learned_addr learned my addr 172.21.15.123:0/4022983187 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 -- 172.21.15.123:0/4022983187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a4223c5e0 con 0x559a4223bc10 2024-03-20T13:36:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 --2- 172.21.15.123:0/4022983187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a4223c010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1914049970 tx=0x7f1914049b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0d19a065e8e412 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f17fb7fe640 1 -- 172.21.15.123:0/4022983187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1914011cd0 con 0x559a4223bc10 2024-03-20T13:36:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f17fb7fe640 1 -- 172.21.15.123:0/4022983187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1914040030 con 0x559a4223bc10 2024-03-20T13:36:56.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f17fb7fe640 1 -- 172.21.15.123:0/4022983187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1914020510 con 0x559a4223bc10 2024-03-20T13:36:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- 172.21.15.123:0/4022983187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 msgr2=0x559a4223c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4022983187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a4223c010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1914049970 tx=0x7f1914049b40 comp rx=0 tx=0).stop 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- 172.21.15.123:0/4022983187 shutdown_connections 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4022983187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a4223c010 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- 172.21.15.123:0/4022983187 >> 172.21.15.123:0/4022983187 conn(0x559a42237f50 msgr2=0x559a42235fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- 172.21.15.123:0/4022983187 shutdown_connections 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- 172.21.15.123:0/4022983187 wait complete. 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 Processor -- start 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- start start 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a42242ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a42243010 con 0x559a4223bc10 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a42242ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a42242ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53354/0 (socket says 172.21.15.123:53354) 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 learned_addr learned my addr 172.21.15.123:0/4051610296 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a42230370 con 0x559a4223bc10 2024-03-20T13:36:56.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191c8cf640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a42242ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1914049b80 tx=0x7f19140498d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f17f9ffb640 1 -- 172.21.15.123:0/4051610296 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1914030070 con 0x559a4223bc10 2024-03-20T13:36:56.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.270+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559a42243210 con 0x559a4223bc10 2024-03-20T13:36:56.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f17f9ffb640 1 -- 172.21.15.123:0/4051610296 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140133a0 con 0x559a4223bc10 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a42243640 con 0x559a4223bc10 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f17f9ffb640 1 -- 172.21.15.123:0/4051610296 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19140483c0 con 0x559a4223bc10 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f17f9ffb640 1 -- 172.21.15.123:0/4051610296 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1914049d50 con 0x559a4223bc10 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f17f9ffb640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17ec034300 0x7f17ec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f17f9ffb640 1 -- 172.21.15.123:0/4051610296 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1914037c90 con 0x559a4223bc10 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191c0ce640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17ec034300 0x7f17ec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a4224e1a0 0x559a42250660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42250db0 con 0x559a4224e1a0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f19138cd640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a4224e1a0 0x559a42250660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191c0ce640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17ec034300 0x7f17ec0367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f190c018f70 tx=0x7f190c0e8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f19138cd640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a4224e1a0 0x559a42250660 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 realm 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4224d6c0 con 0x559a4224e1a0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42251830 con 0x559a4224e1a0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a422523a0 0x559a42254860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42254fd0 con 0x559a422523a0 2024-03-20T13:36:56.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.274+0000 7f191c8cf640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a422523a0 0x559a42254860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c8cf640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a422523a0 0x559a42254860 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a422523a0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 20 searching for the correct realm 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559a42257540 0x559a42259930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42259f10 con 0x559a42257540 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c0ce640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559a42257540 0x559a42259930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c0ce640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559a42257540 0x559a42259930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42259f10 con 0x559a422523a0 2024-03-20T13:36:56.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c8cf640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f191401e9d0 0x7f191401e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x7f191401e9d0 2024-03-20T13:36:56.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.278+0000 7f19138cd640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f191401e9d0 0x7f191401e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f191401e9d0 0x7f191401e330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a4224e1a0 2024-03-20T13:36:56.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a4224e1a0 2024-03-20T13:36:56.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a42257540 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a4224e1a0 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a422523a0 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a422523a0 2024-03-20T13:36:56.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a4224e1a0 2024-03-20T13:36:56.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x7f191401e9d0 2024-03-20T13:36:56.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42255820 con 0x559a4224e1a0 2024-03-20T13:36:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.282+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x7f191401e9d0 2024-03-20T13:36:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a422523a0 2024-03-20T13:36:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a42257540 2024-03-20T13:36:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a4224e1a0 2024-03-20T13:36:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a422523a0 2024-03-20T13:36:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a42257540 2024-03-20T13:36:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a4224e1a0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a4224e1a0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a4224e1a0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a42257540 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x7f191401e9d0 2024-03-20T13:36:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.286+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a4224e1a0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x7f191401e9d0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a42257540 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x7f191401e9d0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a422523a0 2024-03-20T13:36:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a422523a0 2024-03-20T13:36:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a42257540 2024-03-20T13:36:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a422523a0 2024-03-20T13:36:56.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.290+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f190402d080 con 0x559a422523a0 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42256020 con 0x559a4224e1a0 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a422563d0 con 0x559a422523a0 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a422563d0 con 0x559a4224e1a0 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 zone default found 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 4 Realm: () 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 zonegroup default 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42256c50 con 0x7f191401e9d0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225c1d0 con 0x559a42257540 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225c530 con 0x559a42257540 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 started sync module instance, tier type = 2024-03-20T13:36:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.294+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225b7a0 con 0x559a422523a0 2024-03-20T13:36:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94121023093584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225b7a0 con 0x559a422523a0 2024-03-20T13:36:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225cea0 con 0x559a4224e1a0 2024-03-20T13:36:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94121023097344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225ce20 con 0x559a4224e1a0 2024-03-20T13:36:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225dd80 con 0x559a422523a0 2024-03-20T13:36:56.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.298+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94121023093584] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94121023097344] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94121023099472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225dd40 con 0x559a422523a0 2024-03-20T13:36:56.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225e5d0 con 0x7f191401e9d0 2024-03-20T13:36:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94121023103280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225dd40 con 0x7f191401e9d0 2024-03-20T13:36:56.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225f120 con 0x559a422523a0 2024-03-20T13:36:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94121023099472] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.302+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94121023103280] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94121023104336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225f120 con 0x559a422523a0 2024-03-20T13:36:56.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225f4d0 con 0x559a42257540 2024-03-20T13:36:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94121023101024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225fd20 con 0x559a42257540 2024-03-20T13:36:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42260740 con 0x559a42257540 2024-03-20T13:36:56.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94121023104336] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94121023111712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42260af0 con 0x559a42257540 2024-03-20T13:36:56.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42261510 con 0x7f191401e9d0 2024-03-20T13:36:56.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.306+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94121023101024] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94121023111712] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94121023106112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a422614d0 con 0x7f191401e9d0 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=0 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=1 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=2 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=3 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=4 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=5 2024-03-20T13:36:56.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=6 2024-03-20T13:36:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94121023106112] v32'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 20 add_watcher() i=7 2024-03-20T13:36:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225f8e0 con 0x559a4224e1a0 2024-03-20T13:36:56.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.310+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94121023115248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225f950 con 0x559a4224e1a0 2024-03-20T13:36:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94121023115248] v32'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f17d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:56.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 5 note: GC not initialized 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f17d17e2640 20 reqs_thread_entry: start 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 20 Filter name: none 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f1742ffd640 20 reqs_thread_entry: start 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42285f10 con 0x559a4224e1a0 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:56.321 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:56.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f17d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.314+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94121023115248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42266a60 con 0x559a4224e1a0 2024-03-20T13:36:56.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.318+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94121023115248] v32'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.318+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94121023093584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42260ff0 con 0x559a422523a0 2024-03-20T13:36:56.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.318+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94121023093584] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.318+0000 7f191e5b3980 20 remove_watcher() i=0 2024-03-20T13:36:56.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.318+0000 7f191e5b3980 2 removed watcher, disabling cache 2024-03-20T13:36:56.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.318+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94121023097344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42260ff0 con 0x559a4224e1a0 2024-03-20T13:36:56.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.322+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94121023097344] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x559a4224e1a0 2024-03-20T13:36:56.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.322+0000 7f191e5b3980 20 remove_watcher() i=1 2024-03-20T13:36:56.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.322+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94121023099472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42260ff0 con 0x559a422523a0 2024-03-20T13:36:56.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.322+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94121023099472] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.322+0000 7f191e5b3980 20 remove_watcher() i=2 2024-03-20T13:36:56.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.322+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94121023103280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225d250 con 0x7f191401e9d0 2024-03-20T13:36:56.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94121023103280] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191e5b3980 20 remove_watcher() i=3 2024-03-20T13:36:56.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94121023104336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a42260ff0 con 0x559a422523a0 2024-03-20T13:36:56.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191c8cf640 1 -- 172.21.15.123:0/4051610296 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94121023104336] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f191400a4d0 con 0x559a422523a0 2024-03-20T13:36:56.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191e5b3980 20 remove_watcher() i=4 2024-03-20T13:36:56.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94121023101024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225e5d0 con 0x559a42257540 2024-03-20T13:36:56.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94121023101024] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191e5b3980 20 remove_watcher() i=5 2024-03-20T13:36:56.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.326+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94121023111712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225e5d0 con 0x559a42257540 2024-03-20T13:36:56.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.330+0000 7f191c0ce640 1 -- 172.21.15.123:0/4051610296 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94121023111712] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190c0cf960 con 0x559a42257540 2024-03-20T13:36:56.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.330+0000 7f191e5b3980 20 remove_watcher() i=6 2024-03-20T13:36:56.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.330+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94121023106112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559a4225e5d0 con 0x7f191401e9d0 2024-03-20T13:36:56.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94121023106112] v32'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f190400f620 con 0x7f191401e9d0 2024-03-20T13:36:56.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 20 remove_watcher() i=7 2024-03-20T13:36:56.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a422523a0 msgr2=0x559a42254860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a422523a0 0x559a42254860 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a4224e1a0 msgr2=0x559a42250660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a4224e1a0 0x559a42250660 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f191401e9d0 msgr2=0x7f191401e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f191401e9d0 0x7f191401e330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559a42257540 msgr2=0x559a42259930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559a42257540 0x559a42259930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17ec034300 msgr2=0x7f17ec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17ec034300 0x7f17ec0367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f190c018f70 tx=0x7f190c0e8000 comp rx=0 tx=0).stop 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f19138cd640 1 -- 172.21.15.123:0/4051610296 reap_dead start 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 msgr2=0x559a42242ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a42242ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1914049b80 tx=0x7f19140498d0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 shutdown_connections 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/4051610296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4223bc10 0x559a42242ad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 >> 172.21.15.123:0/4051610296 conn(0x559a42237f50 msgr2=0x559a422355b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 shutdown_connections 2024-03-20T13:36:56.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/4051610296 wait complete. 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17f40342b0 msgr2=0x7f17f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17f40342b0 0x7f17f4036770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x559a4221f290 tx=0x7f190c0db040 comp rx=0 tx=0).stop 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 msgr2=0x559a4222f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 0x559a4222f090 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1914016cf0 tx=0x7f191400d790 comp rx=0 tx=0).stop 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 shutdown_connections 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f17f40342b0 0x7f17f4036770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 --2- 172.21.15.123:0/1774550791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a4222ec70 0x559a4222f090 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 >> 172.21.15.123:0/1774550791 conn(0x559a42223a80 msgr2=0x559a42224590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 shutdown_connections 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.334+0000 7f191e5b3980 1 -- 172.21.15.123:0/1774550791 wait complete. 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a4221c1f0 msgr2=0x559a4221e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a4221c1f0 0x559a4221e5e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a42219050 msgr2=0x559a4221b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a42219050 0x559a4221b440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1804034300 msgr2=0x7f18040367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1804034300 0x7f18040367c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1904000f70 tx=0x7f1904001380 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 msgr2=0x559a422143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a422143e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f190c01bb80 tx=0x7f190c0180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 shutdown_connections 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559a4221c1f0 0x559a4221e5e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559a42219050 0x559a4221b440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1804034300 0x7f18040367c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 --2- 172.21.15.123:0/2158146833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559a420964c0 0x559a422143e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 >> 172.21.15.123:0/2158146833 conn(0x559a4211c850 msgr2=0x559a42207cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 shutdown_connections 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.338+0000 7f191e5b3980 1 -- 172.21.15.123:0/2158146833 wait complete. 2024-03-20T13:36:56.353 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:56.353 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-03-20T13:36:56.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-03-20T13:36:56.354 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-03-20T13:36:56.426 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:56.426 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:56.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef8b2ac980 1 Processor -- start 2024-03-20T13:36:56.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef8b2ac980 1 -- start start 2024-03-20T13:36:56.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef8b2ac980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56166c7058b0 0x56166c793c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef8b2ac980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56166c6dd520 con 0x56166c794170 2024-03-20T13:36:56.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef8b2ac980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56166c6a40f0 con 0x56166c7058b0 2024-03-20T13:36:56.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef88dc7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56166c7058b0 0x56166c793c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef88dc7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56166c7058b0 0x56166c793c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53370/0 (socket says 172.21.15.123:53370) 2024-03-20T13:36:56.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef88dc7640 1 -- 172.21.15.123:0/714020823 learned_addr learned my addr 172.21.15.123:0/714020823 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef88dc7640 1 -- 172.21.15.123:0/714020823 >> v1:172.21.15.89:6789/0 conn(0x56166c794170 legacy=0x56166c796560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.422+0000 7fef88dc7640 1 -- 172.21.15.123:0/714020823 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166c798cc0 con 0x56166c7058b0 2024-03-20T13:36:56.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef88dc7640 1 --2- 172.21.15.123:0/714020823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c793c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef7800a5c0 tx=0x7fef7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f396a772815b7ca server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef87dc5640 1 -- 172.21.15.123:0/714020823 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef780aa470 con 0x56166c7058b0 2024-03-20T13:36:56.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef87dc5640 1 -- 172.21.15.123:0/714020823 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780aa5d0 con 0x56166c7058b0 2024-03-20T13:36:56.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef87dc5640 1 -- 172.21.15.123:0/714020823 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef780aa890 con 0x56166c7058b0 2024-03-20T13:36:56.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 -- 172.21.15.123:0/714020823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 msgr2=0x56166c793c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/714020823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c793c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef7800a5c0 tx=0x7fef7801b340 comp rx=0 tx=0).stop 2024-03-20T13:36:56.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 -- 172.21.15.123:0/714020823 shutdown_connections 2024-03-20T13:36:56.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/714020823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c793c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 -- 172.21.15.123:0/714020823 >> 172.21.15.123:0/714020823 conn(0x56166c78b710 msgr2=0x56166c78db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 -- 172.21.15.123:0/714020823 shutdown_connections 2024-03-20T13:36:56.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.426+0000 7fef8b2ac980 1 -- 172.21.15.123:0/714020823 wait complete. 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef8b2ac980 1 Processor -- start 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef8b2ac980 1 -- start start 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef8b2ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c87aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef8b2ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166c6a1620 con 0x56166c7058b0 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef88dc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c87aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef88dc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c87aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53372/0 (socket says 172.21.15.123:53372) 2024-03-20T13:36:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef88dc7640 1 -- 172.21.15.123:0/274598817 learned_addr learned my addr 172.21.15.123:0/274598817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef88dc7640 1 -- 172.21.15.123:0/274598817 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78005df0 con 0x56166c7058b0 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fef88dc7640 1 --2- 172.21.15.123:0/274598817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c87aeb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef780ac040 tx=0x7fef78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3208fc81119620 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fee76e0d640 1 -- 172.21.15.123:0/274598817 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef780aa9b0 con 0x56166c7058b0 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fee76e0d640 1 -- 172.21.15.123:0/274598817 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780aab30 con 0x56166c7058b0 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.442+0000 7fee76e0d640 1 -- 172.21.15.123:0/274598817 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef780aae10 con 0x56166c7058b0 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/274598817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 msgr2=0x56166c87aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/274598817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c87aeb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef780ac040 tx=0x7fef78003030 comp rx=0 tx=0).stop 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/274598817 shutdown_connections 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/274598817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c87aeb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/274598817 >> 172.21.15.123:0/274598817 conn(0x56166c78b710 msgr2=0x56166c876a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/274598817 shutdown_connections 2024-03-20T13:36:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/274598817 wait complete. 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 Processor -- start 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- start start 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c881c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166c69ce00 con 0x56166c7058b0 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef88dc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c881c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef88dc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c881c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53378/0 (socket says 172.21.15.123:53378) 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef88dc7640 1 -- 172.21.15.123:0/3802744243 learned_addr learned my addr 172.21.15.123:0/3802744243 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef88dc7640 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166c798cc0 con 0x56166c7058b0 2024-03-20T13:36:56.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c881c00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef78005940 tx=0x7fef780180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fee7560a640 1 -- 172.21.15.123:0/3802744243 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef780c6750 con 0x56166c7058b0 2024-03-20T13:36:56.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56166c882140 con 0x56166c7058b0 2024-03-20T13:36:56.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fee7560a640 1 -- 172.21.15.123:0/3802744243 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780c68b0 con 0x56166c7058b0 2024-03-20T13:36:56.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fee7560a640 1 -- 172.21.15.123:0/3802744243 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef780c6b50 con 0x56166c7058b0 2024-03-20T13:36:56.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.446+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56166c882570 con 0x56166c7058b0 2024-03-20T13:36:56.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fee7560a640 1 -- 172.21.15.123:0/3802744243 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fef780c6cb0 con 0x56166c7058b0 2024-03-20T13:36:56.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fee7560a640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee700342b0 0x7fee70036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fee7560a640 1 -- 172.21.15.123:0/3802744243 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fef780e4300 con 0x56166c7058b0 2024-03-20T13:36:56.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef885c6640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee700342b0 0x7fee70036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c794170 0x56166c888830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c888d70 con 0x56166c794170 2024-03-20T13:36:56.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef895c8640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c794170 0x56166c888830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef885c6640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee700342b0 0x7fee70036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef7c001e20 tx=0x7fef7c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef895c8640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c794170 0x56166c888830 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef895c8640 1 -- 172.21.15.123:0/3802744243 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c794170 2024-03-20T13:36:56.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8895e0 0x56166c88b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c88c090 con 0x56166c8895e0 2024-03-20T13:36:56.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8895e0 0x56166c88b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8895e0 0x56166c88b9d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef88dc7640 1 -- 172.21.15.123:0/3802744243 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8895e0 2024-03-20T13:36:56.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.450+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c88d8d0 con 0x56166c8895e0 2024-03-20T13:36:56.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef88dc7640 1 -- 172.21.15.123:0/3802744243 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8895e0 2024-03-20T13:36:56.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c88ca10 con 0x56166c8895e0 2024-03-20T13:36:56.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef88dc7640 1 -- 172.21.15.123:0/3802744243 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8895e0 2024-03-20T13:36:56.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c88ce20 con 0x56166c794170 2024-03-20T13:36:56.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef895c8640 1 -- 172.21.15.123:0/3802744243 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c794170 2024-03-20T13:36:56.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 Processor -- start 2024-03-20T13:36:56.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 -- start start 2024-03-20T13:36:56.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 0x56166c89c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166c635e30 con 0x56166c89bfe0 2024-03-20T13:36:56.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef895c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 0x56166c89c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef895c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 0x56166c89c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53388/0 (socket says 172.21.15.123:53388) 2024-03-20T13:36:56.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef895c8640 1 -- 172.21.15.123:0/3630335636 learned_addr learned my addr 172.21.15.123:0/3630335636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef895c8640 1 -- 172.21.15.123:0/3630335636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166c89c940 con 0x56166c89bfe0 2024-03-20T13:36:56.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef895c8640 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 0x56166c89c400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef80016cf0 tx=0x7fef8000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fee6e7fc640 1 -- 172.21.15.123:0/3630335636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef80017660 con 0x56166c89bfe0 2024-03-20T13:36:56.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56166c89cb90 con 0x56166c89bfe0 2024-03-20T13:36:56.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.454+0000 7fee6e7fc640 1 -- 172.21.15.123:0/3630335636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef800177c0 con 0x56166c89bfe0 2024-03-20T13:36:56.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee6e7fc640 1 -- 172.21.15.123:0/3630335636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef80017a60 con 0x56166c89bfe0 2024-03-20T13:36:56.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56166c89d6e0 con 0x56166c89bfe0 2024-03-20T13:36:56.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee6e7fc640 1 -- 172.21.15.123:0/3630335636 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fef8001d020 con 0x56166c89bfe0 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee6e7fc640 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee60034300 0x7fee600367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee6e7fc640 1 -- 172.21.15.123:0/3630335636 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fef8004b5f0 con 0x56166c89bfe0 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee60034300 0x7fee600367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef8b2ac980 1 Processor -- start 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef8b2ac980 1 -- start start 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee60034300 0x7fee600367c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x56166c88c510 tx=0x7fef780de040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef8b2ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c791590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef8b2ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166c629790 con 0x56166c791170 2024-03-20T13:36:56.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef895c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c791590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef895c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c791590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53402/0 (socket says 172.21.15.123:53402) 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef895c8640 1 -- 172.21.15.123:0/1297579046 learned_addr learned my addr 172.21.15.123:0/1297579046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef895c8640 1 -- 172.21.15.123:0/1297579046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166c78fa10 con 0x56166c791170 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fef895c8640 1 --2- 172.21.15.123:0/1297579046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c791590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef8000a100 tx=0x7fef800205d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159342809799526d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee5ffff640 1 -- 172.21.15.123:0/1297579046 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef80048070 con 0x56166c791170 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee5ffff640 1 -- 172.21.15.123:0/1297579046 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8001fcb0 con 0x56166c791170 2024-03-20T13:36:56.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.458+0000 7fee5ffff640 1 -- 172.21.15.123:0/1297579046 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef8004b0d0 con 0x56166c791170 2024-03-20T13:36:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/1297579046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 msgr2=0x56166c791590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/1297579046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c791590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef8000a100 tx=0x7fef800205d0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/1297579046 shutdown_connections 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/1297579046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c791590 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/1297579046 >> 172.21.15.123:0/1297579046 conn(0x56166c8a5270 msgr2=0x56166c8a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/1297579046 shutdown_connections 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/1297579046 wait complete. 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 Processor -- start 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- start start 2024-03-20T13:36:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c8b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166c8b2530 con 0x56166c791170 2024-03-20T13:36:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef895c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c8b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef895c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c8b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53412/0 (socket says 172.21.15.123:53412) 2024-03-20T13:36:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 learned_addr learned my addr 172.21.15.123:0/3324045564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166c89d6e0 con 0x56166c791170 2024-03-20T13:36:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef895c8640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c8b1ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef80020610 tx=0x7fef800498b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fee5e7fc640 1 -- 172.21.15.123:0/3324045564 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef80011cf0 con 0x56166c791170 2024-03-20T13:36:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56166c8b2730 con 0x56166c791170 2024-03-20T13:36:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fee5e7fc640 1 -- 172.21.15.123:0/3324045564 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef80011e50 con 0x56166c791170 2024-03-20T13:36:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fee5e7fc640 1 -- 172.21.15.123:0/3324045564 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef80049b90 con 0x56166c791170 2024-03-20T13:36:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56166c8b2b60 con 0x56166c791170 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fee5e7fc640 1 -- 172.21.15.123:0/3324045564 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fef80049cf0 con 0x56166c791170 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fee5e7fc640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee540342b0 0x7fee54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.462+0000 7fee5e7fc640 1 -- 172.21.15.123:0/3324045564 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fef80018040 con 0x56166c791170 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee540342b0 0x7fee54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c8bd700 0x56166c8bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c0310 con 0x56166c8bd700 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef885c6640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c8bd700 0x56166c8bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee540342b0 0x7fee54036770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef780e4630 tx=0x7fef780e7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef885c6640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c8bd700 0x56166c8bfbc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 realm 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8bcb60 con 0x56166c8bd700 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c0d90 con 0x56166c8bd700 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8c1b20 0x56166c8c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c45f0 con 0x56166c8c1b20 2024-03-20T13:36:56.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef895c8640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8c1b20 0x56166c8c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef895c8640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8c1b20 0x56166c8c3f10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c8c1b20 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.466+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c4df0 con 0x56166c8c1b20 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c8c1b20 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef8b2ac980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef8b2ac980 20 searching for the correct realm 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56166c8c6e50 0x56166c8c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56166c8c6e50 0x56166c8c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef88dc7640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56166c8c6e50 0x56166c8c9310 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c8c1b20 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef895c8640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fef8003b850 0x7fef8001d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x7fef8003b850 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fef8003b850 0x7fef8001d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fef8003b850 0x7fef8001d8c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x7fef8003b850 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.470+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c8c1b20 2024-03-20T13:36:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef8000a4d0 con 0x56166c8c1b20 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x7fef8003b850 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x7fef8003b850 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x7fef8003b850 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fef7c0105b0 con 0x7fef8003b850 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.474+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c0105b0 con 0x56166c8bd700 2024-03-20T13:36:56.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x7fef8003b850 2024-03-20T13:36:56.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8bd700 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x7fef8003b850 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.478+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x7fef8003b850 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c6e50 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c99e0 con 0x56166c8c1b20 2024-03-20T13:36:56.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c63e0 con 0x56166c8bd700 2024-03-20T13:36:56.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.482+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c5330 con 0x56166c8c1b20 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c5300 con 0x56166c8bd700 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 zone default found 2024-03-20T13:36:56.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 4 Realm: () 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 zonegroup default 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8c5e50 con 0x7fef8003b850 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cbd90 con 0x56166c8c6e50 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cc210 con 0x56166c8c6e50 2024-03-20T13:36:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 started sync module instance, tier type = 2024-03-20T13:36:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:56.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.486+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cb0e0 con 0x56166c8c1b20 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654310427712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cb060 con 0x56166c8c1b20 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8ccf70 con 0x56166c8bd700 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654310435536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cd770 con 0x56166c8bd700 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cdf70 con 0x56166c8c1b20 2024-03-20T13:36:56.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654310427712] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.490+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654310435536] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654310437584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cdb90 con 0x56166c8c1b20 2024-03-20T13:36:56.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8ce3d0 con 0x7fef8003b850 2024-03-20T13:36:56.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654310439824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cdfb0 con 0x7fef8003b850 2024-03-20T13:36:56.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cf290 con 0x56166c8c1b20 2024-03-20T13:36:56.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654310437584] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.494+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654310439824] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654310442880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cf250 con 0x56166c8c1b20 2024-03-20T13:36:56.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cf6b0 con 0x56166c8c6e50 2024-03-20T13:36:56.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654310438640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cf670 con 0x56166c8c6e50 2024-03-20T13:36:56.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8d0530 con 0x56166c8c6e50 2024-03-20T13:36:56.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654310442880] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654310449264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8d0530 con 0x56166c8c6e50 2024-03-20T13:36:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8d0ef0 con 0x7fef8003b850 2024-03-20T13:36:56.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.498+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654310438640] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654310449264] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654310444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8d0a50 con 0x7fef8003b850 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=0 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=1 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=2 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=3 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=4 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=5 2024-03-20T13:36:56.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=6 2024-03-20T13:36:56.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654310444432] v32'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 20 add_watcher() i=7 2024-03-20T13:36:56.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:56.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8d0a50 con 0x56166c8bd700 2024-03-20T13:36:56.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.502+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654310447712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8d1630 con 0x56166c8bd700 2024-03-20T13:36:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654310447712] v32'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fee3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:56.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 5 note: GC not initialized 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fee3dfe3640 20 reqs_thread_entry: start 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 20 Filter name: none 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fedaf7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8f5de0 con 0x56166c8bd700 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:56.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8f8300 con 0x7fef8003b850 2024-03-20T13:36:56.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8fba80 con 0x56166c8bd700 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v32'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.506+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94654310627104 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8f87a0 con 0x56166c8c1b20 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94654310442880 notify 137438953473 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fef8006b040 con 0x56166c8c1b20 2024-03-20T13:36:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 notify.4 [notify cookie 94654310627104 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fee5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94654310442880 notifier 4311 bl.length()=533 2024-03-20T13:36:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fee5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fee5f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fee5f7fe640 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fedbc003430 con 0x56166c8c1b20 2024-03-20T13:36:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify_complete (2) cookie 94654310627104 notify 137438953473 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56166c8b2b60 con 0x56166c8c1b20 2024-03-20T13:36:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.517 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fee3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.510+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654310447712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8bada0 con 0x56166c8bd700 2024-03-20T13:36:56.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.514+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94654310447712] v32'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.514+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654310427712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cfa60 con 0x56166c8c1b20 2024-03-20T13:36:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.514+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94654310427712] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.514+0000 7fef8b2ac980 20 remove_watcher() i=0 2024-03-20T13:36:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.514+0000 7fef8b2ac980 2 removed watcher, disabling cache 2024-03-20T13:36:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.514+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654310435536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cfa60 con 0x56166c8bd700 2024-03-20T13:36:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.518+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94654310435536] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x56166c8bd700 2024-03-20T13:36:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.518+0000 7fef8b2ac980 20 remove_watcher() i=1 2024-03-20T13:36:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.518+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654310437584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cfa60 con 0x56166c8c1b20 2024-03-20T13:36:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.518+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94654310437584] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.518+0000 7fef8b2ac980 20 remove_watcher() i=2 2024-03-20T13:36:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.518+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654310439824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cd2d0 con 0x7fef8003b850 2024-03-20T13:36:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94654310439824] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef8b2ac980 20 remove_watcher() i=3 2024-03-20T13:36:56.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654310442880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cfa60 con 0x56166c8c1b20 2024-03-20T13:36:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef895c8640 1 -- 172.21.15.123:0/3324045564 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94654310442880] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef80062040 con 0x56166c8c1b20 2024-03-20T13:36:56.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef8b2ac980 20 remove_watcher() i=4 2024-03-20T13:36:56.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654310438640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cdb90 con 0x56166c8c6e50 2024-03-20T13:36:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94654310438640] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef8b2ac980 20 remove_watcher() i=5 2024-03-20T13:36:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.522+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654310449264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cd770 con 0x56166c8c6e50 2024-03-20T13:36:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef88dc7640 1 -- 172.21.15.123:0/3324045564 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94654310449264] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef780b0020 con 0x56166c8c6e50 2024-03-20T13:36:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 20 remove_watcher() i=6 2024-03-20T13:36:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654310444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56166c8cd770 con 0x7fef8003b850 2024-03-20T13:36:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94654310444432] v32'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef7c028040 con 0x7fef8003b850 2024-03-20T13:36:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 20 remove_watcher() i=7 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8c1b20 msgr2=0x56166c8c3f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8c1b20 0x56166c8c3f10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c8bd700 msgr2=0x56166c8bfbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c8bd700 0x56166c8bfbc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fef8003b850 msgr2=0x7fef8001d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fef8003b850 0x7fef8001d8c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56166c8c6e50 msgr2=0x56166c8c9310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56166c8c6e50 0x56166c8c9310 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee540342b0 msgr2=0x7fee54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee540342b0 0x7fee54036770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef780e4630 tx=0x7fef780e7000 comp rx=0 tx=0).stop 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef885c6640 1 -- 172.21.15.123:0/3324045564 reap_dead start 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 msgr2=0x56166c8b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.526+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c8b1ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef80020610 tx=0x7fef800498b0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 shutdown_connections 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3324045564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c791170 0x56166c8b1ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 >> 172.21.15.123:0/3324045564 conn(0x56166c8a5270 msgr2=0x56166c8a2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 shutdown_connections 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3324045564 wait complete. 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee60034300 msgr2=0x7fee600367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee60034300 0x7fee600367c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x56166c88c510 tx=0x7fef780de040 comp rx=0 tx=0).stop 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 msgr2=0x56166c89c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 0x56166c89c400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef80016cf0 tx=0x7fef8000d790 comp rx=0 tx=0).stop 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 shutdown_connections 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee60034300 0x7fee600367c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3630335636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c89bfe0 0x56166c89c400 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 >> 172.21.15.123:0/3630335636 conn(0x56166c890df0 msgr2=0x56166c891900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 shutdown_connections 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3630335636 wait complete. 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8895e0 msgr2=0x56166c88b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8895e0 0x56166c88b9d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c794170 msgr2=0x56166c888830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c794170 0x56166c888830 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee700342b0 msgr2=0x7fee70036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee700342b0 0x7fee70036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef7c001e20 tx=0x7fef7c0013a0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 msgr2=0x56166c881c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c881c00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef78005940 tx=0x7fef780180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 shutdown_connections 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56166c8895e0 0x56166c88b9d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56166c794170 0x56166c888830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fee700342b0 0x7fee70036770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 --2- 172.21.15.123:0/3802744243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56166c7058b0 0x56166c881c00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 >> 172.21.15.123:0/3802744243 conn(0x56166c78b710 msgr2=0x56166c875550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 shutdown_connections 2024-03-20T13:36:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.530+0000 7fef8b2ac980 1 -- 172.21.15.123:0/3802744243 wait complete. 2024-03-20T13:36:56.546 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:56.547 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:56.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:56.547 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:56.626 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:56.626 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02850dc980 1 Processor -- start 2024-03-20T13:36:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02850dc980 1 -- start start 2024-03-20T13:36:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02850dc980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c5084a66a0 0x55c5084a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02850dc980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c5083f1520 con 0x55c5084a6fc0 2024-03-20T13:36:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02850dc980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c5083b80f0 con 0x55c5084a66a0 2024-03-20T13:36:56.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f0282bf7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c5084a66a0 0x55c5084a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02823f6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55c5084a6fc0 0x55c5084a3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58956/0 (socket says 172.21.15.123:58956) 2024-03-20T13:36:56.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f02823f6640 1 -- 172.21.15.123:0/1931259967 learned_addr learned my addr 172.21.15.123:0/1931259967 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:56.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f0281bf5640 1 -- 172.21.15.123:0/1931259967 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500262438 0 0) 0x55c5083f1520 con 0x55c5084a6fc0 2024-03-20T13:36:56.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f0281bf5640 1 -- 172.21.15.123:0/1931259967 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c001e20 con 0x55c5084a6fc0 2024-03-20T13:36:56.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f0282bf7640 1 -- 172.21.15.123:0/1931259967 >> v1:172.21.15.89:6789/0 conn(0x55c5084a6fc0 legacy=0x55c5084a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.622+0000 7f0282bf7640 1 -- 172.21.15.123:0/1931259967 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5084a3820 con 0x55c5084a66a0 2024-03-20T13:36:56.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f0282bf7640 1 --2- 172.21.15.123:0/1931259967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a6a80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f027400a480 tx=0x7f027401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf7c313c8720f8f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f0281bf5640 1 -- 172.21.15.123:0/1931259967 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02740ab540 con 0x55c5084a66a0 2024-03-20T13:36:56.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f0281bf5640 1 -- 172.21.15.123:0/1931259967 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740ab6a0 con 0x55c5084a66a0 2024-03-20T13:36:56.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f0281bf5640 1 -- 172.21.15.123:0/1931259967 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02740ab940 con 0x55c5084a66a0 2024-03-20T13:36:56.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 -- 172.21.15.123:0/1931259967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 msgr2=0x55c5084a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 --2- 172.21.15.123:0/1931259967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a6a80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f027400a480 tx=0x7f027401b280 comp rx=0 tx=0).stop 2024-03-20T13:36:56.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 -- 172.21.15.123:0/1931259967 shutdown_connections 2024-03-20T13:36:56.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 --2- 172.21.15.123:0/1931259967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a6a80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 -- 172.21.15.123:0/1931259967 >> 172.21.15.123:0/1931259967 conn(0x55c50849ee50 msgr2=0x55c5084a1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 -- 172.21.15.123:0/1931259967 shutdown_connections 2024-03-20T13:36:56.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.626+0000 7f02850dc980 1 -- 172.21.15.123:0/1931259967 wait complete. 2024-03-20T13:36:56.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f02850dc980 1 Processor -- start 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f02850dc980 1 -- start start 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f02850dc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c50858f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f02850dc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5083b5620 con 0x55c5084a66a0 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0282bf7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c50858f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0282bf7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c50858f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53428/0 (socket says 172.21.15.123:53428) 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0282bf7640 1 -- 172.21.15.123:0/635109042 learned_addr learned my addr 172.21.15.123:0/635109042 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0282bf7640 1 -- 172.21.15.123:0/635109042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274005d30 con 0x55c5084a66a0 2024-03-20T13:36:56.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0282bf7640 1 --2- 172.21.15.123:0/635109042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c50858f3b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0274017e90 tx=0x7f0274003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78037826777e31fa server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0170e09640 1 -- 172.21.15.123:0/635109042 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02740ab810 con 0x55c5084a66a0 2024-03-20T13:36:56.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0170e09640 1 -- 172.21.15.123:0/635109042 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740ab970 con 0x55c5084a66a0 2024-03-20T13:36:56.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.642+0000 7f0170e09640 1 -- 172.21.15.123:0/635109042 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02740abc50 con 0x55c5084a66a0 2024-03-20T13:36:56.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/635109042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 msgr2=0x55c50858f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 --2- 172.21.15.123:0/635109042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c50858f3b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0274017e90 tx=0x7f0274003030 comp rx=0 tx=0).stop 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/635109042 shutdown_connections 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 --2- 172.21.15.123:0/635109042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c50858f3b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/635109042 >> 172.21.15.123:0/635109042 conn(0x55c50849ee50 msgr2=0x55c50858af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/635109042 shutdown_connections 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/635109042 wait complete. 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 Processor -- start 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- start start 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5083b0e00 con 0x55c5084a66a0 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f0282bf7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f0282bf7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53438/0 (socket says 172.21.15.123:53438) 2024-03-20T13:36:56.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f0282bf7640 1 -- 172.21.15.123:0/1189241166 learned_addr learned my addr 172.21.15.123:0/1189241166 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f0282bf7640 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5084a3820 con 0x55c5084a66a0 2024-03-20T13:36:56.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f0282bf7640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a5b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0274017e90 tx=0x7f0274018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f016f606640 1 -- 172.21.15.123:0/1189241166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02740c4070 con 0x55c5084a66a0 2024-03-20T13:36:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f016f606640 1 -- 172.21.15.123:0/1189241166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274005710 con 0x55c5084a66a0 2024-03-20T13:36:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f016f606640 1 -- 172.21.15.123:0/1189241166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02740bfa70 con 0x55c5084a66a0 2024-03-20T13:36:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c5084a6040 con 0x55c5084a66a0 2024-03-20T13:36:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.646+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5084a4580 con 0x55c5084a66a0 2024-03-20T13:36:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f016f606640 1 -- 172.21.15.123:0/1189241166 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f02740b2070 con 0x55c5084a66a0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f016f606640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0168034300 0x7f01680367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f016f606640 1 -- 172.21.15.123:0/1189241166 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f02740e35c0 con 0x55c5084a66a0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02823f6640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0168034300 0x7f01680367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5084a6fc0 0x55c50859f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c50859f560 con 0x55c5084a6fc0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02833f8640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5084a6fc0 0x55c50859f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02823f6640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0168034300 0x7f01680367c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0278000f70 tx=0x7f02780010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02833f8640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5084a6fc0 0x55c50859f020 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02833f8640 1 -- 172.21.15.123:0/1189241166 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5084a6fc0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c50859fdd0 0x55c5085a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085a2720 con 0x55c50859fdd0 2024-03-20T13:36:56.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f0282bf7640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c50859fdd0 0x55c5085a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f0282bf7640 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c50859fdd0 0x55c5085a21c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f0282bf7640 1 -- 172.21.15.123:0/1189241166 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f02740aacd0 con 0x55c50859fdd0 2024-03-20T13:36:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.650+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085a3fd0 con 0x55c50859fdd0 2024-03-20T13:36:56.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f0282bf7640 1 -- 172.21.15.123:0/1189241166 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f02740aacd0 con 0x55c50859fdd0 2024-03-20T13:36:56.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085a3110 con 0x55c50859fdd0 2024-03-20T13:36:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f0282bf7640 1 -- 172.21.15.123:0/1189241166 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f02740aacd0 con 0x55c50859fdd0 2024-03-20T13:36:56.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085a3520 con 0x55c5084a6fc0 2024-03-20T13:36:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02833f8640 1 -- 172.21.15.123:0/1189241166 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5084a6fc0 2024-03-20T13:36:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 Processor -- start 2024-03-20T13:36:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 -- start start 2024-03-20T13:36:56.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 0x55c5085b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c508349e30 con 0x55c5085b26e0 2024-03-20T13:36:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02833f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 0x55c5085b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02833f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 0x55c5085b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53446/0 (socket says 172.21.15.123:53446) 2024-03-20T13:36:56.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02833f8640 1 -- 172.21.15.123:0/1818862333 learned_addr learned my addr 172.21.15.123:0/1818862333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02833f8640 1 -- 172.21.15.123:0/1818862333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5085b3040 con 0x55c5085b26e0 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02833f8640 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 0x55c5085b2b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f027c016c80 tx=0x7f027c00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f016ce01640 1 -- 172.21.15.123:0/1818862333 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f027c017580 con 0x55c5085b26e0 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f016ce01640 1 -- 172.21.15.123:0/1818862333 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c0176e0 con 0x55c5085b26e0 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c5085b3290 con 0x55c5085b26e0 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f016ce01640 1 -- 172.21.15.123:0/1818862333 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f027c017980 con 0x55c5085b26e0 2024-03-20T13:36:56.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.654+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5085b3de0 con 0x55c5085b26e0 2024-03-20T13:36:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f016ce01640 1 -- 172.21.15.123:0/1818862333 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f027c01d020 con 0x55c5085b26e0 2024-03-20T13:36:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f016ce01640 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f015c0342b0 0x7f015c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f016ce01640 1 -- 172.21.15.123:0/1818862333 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f027c04b220 con 0x55c5085b26e0 2024-03-20T13:36:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f0282bf7640 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f015c0342b0 0x7f015c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 Processor -- start 2024-03-20T13:36:56.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- start start 2024-03-20T13:36:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f0282bf7640 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f015c0342b0 0x7f015c036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55c5085a2c10 tx=0x7f02740e1980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c50833d790 con 0x55c5085bf5b0 2024-03-20T13:36:56.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02833f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02833f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085bf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53448/0 (socket says 172.21.15.123:53448) 2024-03-20T13:36:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02833f8640 1 -- 172.21.15.123:0/1858942517 learned_addr learned my addr 172.21.15.123:0/1858942517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02833f8640 1 -- 172.21.15.123:0/1858942517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5085bfef0 con 0x55c5085bf5b0 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02833f8640 1 --2- 172.21.15.123:0/1858942517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085bf9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f027c015010 tx=0x7f027c049690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a23e056ea62dd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f01667fc640 1 -- 172.21.15.123:0/1858942517 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f027c0145f0 con 0x55c5085bf5b0 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f01667fc640 1 -- 172.21.15.123:0/1858942517 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c03b180 con 0x55c5085bf5b0 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f01667fc640 1 -- 172.21.15.123:0/1858942517 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f027c017bc0 con 0x55c5085bf5b0 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- 172.21.15.123:0/1858942517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 msgr2=0x55c5085bf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 --2- 172.21.15.123:0/1858942517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085bf9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f027c015010 tx=0x7f027c049690 comp rx=0 tx=0).stop 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- 172.21.15.123:0/1858942517 shutdown_connections 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 --2- 172.21.15.123:0/1858942517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085bf9b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- 172.21.15.123:0/1858942517 >> 172.21.15.123:0/1858942517 conn(0x55c5085bb900 msgr2=0x55c5085b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- 172.21.15.123:0/1858942517 shutdown_connections 2024-03-20T13:36:56.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.658+0000 7f02850dc980 1 -- 172.21.15.123:0/1858942517 wait complete. 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 Processor -- start 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 -- start start 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5085c6ad0 con 0x55c5085bf5b0 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02833f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02833f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53462/0 (socket says 172.21.15.123:53462) 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 learned_addr learned my addr 172.21.15.123:0/2026747429 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5085b3de0 con 0x55c5085bf5b0 2024-03-20T13:36:56.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02833f8640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085c6590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f027c015010 tx=0x7f027c0494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0164ff9640 1 -- 172.21.15.123:0/2026747429 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f027c0481d0 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0164ff9640 1 -- 172.21.15.123:0/2026747429 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c049960 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c5085c6cd0 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0164ff9640 1 -- 172.21.15.123:0/2026747429 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f027c049b10 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5085c7100 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0164ff9640 1 -- 172.21.15.123:0/2026747429 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f027c049c70 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0164ff9640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f014c0342b0 0x7f014c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0164ff9640 1 -- 172.21.15.123:0/2026747429 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f027c04cd60 con 0x55c5085bf5b0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f0282bf7640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f014c0342b0 0x7f014c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5085d1bd0 0x55c5085d4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d47c0 con 0x55c5085d1bd0 2024-03-20T13:36:56.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.662+0000 7f02823f6640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5085d1bd0 0x55c5085d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f0282bf7640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f014c0342b0 0x7f014c036770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02740aa6f0 tx=0x7f02740da000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02823f6640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5085d1bd0 0x55c5085d4070 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 realm 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d10f0 con 0x55c5085d1bd0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d5240 con 0x55c5085d1bd0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c5085d5e00 0x55c5085d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d8a30 con 0x55c5085d5e00 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02833f8640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c5085d5e00 0x55c5085d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02833f8640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c5085d5e00 0x55c5085d82c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5085d5e00 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d9280 con 0x55c5085d5e00 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5085d5e00 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 20 searching for the correct realm 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c5085dafa0 0x55c5085dd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.666+0000 7f0282bf7640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c5085dafa0 0x55c5085dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f0282bf7640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c5085dafa0 0x55c5085dd390 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5085d5e00 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02833f8640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f027c033070 0x7f027c020640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x7f027c033070 2024-03-20T13:36:56.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f027c033070 0x7f027c020640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f027c033070 0x7f027c020640 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.670+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5085d5e00 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c00a4d0 con 0x55c5085d5e00 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x7f027c033070 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x7f027c033070 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.674+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x7f027c033070 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d1bd0 2024-03-20T13:36:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x7f027c033070 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x7f027c033070 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.678+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085dafa0 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dd920 con 0x55c5085d5e00 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:56.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d9bb0 con 0x55c5085d1bd0 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085d9ff0 con 0x55c5085d5e00 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085da3d0 con 0x55c5085d1bd0 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f027800e640 con 0x55c5085d1bd0 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 zone default found 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 4 Realm: () 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 zonegroup default 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085ddd60 con 0x7f027c033070 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f027800e640 con 0x7f027c033070 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.682+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085dff40 con 0x55c5085dafa0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e02a0 con 0x55c5085dafa0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 20 started sync module instance, tier type = 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:56.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085df510 con 0x55c5085d5e00 2024-03-20T13:36:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94304737294528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085df510 con 0x55c5085d5e00 2024-03-20T13:36:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.686+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e0c50 con 0x55c5085d1bd0 2024-03-20T13:36:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.690+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.690+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94304737298288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e14a0 con 0x55c5085d1bd0 2024-03-20T13:36:56.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.690+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e1ea0 con 0x55c5085d5e00 2024-03-20T13:36:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.690+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94304737294528] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.690+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94304737298288] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94304737302944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e1000 con 0x55c5085d5e00 2024-03-20T13:36:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e26f0 con 0x7f027c033070 2024-03-20T13:36:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x7f027c033070 2024-03-20T13:36:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94304737305168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e1000 con 0x7f027c033070 2024-03-20T13:36:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e3160 con 0x55c5085d5e00 2024-03-20T13:36:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94304737305168] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x7f027c033070 2024-03-20T13:36:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94304737302944] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94304737292400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e2c80 con 0x55c5085d5e00 2024-03-20T13:36:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.694+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e39b0 con 0x55c5085dafa0 2024-03-20T13:36:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94304737309968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e2c80 con 0x55c5085dafa0 2024-03-20T13:36:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e47c0 con 0x55c5085dafa0 2024-03-20T13:36:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94304737292400] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94304737309968] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94304737306224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e47c0 con 0x55c5085dafa0 2024-03-20T13:36:56.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.698+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e5050 con 0x7f027c033070 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x7f027c033070 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94304737315696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e5030 con 0x7f027c033070 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=0 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=1 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=2 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=3 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=4 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=5 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94304737306224] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=6 2024-03-20T13:36:56.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94304737315696] v32'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x7f027c033070 2024-03-20T13:36:56.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 20 add_watcher() i=7 2024-03-20T13:36:56.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:56.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.702+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e4320 con 0x55c5085d1bd0 2024-03-20T13:36:56.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94304737317552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e4320 con 0x55c5085d1bd0 2024-03-20T13:36:56.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94304737317552] v32'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f0139fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:56.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 5 note: GC not initialized 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f0138fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 20 Filter name: none 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f0131ffb640 20 reqs_thread_entry: start 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c508609f60 con 0x55c5085d1bd0 2024-03-20T13:36:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.706+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.710+0000 7f02850dc980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:56.715 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.710+0000 7f0139fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.710+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94304737317552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085eaae0 con 0x55c5085d1bd0 2024-03-20T13:36:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.710+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94304737317552] v32'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.710+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94304737294528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e52b0 con 0x55c5085d5e00 2024-03-20T13:36:56.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94304737294528] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02850dc980 20 remove_watcher() i=0 2024-03-20T13:36:56.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02850dc980 2 removed watcher, disabling cache 2024-03-20T13:36:56.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94304737298288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085df8c0 con 0x55c5085d1bd0 2024-03-20T13:36:56.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94304737298288] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x55c5085d1bd0 2024-03-20T13:36:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02850dc980 20 remove_watcher() i=1 2024-03-20T13:36:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.714+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94304737302944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085df8c0 con 0x55c5085d5e00 2024-03-20T13:36:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.718+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94304737302944] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.718+0000 7f02850dc980 20 remove_watcher() i=2 2024-03-20T13:36:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.718+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94304737305168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085df8c0 con 0x7f027c033070 2024-03-20T13:36:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.718+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94304737305168] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x7f027c033070 2024-03-20T13:36:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.718+0000 7f02850dc980 20 remove_watcher() i=3 2024-03-20T13:36:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.718+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94304737292400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e2250 con 0x55c5085d5e00 2024-03-20T13:36:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02833f8640 1 -- 172.21.15.123:0/2026747429 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94304737292400] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f027c05d040 con 0x55c5085d5e00 2024-03-20T13:36:56.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02850dc980 20 remove_watcher() i=4 2024-03-20T13:36:56.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94304737309968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085df070 con 0x55c5085dafa0 2024-03-20T13:36:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94304737309968] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02850dc980 20 remove_watcher() i=5 2024-03-20T13:36:56.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94304737306224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e2250 con 0x55c5085dafa0 2024-03-20T13:36:56.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f0282bf7640 1 -- 172.21.15.123:0/2026747429 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94304737306224] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02740f6040 con 0x55c5085dafa0 2024-03-20T13:36:56.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02850dc980 20 remove_watcher() i=6 2024-03-20T13:36:56.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.722+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94304737315696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5085e2250 con 0x7f027c033070 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94304737315696] v32'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0278043040 con 0x7f027c033070 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 20 remove_watcher() i=7 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c5085d5e00 msgr2=0x55c5085d82c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c5085d5e00 0x55c5085d82c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5085d1bd0 msgr2=0x55c5085d4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5085d1bd0 0x55c5085d4070 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f027c033070 msgr2=0x7f027c020640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f027c033070 0x7f027c020640 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c5085dafa0 msgr2=0x55c5085dd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c5085dafa0 0x55c5085dd390 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f014c0342b0 msgr2=0x7f014c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f014c0342b0 0x7f014c036770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02740aa6f0 tx=0x7f02740da000 comp rx=0 tx=0).stop 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 msgr2=0x55c5085c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02823f6640 1 -- 172.21.15.123:0/2026747429 reap_dead start 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085c6590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f027c015010 tx=0x7f027c0494e0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 shutdown_connections 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/2026747429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085bf5b0 0x55c5085c6590 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 >> 172.21.15.123:0/2026747429 conn(0x55c5085bb900 msgr2=0x55c5085b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 shutdown_connections 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/2026747429 wait complete. 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f015c0342b0 msgr2=0x7f015c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f015c0342b0 0x7f015c036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55c5085a2c10 tx=0x7f02740e1980 comp rx=0 tx=0).stop 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 msgr2=0x55c5085b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 0x55c5085b2b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f027c016c80 tx=0x7f027c00d790 comp rx=0 tx=0).stop 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 shutdown_connections 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f015c0342b0 0x7f015c036770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1818862333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5085b26e0 0x55c5085b2b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 >> 172.21.15.123:0/1818862333 conn(0x55c5085a74f0 msgr2=0x55c5085a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 shutdown_connections 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1818862333 wait complete. 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c50859fdd0 msgr2=0x55c5085a21c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c50859fdd0 0x55c5085a21c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5084a6fc0 msgr2=0x55c50859f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5084a6fc0 0x55c50859f020 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0168034300 msgr2=0x7f01680367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0168034300 0x7f01680367c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0278000f70 tx=0x7f02780010b0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 msgr2=0x55c5084a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a5b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0274017e90 tx=0x7f0274018020 comp rx=0 tx=0).stop 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 shutdown_connections 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c50859fdd0 0x55c5085a21c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c5084a6fc0 0x55c50859f020 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0168034300 0x7f01680367c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 --2- 172.21.15.123:0/1189241166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c5084a66a0 0x55c5084a5b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 >> 172.21.15.123:0/1189241166 conn(0x55c50849ee50 msgr2=0x55c508589a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 shutdown_connections 2024-03-20T13:36:56.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.726+0000 7f02850dc980 1 -- 172.21.15.123:0/1189241166 wait complete. 2024-03-20T13:36:56.745 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:56.745 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-03-20T13:36:56.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-03-20T13:36:56.745 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-03-20T13:36:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.810+0000 7fa1e2ddd980 1 Processor -- start 2024-03-20T13:36:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.810+0000 7fa1e2ddd980 1 -- start start 2024-03-20T13:36:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.810+0000 7fa1e2ddd980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x561317a7d0b0 0x561317b0dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.810+0000 7fa1e2ddd980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561317a55520 con 0x561317b0e4f0 2024-03-20T13:36:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.810+0000 7fa1e2ddd980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x561317a1c0f0 con 0x561317a7d0b0 2024-03-20T13:36:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1e08f8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x561317a7d0b0 0x561317b0dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1e00f7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x561317b0e4f0 0x561317b108e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58966/0 (socket says 172.21.15.123:58966) 2024-03-20T13:36:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4081212645 learned_addr learned my addr 172.21.15.123:0/4081212645 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4081212645 >> v1:172.21.15.89:6789/0 conn(0x561317b0e4f0 legacy=0x561317b108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4081212645 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561317b13010 con 0x561317a7d0b0 2024-03-20T13:36:56.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/4081212645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317b0dfb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000a480 tx=0x7fa1d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c27fd38fa37ede server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1df8f6640 1 -- 172.21.15.123:0/4081212645 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d00ab540 con 0x561317a7d0b0 2024-03-20T13:36:56.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1df8f6640 1 -- 172.21.15.123:0/4081212645 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00ab6a0 con 0x561317a7d0b0 2024-03-20T13:36:56.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.814+0000 7fa1df8f6640 1 -- 172.21.15.123:0/4081212645 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d00ab960 con 0x561317a7d0b0 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4081212645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 msgr2=0x561317b0dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4081212645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317b0dfb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000a480 tx=0x7fa1d001b280 comp rx=0 tx=0).stop 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4081212645 shutdown_connections 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4081212645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317b0dfb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4081212645 >> 172.21.15.123:0/4081212645 conn(0x561317b036d0 msgr2=0x561317b05af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4081212645 shutdown_connections 2024-03-20T13:36:56.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.818+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4081212645 wait complete. 2024-03-20T13:36:56.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.830+0000 7fa1e2ddd980 1 Processor -- start 2024-03-20T13:36:56.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.830+0000 7fa1e2ddd980 1 -- start start 2024-03-20T13:36:56.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bf50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561317a19620 con 0x561317a7d0b0 2024-03-20T13:36:56.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bf50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bf50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53470/0 (socket says 172.21.15.123:53470) 2024-03-20T13:36:56.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 -- 172.21.15.123:0/558367704 learned_addr learned my addr 172.21.15.123:0/558367704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 -- 172.21.15.123:0/558367704 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0005d30 con 0x561317a7d0b0 2024-03-20T13:36:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/558367704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bf50e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00ae040 tx=0x7fa1d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bf1f3a8e3ba2eb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa0cee0d640 1 -- 172.21.15.123:0/558367704 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d00ab810 con 0x561317a7d0b0 2024-03-20T13:36:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa0cee0d640 1 -- 172.21.15.123:0/558367704 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00ab970 con 0x561317a7d0b0 2024-03-20T13:36:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa0cee0d640 1 -- 172.21.15.123:0/558367704 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d00abc10 con 0x561317a7d0b0 2024-03-20T13:36:56.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/558367704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 msgr2=0x561317bf50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/558367704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bf50e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00ae040 tx=0x7fa1d0003030 comp rx=0 tx=0).stop 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/558367704 shutdown_connections 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/558367704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bf50e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/558367704 >> 172.21.15.123:0/558367704 conn(0x561317b036d0 msgr2=0x561317bf0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/558367704 shutdown_connections 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/558367704 wait complete. 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 Processor -- start 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- start start 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bfbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e2ddd980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561317a14e00 con 0x561317a7d0b0 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bfbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bfbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53478/0 (socket says 172.21.15.123:53478) 2024-03-20T13:36:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.834+0000 7fa1e08f8640 1 -- 172.21.15.123:0/557951081 learned_addr learned my addr 172.21.15.123:0/557951081 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e08f8640 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561317b13010 con 0x561317a7d0b0 2024-03-20T13:36:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bfbe10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa1d001bb20 tx=0x7fa1d0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa0cd60a640 1 -- 172.21.15.123:0/557951081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d00c2070 con 0x561317a7d0b0 2024-03-20T13:36:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561317bfc350 con 0x561317a7d0b0 2024-03-20T13:36:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa0cd60a640 1 -- 172.21.15.123:0/557951081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00b5d50 con 0x561317a7d0b0 2024-03-20T13:36:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa0cd60a640 1 -- 172.21.15.123:0/557951081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d00c6410 con 0x561317a7d0b0 2024-03-20T13:36:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561317bfc7e0 con 0x561317a7d0b0 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa0cd60a640 1 -- 172.21.15.123:0/557951081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa1d00b2070 con 0x561317a7d0b0 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa0cd60a640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0c80342b0 0x7fa0c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa0cd60a640 1 -- 172.21.15.123:0/557951081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa1d00e3760 con 0x561317a7d0b0 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e00f7640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0c80342b0 0x7fa0c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317b0e4f0 0x561317c029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c02f30 con 0x561317b0e4f0 2024-03-20T13:36:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317b0e4f0 0x561317c029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e00f7640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0c80342b0 0x7fa0c8036770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f70 tx=0x7fa1c80012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317b0e4f0 0x561317c029f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e10f9640 1 -- 172.21.15.123:0/557951081 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317b0e4f0 2024-03-20T13:36:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c037a0 0x561317c05b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.838+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c06270 con 0x561317c037a0 2024-03-20T13:36:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c037a0 0x561317c05b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c037a0 0x561317c05b90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e08f8640 1 -- 172.21.15.123:0/557951081 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1d00c6700 con 0x561317c037a0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c07ad0 con 0x561317c037a0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e08f8640 1 -- 172.21.15.123:0/557951081 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa1d00d93b0 con 0x561317c037a0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c06cd0 con 0x561317c037a0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e08f8640 1 -- 172.21.15.123:0/557951081 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1d00d93b0 con 0x561317c037a0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c070e0 con 0x561317b0e4f0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e10f9640 1 -- 172.21.15.123:0/557951081 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317b0e4f0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 Processor -- start 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 -- start start 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 0x561317c165b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.842+0000 7fa1e2ddd980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613179ade30 con 0x561317c16190 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e10f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 0x561317c165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e10f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 0x561317c165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53484/0 (socket says 172.21.15.123:53484) 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e10f9640 1 -- 172.21.15.123:0/2082992534 learned_addr learned my addr 172.21.15.123:0/2082992534 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e10f9640 1 -- 172.21.15.123:0/2082992534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561317c16af0 con 0x561317c16190 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 0x561317c165b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8016cf0 tx=0x7fa1d800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa0c67fc640 1 -- 172.21.15.123:0/2082992534 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d8017660 con 0x561317c16190 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561317c16d40 con 0x561317c16190 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa0c67fc640 1 -- 172.21.15.123:0/2082992534 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d80177c0 con 0x561317c16190 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa0c67fc640 1 -- 172.21.15.123:0/2082992534 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d8017a60 con 0x561317c16190 2024-03-20T13:36:56.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561317c17890 con 0x561317c16190 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa0c67fc640 1 -- 172.21.15.123:0/2082992534 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa1d801d020 con 0x561317c16190 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa0c67fc640 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0b80342b0 0x7fa0b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa0c67fc640 1 -- 172.21.15.123:0/2082992534 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa1d804b1b0 con 0x561317c16190 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0b80342b0 0x7fa0b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e2ddd980 1 Processor -- start 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e2ddd980 1 -- start start 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0b80342b0 0x7fa0b8036770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x561317c067d0 tx=0x7fa1d00db040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e2ddd980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c23550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.846+0000 7fa1e2ddd980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613179a1790 con 0x561317c23130 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c23550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c23550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53498/0 (socket says 172.21.15.123:53498) 2024-03-20T13:36:56.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 -- 172.21.15.123:0/583488617 learned_addr learned my addr 172.21.15.123:0/583488617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 -- 172.21.15.123:0/583488617 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561317c23b20 con 0x561317c23130 2024-03-20T13:36:56.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/583488617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c23550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800a100 tx=0x7fa1d8014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e8f378bdeebd29 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa0b7fff640 1 -- 172.21.15.123:0/583488617 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d803b070 con 0x561317c23130 2024-03-20T13:36:56.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa0b7fff640 1 -- 172.21.15.123:0/583488617 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8011dd0 con 0x561317c23130 2024-03-20T13:36:56.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa0b7fff640 1 -- 172.21.15.123:0/583488617 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d803b300 con 0x561317c23130 2024-03-20T13:36:56.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/583488617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 msgr2=0x561317c23550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/583488617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c23550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800a100 tx=0x7fa1d8014740 comp rx=0 tx=0).stop 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/583488617 shutdown_connections 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/583488617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c23550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/583488617 >> 172.21.15.123:0/583488617 conn(0x561317c1f470 msgr2=0x561317c1d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/583488617 shutdown_connections 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/583488617 wait complete. 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 Processor -- start 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- start start 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c29fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e2ddd980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561317c2a510 con 0x561317c23130 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c29fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c29fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53500/0 (socket says 172.21.15.123:53500) 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 learned_addr learned my addr 172.21.15.123:0/4153681552 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:56.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561317c17890 con 0x561317c23130 2024-03-20T13:36:56.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.850+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c29fd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa1d803a040 tx=0x7fa1d8049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa0b67fc640 1 -- 172.21.15.123:0/4153681552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d801fbe0 con 0x561317c23130 2024-03-20T13:36:56.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561317c2a710 con 0x561317c23130 2024-03-20T13:36:56.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa0b67fc640 1 -- 172.21.15.123:0/4153681552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d801fd40 con 0x561317c23130 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa0b67fc640 1 -- 172.21.15.123:0/4153681552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1d80113d0 con 0x561317c23130 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561317c2ab40 con 0x561317c23130 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa0b67fc640 1 -- 172.21.15.123:0/4153681552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa1d8011530 con 0x561317c23130 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa0b67fc640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0ac0342b0 0x7fa0ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa0b67fc640 1 -- 172.21.15.123:0/4153681552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa1d804cd70 con 0x561317c23130 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0ac0342b0 0x7fa0ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317c35720 0x561317c37be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c38330 con 0x561317c35720 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e00f7640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317c35720 0x561317c37be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0ac0342b0 0x7fa0ac036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x561317bfcb40 tx=0x7fa1d00e6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e00f7640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317c35720 0x561317c37be0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 realm 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c34b80 con 0x561317c35720 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c38db0 con 0x561317c35720 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c39b40 0x561317c3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c3c5e0 con 0x561317c39b40 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.854+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c39b40 0x561317c3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c39b40 0x561317c3bf30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c3cde0 con 0x561317c39b40 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 20 searching for the correct realm 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x561317c3ee50 0x561317c41310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c3ee50 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x561317c3ee50 0x561317c41310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e08f8640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x561317c3ee50 0x561317c41310 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c39b40 2024-03-20T13:36:56.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e10f9640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa1d80207a0 0x7fa1d8029820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x7fa1d80207a0 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e00f7640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa1d80207a0 0x7fa1d8029820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.858+0000 7fa1e00f7640 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa1d80207a0 0x7fa1d8029820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c3ee50 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c39b40 2024-03-20T13:36:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c39b40 2024-03-20T13:36:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x7fa1d80207a0 2024-03-20T13:36:56.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x7fa1d80207a0 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.862+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c39b40 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c3ee50 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c39b40 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c3ee50 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c3ee50 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x7fa1d80207a0 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x561317c35720 2024-03-20T13:36:56.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c419e0 con 0x7fa1d80207a0 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.866+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x561317c3ee50 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x7fa1d80207a0 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x561317c39b40 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x561317c39b40 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x561317c3ee50 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x561317c39b40 2024-03-20T13:36:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa1c803c040 con 0x561317c39b40 2024-03-20T13:36:56.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c3e3e0 con 0x561317c35720 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.870+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c3d320 con 0x561317c39b40 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c3d330 con 0x561317c35720 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 zone default found 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 4 Realm: () 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 zonegroup default 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c3de60 con 0x7fa1d80207a0 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c43e50 con 0x561317c3ee50 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c442d0 con 0x561317c3ee50 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 started sync module instance, tier type = 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:56.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.874+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c43a80 con 0x561317c39b40 2024-03-20T13:36:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94640003099856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c446f0 con 0x561317c39b40 2024-03-20T13:36:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c44ef0 con 0x561317c35720 2024-03-20T13:36:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94640003106544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c456f0 con 0x561317c35720 2024-03-20T13:36:56.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46060 con 0x561317c39b40 2024-03-20T13:36:56.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94640003106544] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.878+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94640003099856] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.882+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.882+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94640003109456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c45670 con 0x561317c39b40 2024-03-20T13:36:56.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.882+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46500 con 0x7fa1d80207a0 2024-03-20T13:36:56.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.882+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.882+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94640003113056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46920 con 0x7fa1d80207a0 2024-03-20T13:36:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.882+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c472d0 con 0x561317c39b40 2024-03-20T13:36:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.886+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94640003109456] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.890+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94640003113056] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.890+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.890+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94640003111872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46480 con 0x561317c39b40 2024-03-20T13:36:56.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.890+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c47b20 con 0x561317c3ee50 2024-03-20T13:36:56.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94640003118720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46480 con 0x561317c3ee50 2024-03-20T13:36:56.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c48930 con 0x561317c3ee50 2024-03-20T13:36:56.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94640003111872] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94640003118720] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94640003120768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c48490 con 0x561317c3ee50 2024-03-20T13:36:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c48cf0 con 0x7fa1d80207a0 2024-03-20T13:36:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94640003122960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c49210 con 0x7fa1d80207a0 2024-03-20T13:36:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=0 2024-03-20T13:36:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=1 2024-03-20T13:36:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=2 2024-03-20T13:36:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=3 2024-03-20T13:36:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=4 2024-03-20T13:36:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=5 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94640003120768] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.894+0000 7fa1e2ddd980 20 add_watcher() i=6 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94640003122960] v32'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 add_watcher() i=7 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46df0 con 0x561317c35720 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94640003124464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c46df0 con 0x561317c35720 2024-03-20T13:36:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94640003124464] v32'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 5 note: GC not initialized 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa095fe3640 20 reqs_thread_entry: start 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 Filter name: none 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa0077fe640 20 reqs_thread_entry: start 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 rados->read ofs=0 len=0 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c6e1f0 con 0x561317c35720 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.898+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c70710 con 0x7fa1d80207a0 2024-03-20T13:36:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c73e90 con 0x561317c35720 2024-03-20T13:36:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v32'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e2ddd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e2ddd980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e2ddd980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.902+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94640003300144 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c70bb0 con 0x561317c39b40 2024-03-20T13:36:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94640003111872 notify 137438953474 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fa1d8065040 con 0x561317c39b40 2024-03-20T13:36:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa0b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94640003111872 notifier 4325 bl.length()=533 2024-03-20T13:36:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa0b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa0b77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa0b77fe640 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa014003430 con 0x561317c39b40 2024-03-20T13:36:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 notify.4 [notify cookie 94640003300144 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94640003300144 notify 137438953474 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561317c2ab40 con 0x561317c39b40 2024-03-20T13:36:56.912 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:56.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:56.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.906+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94640003124464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c6d150 con 0x561317c35720 2024-03-20T13:36:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94640003124464] v32'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94640003099856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c48cb0 con 0x561317c39b40 2024-03-20T13:36:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94640003099856] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e2ddd980 20 remove_watcher() i=0 2024-03-20T13:36:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e2ddd980 2 removed watcher, disabling cache 2024-03-20T13:36:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94640003106544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c42cd0 con 0x561317c35720 2024-03-20T13:36:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94640003106544] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x561317c35720 2024-03-20T13:36:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e2ddd980 20 remove_watcher() i=1 2024-03-20T13:36:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.910+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94640003109456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c42cd0 con 0x561317c39b40 2024-03-20T13:36:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.914+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94640003109456] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.914+0000 7fa1e2ddd980 20 remove_watcher() i=2 2024-03-20T13:36:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.914+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94640003113056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c45250 con 0x7fa1d80207a0 2024-03-20T13:36:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.914+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94640003113056] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.914+0000 7fa1e2ddd980 20 remove_watcher() i=3 2024-03-20T13:36:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.914+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94640003111872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c42cd0 con 0x561317c39b40 2024-03-20T13:36:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e10f9640 1 -- 172.21.15.123:0/4153681552 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94640003111872] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d800a4d0 con 0x561317c39b40 2024-03-20T13:36:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e2ddd980 20 remove_watcher() i=4 2024-03-20T13:36:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94640003118720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c45250 con 0x561317c3ee50 2024-03-20T13:36:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94640003118720] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e2ddd980 20 remove_watcher() i=5 2024-03-20T13:36:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94640003120768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c45bc0 con 0x561317c3ee50 2024-03-20T13:36:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e08f8640 1 -- 172.21.15.123:0/4153681552 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94640003120768] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1d00e1070 con 0x561317c3ee50 2024-03-20T13:36:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e2ddd980 20 remove_watcher() i=6 2024-03-20T13:36:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.918+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94640003122960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561317c42cd0 con 0x7fa1d80207a0 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94640003122960] v32'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1c800e5a0 con 0x7fa1d80207a0 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 20 remove_watcher() i=7 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c39b40 msgr2=0x561317c3bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c39b40 0x561317c3bf30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317c35720 msgr2=0x561317c37be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317c35720 0x561317c37be0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa1d80207a0 msgr2=0x7fa1d8029820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa1d80207a0 0x7fa1d8029820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x561317c3ee50 msgr2=0x561317c41310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x561317c3ee50 0x561317c41310 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0ac0342b0 msgr2=0x7fa0ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0ac0342b0 0x7fa0ac036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x561317bfcb40 tx=0x7fa1d00e6000 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 msgr2=0x561317c29fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c29fd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa1d803a040 tx=0x7fa1d8049530 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 shutdown_connections 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa1d80207a0 0x7fa1d8029820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x561317c3ee50 0x561317c41310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c39b40 0x561317c3bf30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317c35720 0x561317c37be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0ac0342b0 0x7fa0ac036770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/4153681552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c23130 0x561317c29fd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 >> 172.21.15.123:0/4153681552 conn(0x561317c1f470 msgr2=0x561317c1cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e00f7640 1 -- 172.21.15.123:0/4153681552 reap_dead start 2024-03-20T13:36:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 shutdown_connections 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/4153681552 wait complete. 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0b80342b0 msgr2=0x7fa0b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0b80342b0 0x7fa0b8036770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x561317c067d0 tx=0x7fa1d00db040 comp rx=0 tx=0).stop 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 msgr2=0x561317c165b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 0x561317c165b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8016cf0 tx=0x7fa1d800d790 comp rx=0 tx=0).stop 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 shutdown_connections 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0b80342b0 0x7fa0b8036770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/2082992534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317c16190 0x561317c165b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 >> 172.21.15.123:0/2082992534 conn(0x561317c0afa0 msgr2=0x561317c0bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 shutdown_connections 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/2082992534 wait complete. 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c037a0 msgr2=0x561317c05b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c037a0 0x561317c05b90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317b0e4f0 msgr2=0x561317c029f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317b0e4f0 0x561317c029f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0c80342b0 msgr2=0x7fa0c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0c80342b0 0x7fa0c8036770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f70 tx=0x7fa1c80012c0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 msgr2=0x561317bfbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bfbe10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa1d001bb20 tx=0x7fa1d0018020 comp rx=0 tx=0).stop 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 shutdown_connections 2024-03-20T13:36:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x561317c037a0 0x561317c05b90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x561317b0e4f0 0x561317c029f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa0c80342b0 0x7fa0c8036770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 --2- 172.21.15.123:0/557951081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561317a7d0b0 0x561317bfbe10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 >> 172.21.15.123:0/557951081 conn(0x561317b036d0 msgr2=0x561317bef780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 shutdown_connections 2024-03-20T13:36:56.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.922+0000 7fa1e2ddd980 1 -- 172.21.15.123:0/557951081 wait complete. 2024-03-20T13:36:56.937 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:56.937 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:56.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:56.938 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:57.005 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:57.005 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.998+0000 7f12d424d980 1 Processor -- start 2024-03-20T13:36:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.998+0000 7f12d424d980 1 -- start start 2024-03-20T13:36:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.998+0000 7f12d424d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557c7efe7440 0x557c7efe9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.998+0000 7f12d424d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557c7ef2f520 con 0x557c7efe2f80 2024-03-20T13:36:57.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:56.998+0000 7f12d424d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557c7eef60f0 con 0x557c7efe7440 2024-03-20T13:36:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1567640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557c7efe7440 0x557c7efe9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1d68640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x557c7efe2f80 0x557c7efe3360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58978/0 (socket says 172.21.15.123:58978) 2024-03-20T13:36:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1567640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557c7efe7440 0x557c7efe9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53502/0 (socket says 172.21.15.123:53502) 2024-03-20T13:36:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1d68640 1 -- 172.21.15.123:0/3392223436 learned_addr learned my addr 172.21.15.123:0/3392223436 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1567640 1 -- 172.21.15.123:0/3392223436 >> v1:172.21.15.89:6789/0 conn(0x557c7efe2f80 legacy=0x557c7efe3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1567640 1 -- 172.21.15.123:0/3392223436 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7efead80 con 0x557c7efe7440 2024-03-20T13:36:57.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d1567640 1 --2- 172.21.15.123:0/3392223436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe7440 0x557c7efe9830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12c800a480 tx=0x7f12c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6696a9f4c0b8af8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d0d66640 1 -- 172.21.15.123:0/3392223436 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c80ab540 con 0x557c7efe7440 2024-03-20T13:36:57.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d0d66640 1 -- 172.21.15.123:0/3392223436 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c80ab6a0 con 0x557c7efe7440 2024-03-20T13:36:57.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d0d66640 1 -- 172.21.15.123:0/3392223436 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c80ab960 con 0x557c7efe7440 2024-03-20T13:36:57.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d424d980 1 -- 172.21.15.123:0/3392223436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe7440 msgr2=0x557c7efe9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d424d980 1 --2- 172.21.15.123:0/3392223436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe7440 0x557c7efe9830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12c800a480 tx=0x7f12c801b280 comp rx=0 tx=0).stop 2024-03-20T13:36:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d424d980 1 -- 172.21.15.123:0/3392223436 shutdown_connections 2024-03-20T13:36:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d424d980 1 --2- 172.21.15.123:0/3392223436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe7440 0x557c7efe9830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.002+0000 7f12d424d980 1 -- 172.21.15.123:0/3392223436 >> 172.21.15.123:0/3392223436 conn(0x557c7efde850 msgr2=0x557c7efe0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.006+0000 7f12d424d980 1 -- 172.21.15.123:0/3392223436 shutdown_connections 2024-03-20T13:36:57.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.006+0000 7f12d424d980 1 -- 172.21.15.123:0/3392223436 wait complete. 2024-03-20T13:36:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 Processor -- start 2024-03-20T13:36:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- start start 2024-03-20T13:36:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7f0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7eef3620 con 0x557c7efe2f80 2024-03-20T13:36:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7f0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7f0ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53514/0 (socket says 172.21.15.123:53514) 2024-03-20T13:36:57.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 -- 172.21.15.123:0/1680815582 learned_addr learned my addr 172.21.15.123:0/1680815582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 -- 172.21.15.123:0/1680815582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8005d30 con 0x557c7efe2f80 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 --2- 172.21.15.123:0/1680815582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7f0ccdf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12cc006fb0 tx=0x7f12cc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66cf8bfdecc9dc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f11bfe07640 1 -- 172.21.15.123:0/1680815582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12cc004530 con 0x557c7efe2f80 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f11bfe07640 1 -- 172.21.15.123:0/1680815582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc004690 con 0x557c7efe2f80 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f11bfe07640 1 -- 172.21.15.123:0/1680815582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12cc0049b0 con 0x557c7efe2f80 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- 172.21.15.123:0/1680815582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 msgr2=0x557c7f0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 --2- 172.21.15.123:0/1680815582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7f0ccdf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12cc006fb0 tx=0x7f12cc001940 comp rx=0 tx=0).stop 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- 172.21.15.123:0/1680815582 shutdown_connections 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 --2- 172.21.15.123:0/1680815582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7f0ccdf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- 172.21.15.123:0/1680815582 >> 172.21.15.123:0/1680815582 conn(0x557c7efde850 msgr2=0x557c7f0c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- 172.21.15.123:0/1680815582 shutdown_connections 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- 172.21.15.123:0/1680815582 wait complete. 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 Processor -- start 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- start start 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7ef59780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d424d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7eeeee00 con 0x557c7efe2f80 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7ef59780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7ef59780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53530/0 (socket says 172.21.15.123:53530) 2024-03-20T13:36:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.018+0000 7f12d1d68640 1 -- 172.21.15.123:0/2310442756 learned_addr learned my addr 172.21.15.123:0/2310442756 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d1d68640 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7ef2f520 con 0x557c7efe2f80 2024-03-20T13:36:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7ef59780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x557c7f0cdc80 tx=0x7f12cc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f11be604640 1 -- 172.21.15.123:0/2310442756 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12cc013760 con 0x557c7efe2f80 2024-03-20T13:36:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c7ef59cc0 con 0x557c7efe2f80 2024-03-20T13:36:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f11be604640 1 -- 172.21.15.123:0/2310442756 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc0138c0 con 0x557c7efe2f80 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c7ef58160 con 0x557c7efe2f80 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f11be604640 1 -- 172.21.15.123:0/2310442756 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12cc013b60 con 0x557c7efe2f80 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f11be604640 1 -- 172.21.15.123:0/2310442756 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f12cc013cc0 con 0x557c7efe2f80 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f11be604640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11b80342b0 0x7f11b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f11be604640 1 -- 172.21.15.123:0/2310442756 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f12cc049550 con 0x557c7efe2f80 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d1567640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11b80342b0 0x7f11b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7efe7440 0x557c7f0dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f0dd0c0 con 0x557c7efe7440 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d2569640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7efe7440 0x557c7f0dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d1567640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11b80342b0 0x7f11b8036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12c80ad000 tx=0x7f12c80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d2569640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7efe7440 0x557c7f0dcb80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d2569640 1 -- 172.21.15.123:0/2310442756 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12c40083f0 con 0x557c7efe7440 2024-03-20T13:36:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f0dd930 0x557c7f0dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f0e03f0 con 0x557c7f0dd930 2024-03-20T13:36:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.022+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f0dd930 0x557c7f0dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f0dd930 0x557c7f0dfd20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d1d68640 1 -- 172.21.15.123:0/2310442756 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f0dd930 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f0e1c50 con 0x557c7f0dd930 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d1d68640 1 -- 172.21.15.123:0/2310442756 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f0dd930 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f0e0e50 con 0x557c7f0dd930 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d1d68640 1 -- 172.21.15.123:0/2310442756 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f0dd930 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f0e1260 con 0x557c7efe7440 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d2569640 1 -- 172.21.15.123:0/2310442756 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f12c40083f0 con 0x557c7efe7440 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 Processor -- start 2024-03-20T13:36:57.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 -- start start 2024-03-20T13:36:57.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 0x557c7f0f0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d424d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7ee87e30 con 0x557c7f0f0420 2024-03-20T13:36:57.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d2569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 0x557c7f0f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d2569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 0x557c7f0f0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53540/0 (socket says 172.21.15.123:53540) 2024-03-20T13:36:57.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.026+0000 7f12d2569640 1 -- 172.21.15.123:0/3852037147 learned_addr learned my addr 172.21.15.123:0/3852037147 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d2569640 1 -- 172.21.15.123:0/3852037147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f0f0d80 con 0x557c7f0f0420 2024-03-20T13:36:57.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d2569640 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 0x557c7f0f0840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f12c400aae0 tx=0x7f12c4008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f11b77fe640 1 -- 172.21.15.123:0/3852037147 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c401d070 con 0x557c7f0f0420 2024-03-20T13:36:57.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f11b77fe640 1 -- 172.21.15.123:0/3852037147 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4010040 con 0x557c7f0f0420 2024-03-20T13:36:57.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f11b77fe640 1 -- 172.21.15.123:0/3852037147 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c4007e20 con 0x557c7f0f0420 2024-03-20T13:36:57.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c7f0f0fd0 con 0x557c7f0f0420 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c7f0f1b20 con 0x557c7f0f0420 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f11b77fe640 1 -- 172.21.15.123:0/3852037147 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f12c4018430 con 0x557c7f0f0420 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f11b77fe640 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11ac034300 0x7f11ac0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f11b77fe640 1 -- 172.21.15.123:0/3852037147 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f12c404a640 con 0x557c7f0f0420 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d1d68640 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11ac034300 0x7f11ac0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d424d980 1 Processor -- start 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d1d68640 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11ac034300 0x7f11ac0367c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x557c7f0e0890 tx=0x7f12cc035040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d424d980 1 -- start start 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d424d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f0fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d424d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7ee7b790 con 0x557c7f0fd390 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d2569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f0fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d2569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f0fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53546/0 (socket says 172.21.15.123:53546) 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.030+0000 7f12d2569640 1 -- 172.21.15.123:0/2694046219 learned_addr learned my addr 172.21.15.123:0/2694046219 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 -- 172.21.15.123:0/2694046219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f0fdd80 con 0x557c7f0fd390 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 --2- 172.21.15.123:0/2694046219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f0fd7b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f12c40489a0 tx=0x7f12c4020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7d5fdd384fe5b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f11b57fa640 1 -- 172.21.15.123:0/2694046219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c4047070 con 0x557c7f0fd390 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f11b57fa640 1 -- 172.21.15.123:0/2694046219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4021800 con 0x557c7f0fd390 2024-03-20T13:36:57.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f11b57fa640 1 -- 172.21.15.123:0/2694046219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c4022410 con 0x557c7f0fd390 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2694046219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 msgr2=0x557c7f0fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 --2- 172.21.15.123:0/2694046219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f0fd7b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f12c40489a0 tx=0x7f12c4020f00 comp rx=0 tx=0).stop 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2694046219 shutdown_connections 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 --2- 172.21.15.123:0/2694046219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f0fd7b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2694046219 >> 172.21.15.123:0/2694046219 conn(0x557c7f0f96d0 msgr2=0x557c7f0f7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2694046219 shutdown_connections 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2694046219 wait complete. 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 Processor -- start 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- start start 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f104230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c7f104770 con 0x557c7f0fd390 2024-03-20T13:36:57.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f104230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f104230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53552/0 (socket says 172.21.15.123:53552) 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 learned_addr learned my addr 172.21.15.123:0/2156390346 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c7f0f1b20 con 0x557c7f0fd390 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d2569640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f104230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x557c7f0f9dd0 tx=0x7f12c4048900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f11a37fe640 1 -- 172.21.15.123:0/2156390346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c4032030 con 0x557c7f0fd390 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f11a37fe640 1 -- 172.21.15.123:0/2156390346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c404a2e0 con 0x557c7f0fd390 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f11a37fe640 1 -- 172.21.15.123:0/2156390346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12c4048c20 con 0x557c7f0fd390 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c7f104970 con 0x557c7f0fd390 2024-03-20T13:36:57.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.034+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c7f104da0 con 0x557c7f0fd390 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f11a37fe640 1 -- 172.21.15.123:0/2156390346 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f12c4035070 con 0x557c7f0fd390 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f11a37fe640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f119c034300 0x7f119c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f11a37fe640 1 -- 172.21.15.123:0/2156390346 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f12c4033070 con 0x557c7f0fd390 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f119c034300 0x7f119c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7f10f940 0x557c7f111e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f112550 con 0x557c7f10f940 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1567640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7f10f940 0x557c7f111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f119c034300 0x7f119c0367c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12cc004fa0 tx=0x7f12cc049480 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1567640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7f10f940 0x557c7f111e00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12c80abb90 con 0x557c7f10f940 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 realm 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f112940 con 0x557c7f10f940 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12c80abb90 con 0x557c7f10f940 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f113190 con 0x557c7f10f940 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12c80abb90 con 0x557c7f10f940 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f113b70 0x557c7f115fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f116710 con 0x557c7f113b70 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d2569640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f113b70 0x557c7f115fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.038+0000 7f12d2569640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f113b70 0x557c7f115fa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f116f60 con 0x557c7f113b70 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 20 searching for the correct realm 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c7f118c80 0x557c7f11b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c7f118c80 0x557c7f11b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1d68640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c7f118c80 0x557c7f11b070 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d2569640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f12c4038ba0 0x7f12c403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x7f12c4038ba0 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1567640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f12c4038ba0 0x7f12c403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1567640 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f12c4038ba0 0x7f12c403a8a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80abb90 con 0x7f12c4038ba0 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.042+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x7f12c4038ba0 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x7f12c4038ba0 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x7f12c4038ba0 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f12c80c8040 con 0x7f12c4038ba0 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.046+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80c8040 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x7f12c4038ba0 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f10f940 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x7f12c4038ba0 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x7f12c4038ba0 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.050+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f118c80 2024-03-20T13:36:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11b600 con 0x557c7f113b70 2024-03-20T13:36:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f117890 con 0x557c7f10f940 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.054+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f117c70 con 0x557c7f113b70 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f118090 con 0x557c7f10f940 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 zone default found 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 4 Realm: () 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 zonegroup default 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11bee0 con 0x7f12c4038ba0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11bb30 con 0x557c7f118c80 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11e160 con 0x557c7f118c80 2024-03-20T13:36:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 started sync module instance, tier type = 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11d690 con 0x557c7f113b70 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93993196182080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11d690 con 0x557c7f113b70 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.058+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11ebd0 con 0x557c7f10f940 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93993196185328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11eb50 con 0x557c7f10f940 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11fae0 con 0x557c7f113b70 2024-03-20T13:36:57.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93993196185328] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93993196182080] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93993196179952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11faa0 con 0x557c7f113b70 2024-03-20T13:36:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f120330 con 0x7f12c4038ba0 2024-03-20T13:36:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93993196191376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11faa0 con 0x7f12c4038ba0 2024-03-20T13:36:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.062+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f120e00 con 0x557c7f113b70 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93993196179952] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93993196191376] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93993196192432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f120e00 con 0x557c7f113b70 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f1211f0 con 0x557c7f118c80 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93993196194032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f121a40 con 0x557c7f118c80 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.066+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f122410 con 0x557c7f118c80 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93993196192432] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93993196194032] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93993196199696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f1215a0 con 0x557c7f118c80 2024-03-20T13:36:57.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f122c60 con 0x7f12c4038ba0 2024-03-20T13:36:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93993196201920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f123080 con 0x7f12c4038ba0 2024-03-20T13:36:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=0 2024-03-20T13:36:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=1 2024-03-20T13:36:57.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=2 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=3 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=4 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=5 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93993196199696] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=6 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93993196201920] v32'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 20 add_watcher() i=7 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f125d50 con 0x557c7f10f940 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.070+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93993196189120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f123080 con 0x557c7f10f940 2024-03-20T13:36:57.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93993196189120] v32'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f11837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:57.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:57.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 5 note: GC not initialized 2024-03-20T13:36:57.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f11827fc640 20 reqs_thread_entry: start 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 20 Filter name: none 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f10f3fff640 20 reqs_thread_entry: start 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f147780 con 0x557c7f10f940 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:57.082 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:57.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f11837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.074+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93993196189120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f128340 con 0x557c7f10f940 2024-03-20T13:36:57.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.078+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93993196189120] v32'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.078+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93993196182080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11f5c0 con 0x557c7f113b70 2024-03-20T13:36:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.078+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93993196182080] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.078+0000 7f12d424d980 20 remove_watcher() i=0 2024-03-20T13:36:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.078+0000 7f12d424d980 2 removed watcher, disabling cache 2024-03-20T13:36:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.078+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93993196185328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11da40 con 0x557c7f10f940 2024-03-20T13:36:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.082+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93993196185328] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x557c7f10f940 2024-03-20T13:36:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.082+0000 7f12d424d980 20 remove_watcher() i=1 2024-03-20T13:36:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.082+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93993196179952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11da40 con 0x557c7f113b70 2024-03-20T13:36:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.082+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93993196179952] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.082+0000 7f12d424d980 20 remove_watcher() i=2 2024-03-20T13:36:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.082+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93993196191376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11da40 con 0x7f12c4038ba0 2024-03-20T13:36:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.086+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93993196191376] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.086+0000 7f12d424d980 20 remove_watcher() i=3 2024-03-20T13:36:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.086+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93993196192432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f11da40 con 0x557c7f113b70 2024-03-20T13:36:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.086+0000 7f12d2569640 1 -- 172.21.15.123:0/2156390346 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93993196192432] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c404adb0 con 0x557c7f113b70 2024-03-20T13:36:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.086+0000 7f12d424d980 20 remove_watcher() i=4 2024-03-20T13:36:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.086+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93993196194032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f120330 con 0x557c7f118c80 2024-03-20T13:36:57.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93993196194032] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 20 remove_watcher() i=5 2024-03-20T13:36:57.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93993196199696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f120330 con 0x557c7f118c80 2024-03-20T13:36:57.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d1d68640 1 -- 172.21.15.123:0/2156390346 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93993196199696] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12cc024020 con 0x557c7f118c80 2024-03-20T13:36:57.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 20 remove_watcher() i=6 2024-03-20T13:36:57.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93993196201920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c7f120310 con 0x7f12c4038ba0 2024-03-20T13:36:57.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93993196201920] v32'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12c80d5060 con 0x7f12c4038ba0 2024-03-20T13:36:57.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 20 remove_watcher() i=7 2024-03-20T13:36:57.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f113b70 msgr2=0x557c7f115fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f113b70 0x557c7f115fa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7f10f940 msgr2=0x557c7f111e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7f10f940 0x557c7f111e00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f12c4038ba0 msgr2=0x7f12c403a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f12c4038ba0 0x7f12c403a8a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c7f118c80 msgr2=0x557c7f11b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c7f118c80 0x557c7f11b070 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f119c034300 msgr2=0x7f119c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f119c034300 0x7f119c0367c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12cc004fa0 tx=0x7f12cc049480 comp rx=0 tx=0).stop 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 msgr2=0x557c7f104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d1567640 1 -- 172.21.15.123:0/2156390346 reap_dead start 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f104230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x557c7f0f9dd0 tx=0x7f12c4048900 comp rx=0 tx=0).stop 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 shutdown_connections 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 --2- 172.21.15.123:0/2156390346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0fd390 0x557c7f104230 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 >> 172.21.15.123:0/2156390346 conn(0x557c7f0f96d0 msgr2=0x557c7f0f6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 shutdown_connections 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.090+0000 7f12d424d980 1 -- 172.21.15.123:0/2156390346 wait complete. 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11ac034300 msgr2=0x7f11ac0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11ac034300 0x7f11ac0367c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x557c7f0e0890 tx=0x7f12cc035040 comp rx=0 tx=0).stop 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 msgr2=0x557c7f0f0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 0x557c7f0f0840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f12c400aae0 tx=0x7f12c4008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 shutdown_connections 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11ac034300 0x7f11ac0367c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/3852037147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7f0f0420 0x557c7f0f0840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 >> 172.21.15.123:0/3852037147 conn(0x557c7f0e5230 msgr2=0x557c7f0e5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 shutdown_connections 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/3852037147 wait complete. 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f0dd930 msgr2=0x557c7f0dfd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f0dd930 0x557c7f0dfd20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7efe7440 msgr2=0x557c7f0dcb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7efe7440 0x557c7f0dcb80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11b80342b0 msgr2=0x7f11b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11b80342b0 0x7f11b8036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12c80ad000 tx=0x7f12c80a5040 comp rx=0 tx=0).stop 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 msgr2=0x557c7ef59780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7ef59780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x557c7f0cdc80 tx=0x7f12cc000f50 comp rx=0 tx=0).stop 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 shutdown_connections 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c7f0dd930 0x557c7f0dfd20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c7efe7440 0x557c7f0dcb80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f11b80342b0 0x7f11b8036770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 --2- 172.21.15.123:0/2310442756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c7efe2f80 0x557c7ef59780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 >> 172.21.15.123:0/2310442756 conn(0x557c7efde850 msgr2=0x557c7f0c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 shutdown_connections 2024-03-20T13:36:57.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.094+0000 7f12d424d980 1 -- 172.21.15.123:0/2310442756 wait complete. 2024-03-20T13:36:57.108 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:57.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-03-20T13:36:57.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-03-20T13:36:57.108 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-03-20T13:36:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37f135c980 1 Processor -- start 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37f135c980 1 -- start start 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37f135c980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5643f6a6c0d0 0x5643f6a6c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37f135c980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5643f69b64c0 con 0x5643f6a6c9f0 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37f135c980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5643f697d0f0 con 0x5643f6a6c0d0 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37eee77640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5643f6a6c0d0 0x5643f6a6c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37ee676640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5643f6a6c9f0 0x5643f6a6d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:58982/0 (socket says 172.21.15.123:58982) 2024-03-20T13:36:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37eee77640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5643f6a6c0d0 0x5643f6a6c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53558/0 (socket says 172.21.15.123:53558) 2024-03-20T13:36:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37ee676640 1 -- 172.21.15.123:0/3893961633 learned_addr learned my addr 172.21.15.123:0/3893961633 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37eee77640 1 -- 172.21.15.123:0/3893961633 >> v1:172.21.15.89:6789/0 conn(0x5643f6a6c9f0 legacy=0x5643f6a6d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.182+0000 7f37eee77640 1 -- 172.21.15.123:0/3893961633 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643f6a6dbd0 con 0x5643f6a6c0d0 2024-03-20T13:36:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37eee77640 1 --2- 172.21.15.123:0/3893961633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6a6c4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37e000a480 tx=0x7f37e001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38cdfef5d53c3a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37ede75640 1 -- 172.21.15.123:0/3893961633 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e00ab540 con 0x5643f6a6c0d0 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37ede75640 1 -- 172.21.15.123:0/3893961633 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00ab6a0 con 0x5643f6a6c0d0 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37ede75640 1 -- 172.21.15.123:0/3893961633 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e00ab960 con 0x5643f6a6c0d0 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 -- 172.21.15.123:0/3893961633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 msgr2=0x5643f6a6c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 --2- 172.21.15.123:0/3893961633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6a6c4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37e000a480 tx=0x7f37e001b280 comp rx=0 tx=0).stop 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 -- 172.21.15.123:0/3893961633 shutdown_connections 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 --2- 172.21.15.123:0/3893961633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6a6c4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 -- 172.21.15.123:0/3893961633 >> 172.21.15.123:0/3893961633 conn(0x5643f69df7f0 msgr2=0x5643f69dfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 -- 172.21.15.123:0/3893961633 shutdown_connections 2024-03-20T13:36:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.186+0000 7f37f135c980 1 -- 172.21.15.123:0/3893961633 wait complete. 2024-03-20T13:36:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37f135c980 1 Processor -- start 2024-03-20T13:36:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37f135c980 1 -- start start 2024-03-20T13:36:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37f135c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b56660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37f135c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643f697a620 con 0x5643f6a6c0d0 2024-03-20T13:36:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37eee77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b56660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37eee77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b56660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53560/0 (socket says 172.21.15.123:53560) 2024-03-20T13:36:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37eee77640 1 -- 172.21.15.123:0/438274450 learned_addr learned my addr 172.21.15.123:0/438274450 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37eee77640 1 -- 172.21.15.123:0/438274450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0005d30 con 0x5643f6a6c0d0 2024-03-20T13:36:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f37eee77640 1 --2- 172.21.15.123:0/438274450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b56660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37e00ae040 tx=0x7f37e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd61f5c47f17369 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f36dce09640 1 -- 172.21.15.123:0/438274450 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e00ab810 con 0x5643f6a6c0d0 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f36dce09640 1 -- 172.21.15.123:0/438274450 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00ab970 con 0x5643f6a6c0d0 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.198+0000 7f36dce09640 1 -- 172.21.15.123:0/438274450 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e00abc10 con 0x5643f6a6c0d0 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/438274450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 msgr2=0x5643f6b56660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 --2- 172.21.15.123:0/438274450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b56660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37e00ae040 tx=0x7f37e0003030 comp rx=0 tx=0).stop 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/438274450 shutdown_connections 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 --2- 172.21.15.123:0/438274450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b56660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/438274450 >> 172.21.15.123:0/438274450 conn(0x5643f69df7f0 msgr2=0x5643f6b521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/438274450 shutdown_connections 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/438274450 wait complete. 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 Processor -- start 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- start start 2024-03-20T13:36:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643f6975e00 con 0x5643f6a6c0d0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37eee77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37eee77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b5d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53572/0 (socket says 172.21.15.123:53572) 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37eee77640 1 -- 172.21.15.123:0/3105363922 learned_addr learned my addr 172.21.15.123:0/3105363922 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37eee77640 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643f6a6dbd0 con 0x5643f6a6c0d0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37eee77640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b5d3a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f37e001bb20 tx=0x7f37e0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f36db606640 1 -- 172.21.15.123:0/3105363922 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e00c2070 con 0x5643f6a6c0d0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f36db606640 1 -- 172.21.15.123:0/3105363922 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00b59d0 con 0x5643f6a6c0d0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f36db606640 1 -- 172.21.15.123:0/3105363922 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e00b5c70 con 0x5643f6a6c0d0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643f6b5d8e0 con 0x5643f6a6c0d0 2024-03-20T13:36:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.202+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643f6b5dd70 con 0x5643f6a6c0d0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f36db606640 1 -- 172.21.15.123:0/3105363922 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f37e00b2070 con 0x5643f6a6c0d0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f36db606640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36d40342b0 0x7f36d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f36db606640 1 -- 172.21.15.123:0/3105363922 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f37e00e3470 con 0x5643f6a6c0d0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37ee676640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36d40342b0 0x7f36d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6a6c9f0 0x5643f6b64020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b64560 con 0x5643f6a6c9f0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37ef678640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6a6c9f0 0x5643f6b64020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37ee676640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36d40342b0 0x7f36d4036770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000f70 tx=0x7f37e40012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37ef678640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6a6c9f0 0x5643f6b64020 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37ef678640 1 -- 172.21.15.123:0/3105363922 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6a6c9f0 2024-03-20T13:36:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b64dd0 0x5643f6b671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b678f0 con 0x5643f6b64dd0 2024-03-20T13:36:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37eee77640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b64dd0 0x5643f6b671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37eee77640 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b64dd0 0x5643f6b671c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37eee77640 1 -- 172.21.15.123:0/3105363922 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f37e00c6500 con 0x5643f6b64dd0 2024-03-20T13:36:57.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b69130 con 0x5643f6b64dd0 2024-03-20T13:36:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37eee77640 1 -- 172.21.15.123:0/3105363922 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f37e00c6500 con 0x5643f6b64dd0 2024-03-20T13:36:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.206+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b68270 con 0x5643f6b64dd0 2024-03-20T13:36:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37eee77640 1 -- 172.21.15.123:0/3105363922 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f37e00c6500 con 0x5643f6b64dd0 2024-03-20T13:36:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b68680 con 0x5643f6a6c9f0 2024-03-20T13:36:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37ef678640 1 -- 172.21.15.123:0/3105363922 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6a6c9f0 2024-03-20T13:36:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 Processor -- start 2024-03-20T13:36:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 -- start start 2024-03-20T13:36:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 0x5643f6b77c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643f690ee30 con 0x5643f6b77840 2024-03-20T13:36:57.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37ef678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 0x5643f6b77c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37ef678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 0x5643f6b77c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53576/0 (socket says 172.21.15.123:53576) 2024-03-20T13:36:57.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37ef678640 1 -- 172.21.15.123:0/3802762880 learned_addr learned my addr 172.21.15.123:0/3802762880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37ef678640 1 -- 172.21.15.123:0/3802762880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643f6b781a0 con 0x5643f6b77840 2024-03-20T13:36:57.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37ef678640 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 0x5643f6b77c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f37e8016cf0 tx=0x7f37e800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f36d8e01640 1 -- 172.21.15.123:0/3802762880 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e8017660 con 0x5643f6b77840 2024-03-20T13:36:57.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643f6b783f0 con 0x5643f6b77840 2024-03-20T13:36:57.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f36d8e01640 1 -- 172.21.15.123:0/3802762880 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80177c0 con 0x5643f6b77840 2024-03-20T13:36:57.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643f6b78f40 con 0x5643f6b77840 2024-03-20T13:36:57.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.210+0000 7f36d8e01640 1 -- 172.21.15.123:0/3802762880 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e8017a60 con 0x5643f6b77840 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f36d8e01640 1 -- 172.21.15.123:0/3802762880 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f37e801d020 con 0x5643f6b77840 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f36d8e01640 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36c80342b0 0x7f36c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f36d8e01640 1 -- 172.21.15.123:0/3802762880 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f37e804b610 con 0x5643f6b77840 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37eee77640 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36c80342b0 0x7f36c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 Processor -- start 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37eee77640 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36c80342b0 0x7f36c8036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5643f6b67d70 tx=0x7f37e00da040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- start start 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b84c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643f6902790 con 0x5643f6b847e0 2024-03-20T13:36:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37ef678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b84c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37ef678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b84c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53586/0 (socket says 172.21.15.123:53586) 2024-03-20T13:36:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37ef678640 1 -- 172.21.15.123:0/1851246733 learned_addr learned my addr 172.21.15.123:0/1851246733 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37ef678640 1 -- 172.21.15.123:0/1851246733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643f6b851d0 con 0x5643f6b847e0 2024-03-20T13:36:57.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37ef678640 1 --2- 172.21.15.123:0/1851246733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b84c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f37e8049970 tx=0x7f37e8049b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa6788695cebdcd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f36d27fc640 1 -- 172.21.15.123:0/1851246733 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e8011cd0 con 0x5643f6b847e0 2024-03-20T13:36:57.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f36d27fc640 1 -- 172.21.15.123:0/1851246733 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8040030 con 0x5643f6b847e0 2024-03-20T13:36:57.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f36d27fc640 1 -- 172.21.15.123:0/1851246733 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e8020510 con 0x5643f6b847e0 2024-03-20T13:36:57.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- 172.21.15.123:0/1851246733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 msgr2=0x5643f6b84c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 --2- 172.21.15.123:0/1851246733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b84c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f37e8049970 tx=0x7f37e8049b40 comp rx=0 tx=0).stop 2024-03-20T13:36:57.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- 172.21.15.123:0/1851246733 shutdown_connections 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 --2- 172.21.15.123:0/1851246733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b84c00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- 172.21.15.123:0/1851246733 >> 172.21.15.123:0/1851246733 conn(0x5643f6b80ad0 msgr2=0x5643f6b7eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- 172.21.15.123:0/1851246733 shutdown_connections 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- 172.21.15.123:0/1851246733 wait complete. 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 Processor -- start 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- start start 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b8b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.214+0000 7f37f135c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643f6b8bb60 con 0x5643f6b847e0 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ef678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b8b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ef678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b8b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53594/0 (socket says 172.21.15.123:53594) 2024-03-20T13:36:57.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 learned_addr learned my addr 172.21.15.123:0/3425052662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643f6b78f40 con 0x5643f6b847e0 2024-03-20T13:36:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ef678640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b8b620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f37e8013560 tx=0x7f37e80498d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f36d0ff9640 1 -- 172.21.15.123:0/3425052662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e8030070 con 0x5643f6b847e0 2024-03-20T13:36:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643f6b8bd60 con 0x5643f6b847e0 2024-03-20T13:36:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f36d0ff9640 1 -- 172.21.15.123:0/3425052662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8048290 con 0x5643f6b847e0 2024-03-20T13:36:57.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f36d0ff9640 1 -- 172.21.15.123:0/3425052662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37e8048590 con 0x5643f6b847e0 2024-03-20T13:36:57.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643f6b8c190 con 0x5643f6b847e0 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f36d0ff9640 1 -- 172.21.15.123:0/3425052662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f37e8049d50 con 0x5643f6b847e0 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f36d0ff9640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36b80342b0 0x7f36b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f36d0ff9640 1 -- 172.21.15.123:0/3425052662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f37e8007050 con 0x5643f6b847e0 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37eee77640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36b80342b0 0x7f36b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6b96d40 0x5643f6b991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b99930 con 0x5643f6b96d40 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ee676640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6b96d40 0x5643f6b991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37eee77640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36b80342b0 0x7f36b8036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37e0003050 tx=0x7f37e00e6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ee676640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6b96d40 0x5643f6b991e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 20 realm 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b96260 con 0x5643f6b96d40 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.218+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9a3b0 con 0x5643f6b96d40 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b9b140 0x5643f6b9d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9dc00 con 0x5643f6b9b140 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37ef678640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b9b140 0x5643f6b9d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37ef678640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b9b140 0x5643f6b9d530 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 20 searching for the correct realm 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5643f6ba0400 0x5643f6ba28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba2f90 con 0x5643f6ba0400 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37eee77640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5643f6ba0400 0x5643f6ba28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37eee77640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5643f6ba0400 0x5643f6ba28c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.222+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba2f90 con 0x5643f6b9b140 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f37e8014920 0x7f37e803b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x7f37e8014920 2024-03-20T13:36:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f37e8014920 0x7f37e803b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f37e8014920 0x7f37e803b870 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6ba0400 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x7f37e8014920 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x7f37e8014920 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.226+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6ba0400 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6ba0400 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6ba0400 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x7f37e8014920 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b96d40 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x7f37e8014920 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.230+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6ba0400 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x7f37e8014920 2024-03-20T13:36:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6ba0400 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e400 con 0x5643f6b9b140 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9e820 con 0x5643f6b96d40 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.234+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9ebd0 con 0x5643f6b9b140 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6b9ebd0 con 0x5643f6b96d40 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f37e400e5a0 con 0x5643f6b96d40 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 zone default found 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 4 Realm: () 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 zonegroup default 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba33d0 con 0x7f37e8014920 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f37e400e5a0 con 0x7f37e8014920 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba5110 con 0x5643f6ba0400 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba54a0 con 0x5643f6ba0400 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 started sync module instance, tier type = 2024-03-20T13:36:57.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:57.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.238+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba49f0 con 0x5643f6b9b140 2024-03-20T13:36:57.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849902200144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4da0 con 0x5643f6b9b140 2024-03-20T13:36:57.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba6200 con 0x5643f6b96d40 2024-03-20T13:36:57.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849902206304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba6ac0 con 0x5643f6b96d40 2024-03-20T13:36:57.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba7540 con 0x5643f6b9b140 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849902206304] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849902200144] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849902205120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba7500 con 0x5643f6b9b140 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.242+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba7dc0 con 0x7f37e8014920 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.246+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x7f37e8014920 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.246+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849902213408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba7500 con 0x7f37e8014920 2024-03-20T13:36:57.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.246+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba88a0 con 0x5643f6b9b140 2024-03-20T13:36:57.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.246+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849902213408] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x7f37e8014920 2024-03-20T13:36:57.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.246+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849902205120] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849902211136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba8860 con 0x5643f6b9b140 2024-03-20T13:36:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba90f0 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849902218320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba8860 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba9f00 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849902211136] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849902218320] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849902220368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba9a60 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.250+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6baa2a0 con 0x7f37e8014920 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849902220368] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x7f37e8014920 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849902216064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba9f00 con 0x7f37e8014920 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=0 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=1 2024-03-20T13:36:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=2 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=3 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=4 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=5 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=6 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849902216064] v32'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x7f37e8014920 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 add_watcher() i=7 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bad710 con 0x5643f6b96d40 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849902222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6baabf0 con 0x5643f6b96d40 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849902222384] v32'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f36a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.254+0000 7f37f135c980 5 note: GC not initialized 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f361ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 20 Filter name: none 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f361dffb640 20 reqs_thread_entry: start 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bcf710 con 0x5643f6b96d40 2024-03-20T13:36:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bcfc10 con 0x5643f6ba0400 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bd55f0 con 0x5643f6b96d40 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~459] v32'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:57.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:57.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94849902399600 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bd10c0 con 0x5643f6b9b140 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94849902211136 notify 137438953475 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x7f37e8069040 con 0x5643f6b9b140 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f36d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94849902211136 notifier 4339 bl.length()=635 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f36d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 notify.4 [notify cookie 94849902399600 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f36d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.258+0000 7f36d27fc640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f36b4003ea0 con 0x5643f6b9b140 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify_complete (2) cookie 94849902399600 notify 137438953475 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5643f6b8c190 con 0x5643f6b9b140 2024-03-20T13:36:57.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bd5070 con 0x5643f6ba0400 2024-03-20T13:36:57.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37f135c980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:36:57.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37f135c980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:36:57.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37f135c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:36:57.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94849902399600 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bd10c0 con 0x5643f6b9b140 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify (1) cookie 94849902205120 notify 137438953476 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5643f6b8c190 con 0x5643f6b9b140 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f36d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94849902205120 notifier 4339 bl.length()=177 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f36d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f36d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f36d27fc640 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f36b4003ea0 con 0x5643f6b9b140 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(68 notify.2 [notify cookie 94849902399600 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== watch-notify(notify_complete (2) cookie 94849902399600 notify 137438953476 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f37e8050070 con 0x5643f6b9b140 2024-03-20T13:36:57.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.262+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.271 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:57.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.266+0000 7f36a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.266+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849902222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6bd4590 con 0x5643f6b96d40 2024-03-20T13:36:57.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.266+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94849902222384] v32'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.266+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849902200144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba9c00 con 0x5643f6b9b140 2024-03-20T13:36:57.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94849902200144] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37f135c980 20 remove_watcher() i=0 2024-03-20T13:36:57.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37f135c980 2 removed watcher, disabling cache 2024-03-20T13:36:57.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849902206304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4550 con 0x5643f6b96d40 2024-03-20T13:36:57.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94849902206304] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x5643f6b96d40 2024-03-20T13:36:57.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37f135c980 20 remove_watcher() i=1 2024-03-20T13:36:57.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.270+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849902205120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4550 con 0x5643f6b9b140 2024-03-20T13:36:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94849902205120] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37f135c980 20 remove_watcher() i=2 2024-03-20T13:36:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849902213408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4550 con 0x7f37e8014920 2024-03-20T13:36:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94849902213408] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x7f37e8014920 2024-03-20T13:36:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37f135c980 20 remove_watcher() i=3 2024-03-20T13:36:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849902211136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4550 con 0x5643f6b9b140 2024-03-20T13:36:57.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37ef678640 1 -- 172.21.15.123:0/3425052662 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94849902211136] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e800a4d0 con 0x5643f6b9b140 2024-03-20T13:36:57.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37f135c980 20 remove_watcher() i=4 2024-03-20T13:36:57.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.274+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849902218320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4550 con 0x5643f6ba0400 2024-03-20T13:36:57.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94849902218320] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 20 remove_watcher() i=5 2024-03-20T13:36:57.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849902220368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba4550 con 0x5643f6ba0400 2024-03-20T13:36:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37eee77640 1 -- 172.21.15.123:0/3425052662 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94849902220368] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e00f9040 con 0x5643f6ba0400 2024-03-20T13:36:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 20 remove_watcher() i=6 2024-03-20T13:36:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849902216064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5643f6ba9450 con 0x7f37e8014920 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94849902216064] v32'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37e4043040 con 0x7f37e8014920 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 20 remove_watcher() i=7 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b9b140 msgr2=0x5643f6b9d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b9b140 0x5643f6b9d530 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6b96d40 msgr2=0x5643f6b991e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6b96d40 0x5643f6b991e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f37e8014920 msgr2=0x7f37e803b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f37e8014920 0x7f37e803b870 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5643f6ba0400 msgr2=0x5643f6ba28c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5643f6ba0400 0x5643f6ba28c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36b80342b0 msgr2=0x7f36b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36b80342b0 0x7f36b8036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37e0003050 tx=0x7f37e00e6000 comp rx=0 tx=0).stop 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 msgr2=0x5643f6b8b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37ee676640 1 -- 172.21.15.123:0/3425052662 reap_dead start 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b8b620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f37e8013560 tx=0x7f37e80498d0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 shutdown_connections 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3425052662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b847e0 0x5643f6b8b620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 >> 172.21.15.123:0/3425052662 conn(0x5643f6b80ad0 msgr2=0x5643f6b7e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 shutdown_connections 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3425052662 wait complete. 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36c80342b0 msgr2=0x7f36c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36c80342b0 0x7f36c8036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5643f6b67d70 tx=0x7f37e00da040 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 msgr2=0x5643f6b77c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 0x5643f6b77c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f37e8016cf0 tx=0x7f37e800d790 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 shutdown_connections 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36c80342b0 0x7f36c8036770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 --2- 172.21.15.123:0/3802762880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6b77840 0x5643f6b77c60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 >> 172.21.15.123:0/3802762880 conn(0x5643f6b6c650 msgr2=0x5643f6b6d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 shutdown_connections 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.278+0000 7f37f135c980 1 -- 172.21.15.123:0/3802762880 wait complete. 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b64dd0 msgr2=0x5643f6b671c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b64dd0 0x5643f6b671c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6a6c9f0 msgr2=0x5643f6b64020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6a6c9f0 0x5643f6b64020 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36d40342b0 msgr2=0x7f36d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36d40342b0 0x7f36d4036770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000f70 tx=0x7f37e40012c0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 msgr2=0x5643f6b5d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b5d3a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f37e001bb20 tx=0x7f37e0018020 comp rx=0 tx=0).stop 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 shutdown_connections 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5643f6b64dd0 0x5643f6b671c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5643f6a6c9f0 0x5643f6b64020 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f36d40342b0 0x7f36d4036770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 --2- 172.21.15.123:0/3105363922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5643f6a6c0d0 0x5643f6b5d3a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 >> 172.21.15.123:0/3105363922 conn(0x5643f69df7f0 msgr2=0x5643f6b50d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 shutdown_connections 2024-03-20T13:36:57.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.282+0000 7f37f135c980 1 -- 172.21.15.123:0/3105363922 wait complete. 2024-03-20T13:36:57.295 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:57.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:57.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:57.296 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:57.370 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:57.371 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:57.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d5363980 1 Processor -- start 2024-03-20T13:36:57.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d5363980 1 -- start start 2024-03-20T13:36:57.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d5363980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dcc3620980 0x55dcc361ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d5363980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dcc35f6520 con 0x55dcc361f4c0 2024-03-20T13:36:57.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d5363980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dcc35bd0f0 con 0x55dcc3620980 2024-03-20T13:36:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d2e7e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dcc3620980 0x55dcc361ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d2e7e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dcc3620980 0x55dcc361ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53598/0 (socket says 172.21.15.123:53598) 2024-03-20T13:36:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d2e7e640 1 -- 172.21.15.123:0/4087322720 learned_addr learned my addr 172.21.15.123:0/4087322720 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d2e7e640 1 -- 172.21.15.123:0/4087322720 >> v1:172.21.15.89:6789/0 conn(0x55dcc361f4c0 legacy=0x55dcc36b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d2e7e640 1 -- 172.21.15.123:0/4087322720 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc36adb70 con 0x55dcc3620980 2024-03-20T13:36:57.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.366+0000 7f61d1e7c640 1 -- 172.21.15.123:0/4087322720 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683496457 0 0) 0x55dcc35f6520 con 0x55dcc361f4c0 2024-03-20T13:36:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/4087322720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc3620980 0x55dcc361ef80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f61c400a5c0 tx=0x7f61c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40f39021695ea96 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d1e7c640 1 -- 172.21.15.123:0/4087322720 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c40aa530 con 0x55dcc3620980 2024-03-20T13:36:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d1e7c640 1 -- 172.21.15.123:0/4087322720 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40a6050 con 0x55dcc3620980 2024-03-20T13:36:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d1e7c640 1 -- 172.21.15.123:0/4087322720 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c40aa7e0 con 0x55dcc3620980 2024-03-20T13:36:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 -- 172.21.15.123:0/4087322720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc3620980 msgr2=0x55dcc361ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 --2- 172.21.15.123:0/4087322720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc3620980 0x55dcc361ef80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f61c400a5c0 tx=0x7f61c401b340 comp rx=0 tx=0).stop 2024-03-20T13:36:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 -- 172.21.15.123:0/4087322720 shutdown_connections 2024-03-20T13:36:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 --2- 172.21.15.123:0/4087322720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc3620980 0x55dcc361ef80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 -- 172.21.15.123:0/4087322720 >> 172.21.15.123:0/4087322720 conn(0x55dcc36a5850 msgr2=0x55dcc36a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 -- 172.21.15.123:0/4087322720 shutdown_connections 2024-03-20T13:36:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.370+0000 7f61d5363980 1 -- 172.21.15.123:0/4087322720 wait complete. 2024-03-20T13:36:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.382+0000 7f61d5363980 1 Processor -- start 2024-03-20T13:36:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.382+0000 7f61d5363980 1 -- start start 2024-03-20T13:36:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc379aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc35ba620 con 0x55dcc361f4c0 2024-03-20T13:36:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc379aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc379aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53614/0 (socket says 172.21.15.123:53614) 2024-03-20T13:36:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 -- 172.21.15.123:0/1537248269 learned_addr learned my addr 172.21.15.123:0/1537248269 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 -- 172.21.15.123:0/1537248269 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4005df0 con 0x55dcc361f4c0 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/1537248269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc379aaa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61c4018f70 tx=0x7f61c4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0d331cb2f90b32 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f60c0e09640 1 -- 172.21.15.123:0/1537248269 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c40aa6f0 con 0x55dcc361f4c0 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f60c0e09640 1 -- 172.21.15.123:0/1537248269 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40aa850 con 0x55dcc361f4c0 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f60c0e09640 1 -- 172.21.15.123:0/1537248269 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c40aab10 con 0x55dcc361f4c0 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- 172.21.15.123:0/1537248269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 msgr2=0x55dcc379aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 --2- 172.21.15.123:0/1537248269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc379aaa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61c4018f70 tx=0x7f61c4003030 comp rx=0 tx=0).stop 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- 172.21.15.123:0/1537248269 shutdown_connections 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 --2- 172.21.15.123:0/1537248269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc379aaa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- 172.21.15.123:0/1537248269 >> 172.21.15.123:0/1537248269 conn(0x55dcc36a5850 msgr2=0x55dcc3796630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- 172.21.15.123:0/1537248269 shutdown_connections 2024-03-20T13:36:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- 172.21.15.123:0/1537248269 wait complete. 2024-03-20T13:36:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 Processor -- start 2024-03-20T13:36:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- start start 2024-03-20T13:36:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc37a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d5363980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc35b5e00 con 0x55dcc361f4c0 2024-03-20T13:36:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc37a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc37a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53624/0 (socket says 172.21.15.123:53624) 2024-03-20T13:36:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 -- 172.21.15.123:0/600959485 learned_addr learned my addr 172.21.15.123:0/600959485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.386+0000 7f61d2e7e640 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc36adb70 con 0x55dcc361f4c0 2024-03-20T13:36:57.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc37a17d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61c401bbe0 tx=0x7f61c40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f60bf606640 1 -- 172.21.15.123:0/600959485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c40b47e0 con 0x55dcc361f4c0 2024-03-20T13:36:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f60bf606640 1 -- 172.21.15.123:0/600959485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40c4070 con 0x55dcc361f4c0 2024-03-20T13:36:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f60bf606640 1 -- 172.21.15.123:0/600959485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c40b4a70 con 0x55dcc361f4c0 2024-03-20T13:36:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc37a1d10 con 0x55dcc361f4c0 2024-03-20T13:36:57.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc37a21a0 con 0x55dcc361f4c0 2024-03-20T13:36:57.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f60bf606640 1 -- 172.21.15.123:0/600959485 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61c40c6030 con 0x55dcc361f4c0 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f60bf606640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60b8034350 0x7f60b8036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f60bf606640 1 -- 172.21.15.123:0/600959485 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f61c40e4260 con 0x55dcc361f4c0 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d267d640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60b8034350 0x7f60b8036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc3620980 0x55dcc37a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37a88f0 con 0x55dcc3620980 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d367f640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc3620980 0x55dcc37a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d267d640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60b8034350 0x7f60b8036810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000f70 tx=0x7f61c8001400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d367f640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc3620980 0x55dcc37a83b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d367f640 1 -- 172.21.15.123:0/600959485 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc3620980 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37a9160 0x55dcc37ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37abc80 con 0x55dcc37a9160 2024-03-20T13:36:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.390+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37a9160 0x55dcc37ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37a9160 0x55dcc37ab550 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d2e7e640 1 -- 172.21.15.123:0/600959485 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37a9160 2024-03-20T13:36:57.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ad4e0 con 0x55dcc37a9160 2024-03-20T13:36:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d2e7e640 1 -- 172.21.15.123:0/600959485 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37a9160 2024-03-20T13:36:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ac6e0 con 0x55dcc37a9160 2024-03-20T13:36:57.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d2e7e640 1 -- 172.21.15.123:0/600959485 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37a9160 2024-03-20T13:36:57.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37acaf0 con 0x55dcc3620980 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d367f640 1 -- 172.21.15.123:0/600959485 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc3620980 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 Processor -- start 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 -- start start 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 0x55dcc37bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d5363980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc354ee30 con 0x55dcc37bbc70 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d367f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 0x55dcc37bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d367f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 0x55dcc37bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53638/0 (socket says 172.21.15.123:53638) 2024-03-20T13:36:57.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.394+0000 7f61d367f640 1 -- 172.21.15.123:0/1623399520 learned_addr learned my addr 172.21.15.123:0/1623399520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d367f640 1 -- 172.21.15.123:0/1623399520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc37bc5d0 con 0x55dcc37bbc70 2024-03-20T13:36:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d367f640 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 0x55dcc37bc090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61cc016cf0 tx=0x7f61cc00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f60bce01640 1 -- 172.21.15.123:0/1623399520 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61cc017660 con 0x55dcc37bbc70 2024-03-20T13:36:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f60bce01640 1 -- 172.21.15.123:0/1623399520 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0177c0 con 0x55dcc37bbc70 2024-03-20T13:36:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc37bc820 con 0x55dcc37bbc70 2024-03-20T13:36:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f60bce01640 1 -- 172.21.15.123:0/1623399520 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61cc017a60 con 0x55dcc37bbc70 2024-03-20T13:36:57.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc37bd370 con 0x55dcc37bbc70 2024-03-20T13:36:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f60bce01640 1 -- 172.21.15.123:0/1623399520 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61cc01d020 con 0x55dcc37bbc70 2024-03-20T13:36:57.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f60bce01640 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60ac0342b0 0x7f60ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f60bce01640 1 -- 172.21.15.123:0/1623399520 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f61cc04b550 con 0x55dcc37bbc70 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60ac0342b0 0x7f60ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d5363980 1 Processor -- start 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d5363980 1 -- start start 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60ac0342b0 0x7f60ac036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55dcc37ac120 tx=0x7f61c40dd040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d5363980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d5363980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc3542790 con 0x55dcc37c8c10 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d367f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d367f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53654/0 (socket says 172.21.15.123:53654) 2024-03-20T13:36:57.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d367f640 1 -- 172.21.15.123:0/1155331389 learned_addr learned my addr 172.21.15.123:0/1155331389 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.398+0000 7f61d367f640 1 -- 172.21.15.123:0/1155331389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc37c9600 con 0x55dcc37c8c10 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d367f640 1 --2- 172.21.15.123:0/1155331389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37c9030 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f61cc049970 tx=0x7f61cc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6d336296df44d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b67fc640 1 -- 172.21.15.123:0/1155331389 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61cc020510 con 0x55dcc37c8c10 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b67fc640 1 -- 172.21.15.123:0/1155331389 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc040030 con 0x55dcc37c8c10 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b67fc640 1 -- 172.21.15.123:0/1155331389 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61cc017bc0 con 0x55dcc37c8c10 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/1155331389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 msgr2=0x55dcc37c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 --2- 172.21.15.123:0/1155331389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37c9030 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f61cc049970 tx=0x7f61cc011ad0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/1155331389 shutdown_connections 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 --2- 172.21.15.123:0/1155331389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37c9030 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/1155331389 >> 172.21.15.123:0/1155331389 conn(0x55dcc37c4f50 msgr2=0x55dcc37c2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/1155331389 shutdown_connections 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/1155331389 wait complete. 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 Processor -- start 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- start start 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc37d0030 con 0x55dcc37c8c10 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d367f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d367f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53660/0 (socket says 172.21.15.123:53660) 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 learned_addr learned my addr 172.21.15.123:0/296659861 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc37bd370 con 0x55dcc37c8c10 2024-03-20T13:36:57.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d367f640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37cfaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00dce0 tx=0x7f61cc0498d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b4ff9640 1 -- 172.21.15.123:0/296659861 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61cc030070 con 0x55dcc37c8c10 2024-03-20T13:36:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc37d0230 con 0x55dcc37c8c10 2024-03-20T13:36:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b4ff9640 1 -- 172.21.15.123:0/296659861 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0484a0 con 0x55dcc37c8c10 2024-03-20T13:36:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b4ff9640 1 -- 172.21.15.123:0/296659861 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61cc029580 con 0x55dcc37c8c10 2024-03-20T13:36:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc37d0660 con 0x55dcc37c8c10 2024-03-20T13:36:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b4ff9640 1 -- 172.21.15.123:0/296659861 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61cc0296e0 con 0x55dcc37c8c10 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b4ff9640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f609c0342b0 0x7f609c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.402+0000 7f60b4ff9640 1 -- 172.21.15.123:0/296659861 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f61cc04a5a0 con 0x55dcc37c8c10 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f609c0342b0 0x7f609c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc37db130 0x55dcc37dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ddd40 con 0x55dcc37db130 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d267d640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc37db130 0x55dcc37dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f609c0342b0 0x7f609c036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f61c40c8fe0 tx=0x7f61c40e7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d267d640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc37db130 0x55dcc37dd5f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 realm 2024-03-20T13:36:57.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37da590 con 0x55dcc37db130 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37de7c0 con 0x55dcc37db130 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37df550 0x55dcc37e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e1ff0 con 0x55dcc37df550 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d367f640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37df550 0x55dcc37e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d367f640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37df550 0x55dcc37e1940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 20 searching for the correct realm 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dcc37e4560 0x55dcc37e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e6ee0 con 0x55dcc37e4560 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.406+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dcc37e4560 0x55dcc37e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d2e7e640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dcc37e4560 0x55dcc37e6950 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e6ee0 con 0x55dcc37df550 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f61cc03b050 0x7f61cc014920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x7f61cc03b050 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f61cc03b050 0x7f61cc014920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f61cc03b050 0x7f61cc014920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x7f61cc03b050 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37e4560 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.410+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x7f61cc03b050 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x7f61cc03b050 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x7f61cc03b050 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f61c8010610 con 0x7f61cc03b050 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37e4560 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8010610 con 0x55dcc37db130 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37e4560 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37e4560 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.414+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x7f61cc03b050 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37db130 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x7f61cc03b050 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37e4560 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x7f61cc03b050 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37e4560 2024-03-20T13:36:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e2840 con 0x55dcc37df550 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.418+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e3040 con 0x55dcc37db130 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e33f0 con 0x55dcc37df550 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e33f0 con 0x55dcc37db130 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 zone default found 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 4 Realm: () 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 zonegroup default 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e7320 con 0x7f61cc03b050 2024-03-20T13:36:57.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e9060 con 0x55dcc37e4560 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e93f0 con 0x55dcc37e4560 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 started sync module instance, tier type = 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e8940 con 0x55dcc37df550 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.422+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406661014688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e8cf0 con 0x55dcc37df550 2024-03-20T13:36:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ea130 con 0x55dcc37db130 2024-03-20T13:36:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406661020816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ea690 con 0x55dcc37db130 2024-03-20T13:36:57.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eb160 con 0x55dcc37df550 2024-03-20T13:36:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406661020816] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.426+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406661014688] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406661019632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eb120 con 0x55dcc37df550 2024-03-20T13:36:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ea260 con 0x7f61cc03b050 2024-03-20T13:36:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406661027088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ebdd0 con 0x7f61cc03b050 2024-03-20T13:36:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ec7d0 con 0x55dcc37df550 2024-03-20T13:36:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.430+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406661027088] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406661019632] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406661030608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eb930 con 0x55dcc37df550 2024-03-20T13:36:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ed050 con 0x55dcc37e4560 2024-03-20T13:36:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406661032880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eb930 con 0x55dcc37e4560 2024-03-20T13:36:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ede60 con 0x55dcc37e4560 2024-03-20T13:36:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406661032880] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.434+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406661030608] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406661024832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ede60 con 0x55dcc37e4560 2024-03-20T13:36:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ee660 con 0x7f61cc03b050 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406661038144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eeaa0 con 0x7f61cc03b050 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=0 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=1 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=2 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=3 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=4 2024-03-20T13:36:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=5 2024-03-20T13:36:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406661024832] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.438+0000 7f61d5363980 20 add_watcher() i=6 2024-03-20T13:36:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.442+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406661038144] v32'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.442+0000 7f61d5363980 20 add_watcher() i=7 2024-03-20T13:36:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.442+0000 7f61d5363980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.442+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ed9c0 con 0x55dcc37db130 2024-03-20T13:36:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.442+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.442+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406661039424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ed9c0 con 0x55dcc37db130 2024-03-20T13:36:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406661039424] v32'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f60897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 5 note: GC not initialized 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f6003fff640 20 reqs_thread_entry: start 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 20 Filter name: none 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f6001ffb640 20 reqs_thread_entry: start 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc3813580 con 0x55dcc37db130 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 20 rados_obj.operate() r=0 bl.length=459 2024-03-20T13:36:57.453 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f60897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.446+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406661039424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc38125f0 con 0x55dcc37db130 2024-03-20T13:36:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.450+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94406661039424] v32'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.450+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406661014688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ee500 con 0x55dcc37df550 2024-03-20T13:36:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.450+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94406661014688] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.450+0000 7f61d5363980 20 remove_watcher() i=0 2024-03-20T13:36:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.450+0000 7f61d5363980 2 removed watcher, disabling cache 2024-03-20T13:36:57.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.450+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406661020816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e84a0 con 0x55dcc37db130 2024-03-20T13:36:57.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.454+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94406661020816] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x55dcc37db130 2024-03-20T13:36:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.454+0000 7f61d5363980 20 remove_watcher() i=1 2024-03-20T13:36:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.454+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406661019632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e84a0 con 0x55dcc37df550 2024-03-20T13:36:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.454+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94406661019632] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.454+0000 7f61d5363980 20 remove_watcher() i=2 2024-03-20T13:36:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.454+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406661027088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e84a0 con 0x7f61cc03b050 2024-03-20T13:36:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94406661027088] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d5363980 20 remove_watcher() i=3 2024-03-20T13:36:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406661030608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eb510 con 0x55dcc37df550 2024-03-20T13:36:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d367f640 1 -- 172.21.15.123:0/296659861 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94406661030608] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61cc00a4d0 con 0x55dcc37df550 2024-03-20T13:36:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d5363980 20 remove_watcher() i=4 2024-03-20T13:36:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406661032880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37e84a0 con 0x55dcc37e4560 2024-03-20T13:36:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94406661032880] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d5363980 20 remove_watcher() i=5 2024-03-20T13:36:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.458+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406661024832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37ec2d0 con 0x55dcc37e4560 2024-03-20T13:36:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d2e7e640 1 -- 172.21.15.123:0/296659861 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94406661024832] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c40d2980 con 0x55dcc37e4560 2024-03-20T13:36:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 20 remove_watcher() i=6 2024-03-20T13:36:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406661038144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dcc37eb510 con 0x7f61cc03b050 2024-03-20T13:36:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94406661038144] v32'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c8028040 con 0x7f61cc03b050 2024-03-20T13:36:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 20 remove_watcher() i=7 2024-03-20T13:36:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37df550 msgr2=0x55dcc37e1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37df550 0x55dcc37e1940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc37db130 msgr2=0x55dcc37dd5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc37db130 0x55dcc37dd5f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f61cc03b050 msgr2=0x7f61cc014920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f61cc03b050 0x7f61cc014920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dcc37e4560 msgr2=0x55dcc37e6950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dcc37e4560 0x55dcc37e6950 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f609c0342b0 msgr2=0x7f609c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f609c0342b0 0x7f609c036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f61c40c8fe0 tx=0x7f61c40e7000 comp rx=0 tx=0).stop 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 msgr2=0x55dcc37cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37cfaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00dce0 tx=0x7f61cc0498d0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d267d640 1 -- 172.21.15.123:0/296659861 reap_dead start 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 shutdown_connections 2024-03-20T13:36:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/296659861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37c8c10 0x55dcc37cfaf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 >> 172.21.15.123:0/296659861 conn(0x55dcc37c4f50 msgr2=0x55dcc37c25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 shutdown_connections 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/296659861 wait complete. 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60ac0342b0 msgr2=0x7f60ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60ac0342b0 0x7f60ac036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55dcc37ac120 tx=0x7f61c40dd040 comp rx=0 tx=0).stop 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 msgr2=0x55dcc37bc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 0x55dcc37bc090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61cc016cf0 tx=0x7f61cc00d790 comp rx=0 tx=0).stop 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 shutdown_connections 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60ac0342b0 0x7f60ac036770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 --2- 172.21.15.123:0/1623399520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc37bbc70 0x55dcc37bc090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 >> 172.21.15.123:0/1623399520 conn(0x55dcc37b0a80 msgr2=0x55dcc37b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 shutdown_connections 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.462+0000 7f61d5363980 1 -- 172.21.15.123:0/1623399520 wait complete. 2024-03-20T13:36:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37a9160 msgr2=0x55dcc37ab550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37a9160 0x55dcc37ab550 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc3620980 msgr2=0x55dcc37a83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc3620980 0x55dcc37a83b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60b8034350 msgr2=0x7f60b8036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60b8034350 0x7f60b8036810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000f70 tx=0x7f61c8001400 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 msgr2=0x55dcc37a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc37a17d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61c401bbe0 tx=0x7f61c40180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 shutdown_connections 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dcc37a9160 0x55dcc37ab550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dcc3620980 0x55dcc37a83b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f60b8034350 0x7f60b8036810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 --2- 172.21.15.123:0/600959485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcc361f4c0 0x55dcc37a17d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 >> 172.21.15.123:0/600959485 conn(0x55dcc36a5850 msgr2=0x55dcc3795140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 shutdown_connections 2024-03-20T13:36:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.466+0000 7f61d5363980 1 -- 172.21.15.123:0/600959485 wait complete. 2024-03-20T13:36:57.479 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:57.479 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-03-20T13:36:57.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-03-20T13:36:57.480 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-03-20T13:36:57.556 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:57.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.550+0000 7f2cf3cd5980 1 Processor -- start 2024-03-20T13:36:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.550+0000 7f2cf3cd5980 1 -- start start 2024-03-20T13:36:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.550+0000 7f2cf3cd5980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x565446874990 0x565446872f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.550+0000 7f2cf3cd5980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56544684a4c0 con 0x5654468734d0 2024-03-20T13:36:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.550+0000 7f2cf3cd5980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5654468110f0 con 0x565446874990 2024-03-20T13:36:57.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf17f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x565446874990 0x565446872f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf17f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x565446874990 0x565446872f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53670/0 (socket says 172.21.15.123:53670) 2024-03-20T13:36:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1073977235 learned_addr learned my addr 172.21.15.123:0/1073977235 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf0fef640 1 --1- 172.21.15.123:0/1073977235 >> v1:172.21.15.89:6789/0 conn(0x5654468734d0 0x565446905f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59002/0 (socket says 172.21.15.123:59002) 2024-03-20T13:36:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1073977235 >> v1:172.21.15.89:6789/0 conn(0x5654468734d0 legacy=0x565446905f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1073977235 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654468738e0 con 0x565446874990 2024-03-20T13:36:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/1073977235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446874990 0x565446872f90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00a5c0 tx=0x7f2cec01b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40481481775538d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2ce3fff640 1 -- 172.21.15.123:0/1073977235 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0aa530 con 0x565446874990 2024-03-20T13:36:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2ce3fff640 1 -- 172.21.15.123:0/1073977235 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0a6050 con 0x565446874990 2024-03-20T13:36:57.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2ce3fff640 1 -- 172.21.15.123:0/1073977235 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0aa7e0 con 0x565446874990 2024-03-20T13:36:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1073977235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446874990 msgr2=0x565446872f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1073977235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446874990 0x565446872f90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00a5c0 tx=0x7f2cec01b2e0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1073977235 shutdown_connections 2024-03-20T13:36:57.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1073977235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446874990 0x565446872f90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1073977235 >> 172.21.15.123:0/1073977235 conn(0x5654468f9860 msgr2=0x5654468fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1073977235 shutdown_connections 2024-03-20T13:36:57.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.554+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1073977235 wait complete. 2024-03-20T13:36:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 Processor -- start 2024-03-20T13:36:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- start start 2024-03-20T13:36:57.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544680e620 con 0x5654468734d0 2024-03-20T13:36:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf17f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf17f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469ea590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53680/0 (socket says 172.21.15.123:53680) 2024-03-20T13:36:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1845626333 learned_addr learned my addr 172.21.15.123:0/1845626333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1845626333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec005df0 con 0x5654468734d0 2024-03-20T13:36:57.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/1845626333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469ea590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2cec018f70 tx=0x7f2cec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9395122e71676fde server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2bdf606640 1 -- 172.21.15.123:0/1845626333 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0aa800 con 0x5654468734d0 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2bdf606640 1 -- 172.21.15.123:0/1845626333 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0aa960 con 0x5654468734d0 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2bdf606640 1 -- 172.21.15.123:0/1845626333 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0aac20 con 0x5654468734d0 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1845626333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 msgr2=0x5654469ea590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1845626333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469ea590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2cec018f70 tx=0x7f2cec003030 comp rx=0 tx=0).stop 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1845626333 shutdown_connections 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1845626333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469ea590 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1845626333 >> 172.21.15.123:0/1845626333 conn(0x5654468f9860 msgr2=0x5654469e6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1845626333 shutdown_connections 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1845626333 wait complete. 2024-03-20T13:36:57.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.570+0000 7f2cf3cd5980 1 Processor -- start 2024-03-20T13:36:57.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 -- start start 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x565446809e00 con 0x5654468734d0 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf17f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf17f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53694/0 (socket says 172.21.15.123:53694) 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1580663351 learned_addr learned my addr 172.21.15.123:0/1580663351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654468738e0 con 0x5654468734d0 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469f12c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cec01bb80 tx=0x7f2cec0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2bdde03640 1 -- 172.21.15.123:0/1580663351 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0c2070 con 0x5654468734d0 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654469f1800 con 0x5654468734d0 2024-03-20T13:36:57.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2bdde03640 1 -- 172.21.15.123:0/1580663351 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0bdb10 con 0x5654468734d0 2024-03-20T13:36:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2bdde03640 1 -- 172.21.15.123:0/1580663351 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0bddb0 con 0x5654468734d0 2024-03-20T13:36:57.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654469f1bd0 con 0x5654468734d0 2024-03-20T13:36:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2bdde03640 1 -- 172.21.15.123:0/1580663351 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2cec0b1070 con 0x5654468734d0 2024-03-20T13:36:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2bdde03640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bd80342b0 0x7f2bd8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2bdde03640 1 -- 172.21.15.123:0/1580663351 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2cec0e3700 con 0x5654468734d0 2024-03-20T13:36:57.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf0fef640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bd80342b0 0x7f2bd8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446874990 0x5654469f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654469f83e0 con 0x565446874990 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446874990 0x5654469f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf0fef640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bd80342b0 0x7f2bd8036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8001e50 tx=0x7f2ce80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446874990 0x5654469f7ea0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/1580663351 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ce400a4d0 con 0x565446874990 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654469f8c50 0x5654469fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.574+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654469fb760 con 0x5654469f8c50 2024-03-20T13:36:57.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654469f8c50 0x5654469fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654469f8c50 0x5654469fb040 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1580663351 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2cec0cc070 con 0x5654469f8c50 2024-03-20T13:36:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654469fcfc0 con 0x5654469f8c50 2024-03-20T13:36:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1580663351 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2cec0cc070 con 0x5654469f8c50 2024-03-20T13:36:57.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654469fc1c0 con 0x5654469f8c50 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf17f0640 1 -- 172.21.15.123:0/1580663351 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2cec0cc070 con 0x5654469f8c50 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654469fc5d0 con 0x565446874990 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/1580663351 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2ce400a4d0 con 0x565446874990 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 Processor -- start 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 -- start start 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 0x565446a0bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.578+0000 7f2cf3cd5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654467a2e30 con 0x565446a0b750 2024-03-20T13:36:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf1ff1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 0x565446a0bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf1ff1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 0x565446a0bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53698/0 (socket says 172.21.15.123:53698) 2024-03-20T13:36:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/3895080077 learned_addr learned my addr 172.21.15.123:0/3895080077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/3895080077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565446a0c0b0 con 0x565446a0b750 2024-03-20T13:36:57.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 0x565446a0bb70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4016cf0 tx=0x7f2ce400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2bd6ffd640 1 -- 172.21.15.123:0/3895080077 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4017660 con 0x565446a0b750 2024-03-20T13:36:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2bd6ffd640 1 -- 172.21.15.123:0/3895080077 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40177c0 con 0x565446a0b750 2024-03-20T13:36:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2bd6ffd640 1 -- 172.21.15.123:0/3895080077 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4017a60 con 0x565446a0b750 2024-03-20T13:36:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565446a0c300 con 0x565446a0b750 2024-03-20T13:36:57.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565446a0ce50 con 0x565446a0b750 2024-03-20T13:36:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2bd6ffd640 1 -- 172.21.15.123:0/3895080077 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2ce401d020 con 0x565446a0b750 2024-03-20T13:36:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2bd6ffd640 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bc8034300 0x7f2bc80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2bd6ffd640 1 -- 172.21.15.123:0/3895080077 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2ce404b170 con 0x565446a0b750 2024-03-20T13:36:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bc8034300 0x7f2bc80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf3cd5980 1 Processor -- start 2024-03-20T13:36:57.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf3cd5980 1 -- start start 2024-03-20T13:36:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bc8034300 0x7f2bc80367c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5654469fbc00 tx=0x7f2cec0d8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf3cd5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a18b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.582+0000 7f2cf3cd5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x565446796790 con 0x565446a186f0 2024-03-20T13:36:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a18b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a18b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53714/0 (socket says 172.21.15.123:53714) 2024-03-20T13:36:57.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/2626286600 learned_addr learned my addr 172.21.15.123:0/2626286600 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/2626286600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565446a190e0 con 0x565446a186f0 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/2626286600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a18b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a100 tx=0x7f2ce40146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d90145fc61da5b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2bd4ff9640 1 -- 172.21.15.123:0/2626286600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4017c80 con 0x565446a186f0 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2bd4ff9640 1 -- 172.21.15.123:0/2626286600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce403b170 con 0x565446a186f0 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2bd4ff9640 1 -- 172.21.15.123:0/2626286600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4011cb0 con 0x565446a186f0 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/2626286600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 msgr2=0x565446a18b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/2626286600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a18b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a100 tx=0x7f2ce40146a0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/2626286600 shutdown_connections 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/2626286600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a18b10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/2626286600 >> 172.21.15.123:0/2626286600 conn(0x565446a14a30 msgr2=0x565446a12a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/2626286600 shutdown_connections 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/2626286600 wait complete. 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 Processor -- start 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- start start 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a1f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x565446a1faf0 con 0x565446a186f0 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a1f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a1f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53722/0 (socket says 172.21.15.123:53722) 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 learned_addr learned my addr 172.21.15.123:0/154958999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565446a0ce50 con 0x565446a186f0 2024-03-20T13:36:57.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a1f5b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a100 tx=0x7f2ce40494f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2bc6ffd640 1 -- 172.21.15.123:0/154958999 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce403b2e0 con 0x565446a186f0 2024-03-20T13:36:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565446a1fcf0 con 0x565446a186f0 2024-03-20T13:36:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2bc6ffd640 1 -- 172.21.15.123:0/154958999 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40113d0 con 0x565446a186f0 2024-03-20T13:36:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2bc6ffd640 1 -- 172.21.15.123:0/154958999 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4005020 con 0x565446a186f0 2024-03-20T13:36:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.586+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565446a20120 con 0x565446a186f0 2024-03-20T13:36:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2bc6ffd640 1 -- 172.21.15.123:0/154958999 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2ce4005180 con 0x565446a186f0 2024-03-20T13:36:57.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2bc6ffd640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bbc0342b0 0x7f2bbc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2bc6ffd640 1 -- 172.21.15.123:0/154958999 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2ce4044070 con 0x565446a186f0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bbc0342b0 0x7f2bbc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446a2ac60 0x565446a2d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a2d870 con 0x565446a2ac60 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf0fef640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446a2ac60 0x565446a2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bbc0342b0 0x7f2bbc036770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0e3a30 tx=0x7f2cec0de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf0fef640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446a2ac60 0x565446a2d120 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 realm 2024-03-20T13:36:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a2a110 con 0x565446a2ac60 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a2e2b0 con 0x565446a2ac60 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x565446a2f040 0x565446a31430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a31ab0 con 0x565446a2f040 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x565446a2f040 0x565446a31430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x565446a2f040 0x565446a31430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.590+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a322b0 con 0x565446a2f040 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf3cd5980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf3cd5980 20 searching for the correct realm 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x565446a341f0 0x565446a366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a341f0 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x565446a341f0 0x565446a366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf17f0640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x565446a341f0 0x565446a366b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2f040 2024-03-20T13:36:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf1ff1640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2ce4039030 0x7f2ce4002c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x7f2ce4039030 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2ce4039030 0x7f2ce4002c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2ce4039030 0x7f2ce4002c90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2ac60 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2ac60 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a341f0 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2ac60 2024-03-20T13:36:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.594+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2f040 2024-03-20T13:36:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2f040 2024-03-20T13:36:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2ac60 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x7f2ce4039030 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a36d80 con 0x565446a2ac60 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x7f2ce4039030 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2f040 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a341f0 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2ac60 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2f040 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.598+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a341f0 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2ac60 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2ac60 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2ac60 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a341f0 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x7f2ce4039030 2024-03-20T13:36:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2ac60 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x7f2ce4039030 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a341f0 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x7f2ce4039030 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2f040 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2f040 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.602+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a341f0 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2f040 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2ce802d080 con 0x565446a2f040 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:57.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a33750 con 0x565446a2ac60 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a326d0 con 0x565446a2f040 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a32fa0 con 0x565446a2ac60 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 zone default found 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 4 Realm: () 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 zonegroup default 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a37660 con 0x7f2ce4039030 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a393a0 con 0x565446a341f0 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a39700 con 0x565446a341f0 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 started sync module instance, tier type = 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.606+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a38c80 con 0x565446a2f040 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.610+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.610+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919962363872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a39030 con 0x565446a2f040 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.610+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3a410 con 0x565446a2ac60 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.610+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.610+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919962369904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3a930 con 0x565446a2ac60 2024-03-20T13:36:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.610+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3b400 con 0x565446a2f040 2024-03-20T13:36:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.614+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919962369904] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.614+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919962363872] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.614+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.614+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919962368720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3b3c0 con 0x565446a2f040 2024-03-20T13:36:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.614+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3a540 con 0x7f2ce4039030 2024-03-20T13:36:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919962376112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3c070 con 0x7f2ce4039030 2024-03-20T13:36:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3ca90 con 0x565446a2f040 2024-03-20T13:36:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919962376112] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919962368720] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919962379632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3bbd0 con 0x565446a2f040 2024-03-20T13:36:57.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3d2e0 con 0x565446a341f0 2024-03-20T13:36:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919962381888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3bbd0 con 0x565446a341f0 2024-03-20T13:36:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.618+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3e0f0 con 0x565446a341f0 2024-03-20T13:36:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.622+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919962381888] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.622+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919962379632] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.622+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.622+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919962383936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3aff0 con 0x565446a341f0 2024-03-20T13:36:57.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.622+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3e800 con 0x7f2ce4039030 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919962387168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3e800 con 0x7f2ce4039030 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=0 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=1 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=2 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=3 2024-03-20T13:36:57.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=4 2024-03-20T13:36:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=5 2024-03-20T13:36:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919962383936] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=6 2024-03-20T13:36:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919962387168] v32'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 20 add_watcher() i=7 2024-03-20T13:36:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3dc50 con 0x565446a2ac60 2024-03-20T13:36:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.626+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919962389232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3dc50 con 0x565446a2ac60 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919962389232] v32'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2ba7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 5 note: GC not initialized 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2ba6fe5640 20 reqs_thread_entry: start 2024-03-20T13:36:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 20 Filter name: none 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2ba4fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a63c80 con 0x565446a2ac60 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 20 rados_obj.operate() r=0 bl.length=459 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.630+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a69980 con 0x565446a2ac60 2024-03-20T13:36:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v32'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf3cd5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf3cd5980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf3cd5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94919962563712 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a66640 con 0x565446a2f040 2024-03-20T13:36:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94919962379632 notify 137438953477 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f2ce4067040 con 0x565446a2f040 2024-03-20T13:36:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2bd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94919962379632 notifier 4353 bl.length()=533 2024-03-20T13:36:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2bd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2bd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2bd4ff9640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2bb4003ea0 con 0x565446a2f040 2024-03-20T13:36:57.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 94919962563712 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify_complete (2) cookie 94919962563712 notify 137438953477 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x565446a20120 con 0x565446a2f040 2024-03-20T13:36:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf3cd5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:36:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94919962563712 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a66640 con 0x565446a2f040 2024-03-20T13:36:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify (1) cookie 94919962368720 notify 137438953478 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x565446a20120 con 0x565446a2f040 2024-03-20T13:36:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2bc7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94919962368720 notifier 4353 bl.length()=170 2024-03-20T13:36:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2bc7fff640 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2b180032c0 con 0x565446a2f040 2024-03-20T13:36:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.634+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(66 notify.2 [notify cookie 94919962563712 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.638+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== watch-notify(notify_complete (2) cookie 94919962563712 notify 137438953478 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2ce4038070 con 0x565446a2f040 2024-03-20T13:36:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.638+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.638+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a69480 con 0x565446a341f0 2024-03-20T13:36:57.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.638+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.644 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.638+0000 7f2ba7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.638+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919962389232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a62b90 con 0x565446a2ac60 2024-03-20T13:36:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.642+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94919962389232] v32'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.642+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919962363872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3eaf0 con 0x565446a2f040 2024-03-20T13:36:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.642+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94919962363872] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.642+0000 7f2cf3cd5980 20 remove_watcher() i=0 2024-03-20T13:36:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.642+0000 7f2cf3cd5980 2 removed watcher, disabling cache 2024-03-20T13:36:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.642+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919962369904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a387e0 con 0x565446a2ac60 2024-03-20T13:36:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94919962369904] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x565446a2ac60 2024-03-20T13:36:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf3cd5980 20 remove_watcher() i=1 2024-03-20T13:36:57.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919962368720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a387e0 con 0x565446a2f040 2024-03-20T13:36:57.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94919962368720] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf3cd5980 20 remove_watcher() i=2 2024-03-20T13:36:57.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919962376112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a387e0 con 0x7f2ce4039030 2024-03-20T13:36:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94919962376112] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf3cd5980 20 remove_watcher() i=3 2024-03-20T13:36:57.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.646+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919962379632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a387e0 con 0x565446a2f040 2024-03-20T13:36:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.650+0000 7f2cf1ff1640 1 -- 172.21.15.123:0/154958999 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94919962379632] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce4053040 con 0x565446a2f040 2024-03-20T13:36:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.650+0000 7f2cf3cd5980 20 remove_watcher() i=4 2024-03-20T13:36:57.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.650+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919962381888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3c570 con 0x565446a341f0 2024-03-20T13:36:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.650+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94919962381888] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.650+0000 7f2cf3cd5980 20 remove_watcher() i=5 2024-03-20T13:36:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.650+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919962383936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a387e0 con 0x565446a341f0 2024-03-20T13:36:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf17f0640 1 -- 172.21.15.123:0/154958999 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94919962383936] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2cec0eb040 con 0x565446a341f0 2024-03-20T13:36:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 20 remove_watcher() i=6 2024-03-20T13:36:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919962387168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565446a3c570 con 0x7f2ce4039030 2024-03-20T13:36:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94919962387168] v32'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ce800f6a0 con 0x7f2ce4039030 2024-03-20T13:36:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 20 remove_watcher() i=7 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x565446a2f040 msgr2=0x565446a31430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x565446a2f040 0x565446a31430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446a2ac60 msgr2=0x565446a2d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446a2ac60 0x565446a2d120 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2ce4039030 msgr2=0x7f2ce4002c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2ce4039030 0x7f2ce4002c90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x565446a341f0 msgr2=0x565446a366b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x565446a341f0 0x565446a366b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bbc0342b0 msgr2=0x7f2bbc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bbc0342b0 0x7f2bbc036770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0e3a30 tx=0x7f2cec0de000 comp rx=0 tx=0).stop 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 msgr2=0x565446a1f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf0fef640 1 -- 172.21.15.123:0/154958999 reap_dead start 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a1f5b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a100 tx=0x7f2ce40494f0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 shutdown_connections 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/154958999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a186f0 0x565446a1f5b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 >> 172.21.15.123:0/154958999 conn(0x565446a14a30 msgr2=0x565446a12090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 shutdown_connections 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/154958999 wait complete. 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bc8034300 msgr2=0x7f2bc80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bc8034300 0x7f2bc80367c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5654469fbc00 tx=0x7f2cec0d8040 comp rx=0 tx=0).stop 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 msgr2=0x565446a0bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 0x565446a0bb70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4016cf0 tx=0x7f2ce400d790 comp rx=0 tx=0).stop 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 shutdown_connections 2024-03-20T13:36:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bc8034300 0x7f2bc80367c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/3895080077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565446a0b750 0x565446a0bb70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 >> 172.21.15.123:0/3895080077 conn(0x565446a00560 msgr2=0x565446a01070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 shutdown_connections 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/3895080077 wait complete. 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654469f8c50 msgr2=0x5654469fb040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654469f8c50 0x5654469fb040 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446874990 msgr2=0x5654469f7ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446874990 0x5654469f7ea0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bd80342b0 msgr2=0x7f2bd8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bd80342b0 0x7f2bd8036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8001e50 tx=0x7f2ce80013b0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 msgr2=0x5654469f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469f12c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cec01bb80 tx=0x7f2cec0180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 shutdown_connections 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654469f8c50 0x5654469fb040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x565446874990 0x5654469f7ea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2bd80342b0 0x7f2bd8036770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 --2- 172.21.15.123:0/1580663351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654468734d0 0x5654469f12c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 >> 172.21.15.123:0/1580663351 conn(0x5654468f9860 msgr2=0x5654469e4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 shutdown_connections 2024-03-20T13:36:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.654+0000 7f2cf3cd5980 1 -- 172.21.15.123:0/1580663351 wait complete. 2024-03-20T13:36:57.670 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:57.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-03-20T13:36:57.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-03-20T13:36:57.670 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-03-20T13:36:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:57.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.738+0000 7fc367bff980 1 Processor -- start 2024-03-20T13:36:57.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.738+0000 7fc367bff980 1 -- start start 2024-03-20T13:36:57.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.738+0000 7fc367bff980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560da972bf50 0x560da972c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.738+0000 7fc367bff980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560da96784c0 con 0x560da972c870 2024-03-20T13:36:57.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.738+0000 7fc367bff980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x560da963f0f0 con 0x560da972bf50 2024-03-20T13:36:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc36571a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560da972bf50 0x560da972c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc36571a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560da972bf50 0x560da972c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53732/0 (socket says 172.21.15.123:53732) 2024-03-20T13:36:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc364f19640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x560da972c870 0x560da972d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59010/0 (socket says 172.21.15.123:59010) 2024-03-20T13:36:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc36571a640 1 -- 172.21.15.123:0/3101026959 learned_addr learned my addr 172.21.15.123:0/3101026959 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc36571a640 1 -- 172.21.15.123:0/3101026959 >> v1:172.21.15.89:6789/0 conn(0x560da972c870 legacy=0x560da972d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc36571a640 1 -- 172.21.15.123:0/3101026959 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da972da60 con 0x560da972bf50 2024-03-20T13:36:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc36571a640 1 --2- 172.21.15.123:0/3101026959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da972c330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc35800a5c0 tx=0x7fc35801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8632bd85c1a86e49 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc357fff640 1 -- 172.21.15.123:0/3101026959 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3580aa470 con 0x560da972bf50 2024-03-20T13:36:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc357fff640 1 -- 172.21.15.123:0/3101026959 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580aa5d0 con 0x560da972bf50 2024-03-20T13:36:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc357fff640 1 -- 172.21.15.123:0/3101026959 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3580aa890 con 0x560da972bf50 2024-03-20T13:36:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc367bff980 1 -- 172.21.15.123:0/3101026959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 msgr2=0x560da972c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.742+0000 7fc367bff980 1 --2- 172.21.15.123:0/3101026959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da972c330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc35800a5c0 tx=0x7fc35801b340 comp rx=0 tx=0).stop 2024-03-20T13:36:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.746+0000 7fc367bff980 1 -- 172.21.15.123:0/3101026959 shutdown_connections 2024-03-20T13:36:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.746+0000 7fc367bff980 1 --2- 172.21.15.123:0/3101026959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da972c330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.746+0000 7fc367bff980 1 -- 172.21.15.123:0/3101026959 >> 172.21.15.123:0/3101026959 conn(0x560da9727820 msgr2=0x560da9729c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.746+0000 7fc367bff980 1 -- 172.21.15.123:0/3101026959 shutdown_connections 2024-03-20T13:36:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.746+0000 7fc367bff980 1 -- 172.21.15.123:0/3101026959 wait complete. 2024-03-20T13:36:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 Processor -- start 2024-03-20T13:36:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- start start 2024-03-20T13:36:57.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da96a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da963c620 con 0x560da972bf50 2024-03-20T13:36:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc36571a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da96a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc36571a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da96a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53748/0 (socket says 172.21.15.123:53748) 2024-03-20T13:36:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc36571a640 1 -- 172.21.15.123:0/480742409 learned_addr learned my addr 172.21.15.123:0/480742409 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc36571a640 1 -- 172.21.15.123:0/480742409 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358005df0 con 0x560da972bf50 2024-03-20T13:36:57.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc36571a640 1 --2- 172.21.15.123:0/480742409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da96a1f00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc358018f70 tx=0x7fc358003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a3063a4152237f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc253606640 1 -- 172.21.15.123:0/480742409 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3580aa9c0 con 0x560da972bf50 2024-03-20T13:36:57.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc253606640 1 -- 172.21.15.123:0/480742409 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580aab20 con 0x560da972bf50 2024-03-20T13:36:57.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc253606640 1 -- 172.21.15.123:0/480742409 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3580aadc0 con 0x560da972bf50 2024-03-20T13:36:57.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- 172.21.15.123:0/480742409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 msgr2=0x560da96a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 --2- 172.21.15.123:0/480742409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da96a1f00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc358018f70 tx=0x7fc358003030 comp rx=0 tx=0).stop 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- 172.21.15.123:0/480742409 shutdown_connections 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 --2- 172.21.15.123:0/480742409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da96a1f00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- 172.21.15.123:0/480742409 >> 172.21.15.123:0/480742409 conn(0x560da9727820 msgr2=0x560da9811f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- 172.21.15.123:0/480742409 shutdown_connections 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.758+0000 7fc367bff980 1 -- 172.21.15.123:0/480742409 wait complete. 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 Processor -- start 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 -- start start 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da981f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da9637e00 con 0x560da972bf50 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc36571a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da981f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc36571a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da981f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53762/0 (socket says 172.21.15.123:53762) 2024-03-20T13:36:57.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc36571a640 1 -- 172.21.15.123:0/144385704 learned_addr learned my addr 172.21.15.123:0/144385704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc36571a640 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da972da60 con 0x560da972bf50 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc36571a640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da981f340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc358018f70 tx=0x7fc3580180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc251e03640 1 -- 172.21.15.123:0/144385704 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3580cb070 con 0x560da972bf50 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560da981f880 con 0x560da972bf50 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc251e03640 1 -- 172.21.15.123:0/144385704 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580c6690 con 0x560da972bf50 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc251e03640 1 -- 172.21.15.123:0/144385704 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3580c6930 con 0x560da972bf50 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560da981fcb0 con 0x560da972bf50 2024-03-20T13:36:57.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc251e03640 1 -- 172.21.15.123:0/144385704 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3580c6a90 con 0x560da972bf50 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc251e03640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc24c034300 0x7fc24c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc251e03640 1 -- 172.21.15.123:0/144385704 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc3580e4a40 con 0x560da972bf50 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc364f19640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc24c034300 0x7fc24c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da972c870 0x560da9825f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9826460 con 0x560da972c870 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc365f1b640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da972c870 0x560da9825f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc364f19640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc24c034300 0x7fc24c0367c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc35c001e50 tx=0x7fc35c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.762+0000 7fc365f1b640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da972c870 0x560da9825f20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc365f1b640 1 -- 172.21.15.123:0/144385704 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da972c870 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da9826cd0 0x560da98290c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9829790 con 0x560da9826cd0 2024-03-20T13:36:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc36571a640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da9826cd0 0x560da98290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc36571a640 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da9826cd0 0x560da98290c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc36571a640 1 -- 172.21.15.123:0/144385704 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc3580cd070 con 0x560da9826cd0 2024-03-20T13:36:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da982aff0 con 0x560da9826cd0 2024-03-20T13:36:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc36571a640 1 -- 172.21.15.123:0/144385704 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc3580cd070 con 0x560da9826cd0 2024-03-20T13:36:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da982a130 con 0x560da9826cd0 2024-03-20T13:36:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc36571a640 1 -- 172.21.15.123:0/144385704 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc3580cd070 con 0x560da9826cd0 2024-03-20T13:36:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da982a540 con 0x560da972c870 2024-03-20T13:36:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc365f1b640 1 -- 172.21.15.123:0/144385704 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da972c870 2024-03-20T13:36:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.766+0000 7fc367bff980 1 Processor -- start 2024-03-20T13:36:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 -- start start 2024-03-20T13:36:57.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 0x560da9839af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da95d0e30 con 0x560da98396d0 2024-03-20T13:36:57.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc365f1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 0x560da9839af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc365f1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 0x560da9839af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53768/0 (socket says 172.21.15.123:53768) 2024-03-20T13:36:57.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc365f1b640 1 -- 172.21.15.123:0/3464428191 learned_addr learned my addr 172.21.15.123:0/3464428191 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc365f1b640 1 -- 172.21.15.123:0/3464428191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da983a030 con 0x560da98396d0 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc365f1b640 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 0x560da9839af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc360016cf0 tx=0x7fc36000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc24affd640 1 -- 172.21.15.123:0/3464428191 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc360017660 con 0x560da98396d0 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560da983a280 con 0x560da98396d0 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc24affd640 1 -- 172.21.15.123:0/3464428191 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3600177c0 con 0x560da98396d0 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560da983add0 con 0x560da98396d0 2024-03-20T13:36:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc24affd640 1 -- 172.21.15.123:0/3464428191 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc360017a60 con 0x560da98396d0 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc24affd640 1 -- 172.21.15.123:0/3464428191 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc36001d020 con 0x560da98396d0 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc24affd640 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc23c034300 0x7fc23c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc24affd640 1 -- 172.21.15.123:0/3464428191 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc36004b5f0 con 0x560da98396d0 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc36571a640 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc23c034300 0x7fc23c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 Processor -- start 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 -- start start 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc36571a640 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc23c034300 0x7fc23c0367c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x560da9829c30 tx=0x7fc3580e1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da9846a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.770+0000 7fc367bff980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da95c4790 con 0x560da9846650 2024-03-20T13:36:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da9846a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da9846a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53776/0 (socket says 172.21.15.123:53776) 2024-03-20T13:36:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 -- 172.21.15.123:0/3589453052 learned_addr learned my addr 172.21.15.123:0/3589453052 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 -- 172.21.15.123:0/3589453052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da9847040 con 0x560da9846650 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 --2- 172.21.15.123:0/3589453052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da9846a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc360005a40 tx=0x7fc360029bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b678597bd4971a34 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc248ff9640 1 -- 172.21.15.123:0/3589453052 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc360017d40 con 0x560da9846650 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc248ff9640 1 -- 172.21.15.123:0/3589453052 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360011cb0 con 0x560da9846650 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc248ff9640 1 -- 172.21.15.123:0/3589453052 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc36003a120 con 0x560da9846650 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3589453052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 msgr2=0x560da9846a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 --2- 172.21.15.123:0/3589453052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da9846a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc360005a40 tx=0x7fc360029bf0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3589453052 shutdown_connections 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 --2- 172.21.15.123:0/3589453052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da9846a70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3589453052 >> 172.21.15.123:0/3589453052 conn(0x560da9842990 msgr2=0x560da98409f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3589453052 shutdown_connections 2024-03-20T13:36:57.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3589453052 wait complete. 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 Processor -- start 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- start start 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da984d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da984da30 con 0x560da9846650 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da984d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da984d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53784/0 (socket says 172.21.15.123:53784) 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 learned_addr learned my addr 172.21.15.123:0/3277759114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da983add0 con 0x560da9846650 2024-03-20T13:36:57.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc365f1b640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da984d4f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc360029e60 tx=0x7fc3600498b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc23affd640 1 -- 172.21.15.123:0/3277759114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc360031070 con 0x560da9846650 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc23affd640 1 -- 172.21.15.123:0/3277759114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360011e20 con 0x560da9846650 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560da984dc30 con 0x560da9846650 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc23affd640 1 -- 172.21.15.123:0/3277759114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc360049da0 con 0x560da9846650 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.774+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560da984e060 con 0x560da9846650 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc23affd640 1 -- 172.21.15.123:0/3277759114 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc360048130 con 0x560da9846650 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc23affd640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc230034300 0x7fc2300367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc23affd640 1 -- 172.21.15.123:0/3277759114 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc360037c80 con 0x560da9846650 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc36571a640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc230034300 0x7fc2300367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da9858c70 0x560da985b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da985b880 con 0x560da9858c70 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc364f19640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da9858c70 0x560da985b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc36571a640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc230034300 0x7fc2300367c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3580cfff0 tx=0x7fc3580ea000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc364f19640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da9858c70 0x560da985b130 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 realm 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9858150 con 0x560da9858c70 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da985c300 con 0x560da9858c70 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da985ce70 0x560da985f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da985faa0 con 0x560da985ce70 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc365f1b640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da985ce70 0x560da985f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc365f1b640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da985ce70 0x560da985f330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da985ce70 2024-03-20T13:36:57.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.778+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da985ce70 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da985ce70 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc367bff980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc367bff980 20 searching for the correct realm 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560da98622a0 0x560da9864760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9864e30 con 0x560da98622a0 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc36571a640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560da98622a0 0x560da9864760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc36571a640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560da98622a0 0x560da9864760 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9864e30 con 0x560da985ce70 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da985ce70 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc365f1b640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc360055040 0x7fc36001f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x7fc360055040 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc360055040 0x7fc36001f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc360055040 0x7fc36001f800 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da9858c70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da9858c70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da98622a0 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da9858c70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.782+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da985ce70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da985ce70 2024-03-20T13:36:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da985ce70 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc36000a4d0 con 0x560da985ce70 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da9858c70 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x7fc360055040 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98602a0 con 0x560da9858c70 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x7fc360055040 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da985ce70 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da98622a0 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da9858c70 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da985ce70 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da98622a0 2024-03-20T13:36:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.786+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da98622a0 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x7fc360055040 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x7fc360055040 2024-03-20T13:36:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da98622a0 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x7fc360055040 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da985ce70 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da985ce70 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da98622a0 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.790+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da985ce70 2024-03-20T13:36:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc35c02d080 con 0x560da985ce70 2024-03-20T13:36:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:57.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98606c0 con 0x560da9858c70 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9860a70 con 0x560da985ce70 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9860a70 con 0x560da9858c70 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 zone default found 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 4 Realm: () 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 zonegroup default 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9865270 con 0x7fc360055040 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9866fb0 con 0x560da98622a0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98673b0 con 0x560da98622a0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 started sync module instance, tier type = 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.794+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9866890 con 0x560da985ce70 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94616678720496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9866c40 con 0x560da985ce70 2024-03-20T13:36:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9868110 con 0x560da9858c70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94616678726768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98685b0 con 0x560da9858c70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9869080 con 0x560da985ce70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94616678720496] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.798+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94616678726768] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94616678727824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9869040 con 0x560da985ce70 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98698d0 con 0x7fc360055040 2024-03-20T13:36:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94616678732848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9869040 con 0x7fc360055040 2024-03-20T13:36:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986a380 con 0x560da985ce70 2024-03-20T13:36:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94616678732848] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94616678727824] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.802+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94616678730592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986a340 con 0x560da985ce70 2024-03-20T13:36:57.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986a770 con 0x560da98622a0 2024-03-20T13:36:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94616678733904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986afc0 con 0x560da98622a0 2024-03-20T13:36:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986b970 con 0x560da98622a0 2024-03-20T13:36:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94616678733904] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94616678730592] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94616678735456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986ab20 con 0x560da98622a0 2024-03-20T13:36:57.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986c1f0 con 0x7fc360055040 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94616678743376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986ab20 con 0x7fc360055040 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=0 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=1 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=2 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=3 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=4 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=5 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94616678735456] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.806+0000 7fc367bff980 20 add_watcher() i=6 2024-03-20T13:36:57.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94616678743376] v32'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 20 add_watcher() i=7 2024-03-20T13:36:57.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986b490 con 0x560da9858c70 2024-03-20T13:36:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94616678744432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986b490 con 0x560da9858c70 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94616678744432] v32'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc21bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 5 note: GC not initialized 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc21afe5640 20 reqs_thread_entry: start 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 20 Filter name: none 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc218fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:57.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.810+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9891250 con 0x560da9858c70 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9891750 con 0x560da9858c70 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-03-20T13:36:57.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-03-20T13:36:57.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98970d0 con 0x560da9858c70 2024-03-20T13:36:57.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~513] v32'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94616678918992 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9892c00 con 0x560da985ce70 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94616678730592 notify 137438953479 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x560da984e060 con 0x560da985ce70 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc248ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94616678730592 notifier 4360 bl.length()=689 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc248ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc248ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc248ff9640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc228003ea0 con 0x560da985ce70 2024-03-20T13:36:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 notify.4 [notify cookie 94616678918992 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify_complete (2) cookie 94616678918992 notify 137438953479 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560da984dc30 con 0x560da985ce70 2024-03-20T13:36:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.814+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9896b50 con 0x560da9858c70 2024-03-20T13:36:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc367bff980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-03-20T13:36:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc367bff980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-03-20T13:36:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc367bff980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-03-20T13:36:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94616678918992 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9892c00 con 0x560da985ce70 2024-03-20T13:36:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify (1) cookie 94616678720496 notify 137438953480 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7fc36006c040 con 0x560da985ce70 2024-03-20T13:36:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc23bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94616678720496 notifier 4360 bl.length()=166 2024-03-20T13:36:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc23bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-03-20T13:36:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc23bfff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-03-20T13:36:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(68 notify.0 [notify cookie 94616678918992 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc23bfff640 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc18c003400 con 0x560da985ce70 2024-03-20T13:36:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== watch-notify(notify_complete (2) cookie 94616678918992 notify 137438953480 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560da984dc30 con 0x560da985ce70 2024-03-20T13:36:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.826 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"COii3K7A7QBcq7Dn6zIw3bBCIO9mm04oHvESv8el"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc21bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.818+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94616678744432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9890230 con 0x560da9858c70 2024-03-20T13:36:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.822+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94616678744432] v32'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.822+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94616678720496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da986c170 con 0x560da985ce70 2024-03-20T13:36:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.822+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94616678720496] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.822+0000 7fc367bff980 20 remove_watcher() i=0 2024-03-20T13:36:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.822+0000 7fc367bff980 2 removed watcher, disabling cache 2024-03-20T13:36:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.822+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94616678726768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98663f0 con 0x560da9858c70 2024-03-20T13:36:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.826+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94616678726768] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x560da9858c70 2024-03-20T13:36:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.826+0000 7fc367bff980 20 remove_watcher() i=1 2024-03-20T13:36:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.826+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94616678727824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da98663f0 con 0x560da985ce70 2024-03-20T13:36:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.826+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94616678727824] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.826+0000 7fc367bff980 20 remove_watcher() i=2 2024-03-20T13:36:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.826+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94616678732848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9868110 con 0x7fc360055040 2024-03-20T13:36:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94616678732848] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc367bff980 20 remove_watcher() i=3 2024-03-20T13:36:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94616678730592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9868110 con 0x560da985ce70 2024-03-20T13:36:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc365f1b640 1 -- 172.21.15.123:0/3277759114 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94616678730592] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc360063040 con 0x560da985ce70 2024-03-20T13:36:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc367bff980 20 remove_watcher() i=4 2024-03-20T13:36:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94616678733904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9868110 con 0x560da98622a0 2024-03-20T13:36:57.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94616678733904] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc367bff980 20 remove_watcher() i=5 2024-03-20T13:36:57.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.830+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94616678735456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9868110 con 0x560da98622a0 2024-03-20T13:36:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc36571a640 1 -- 172.21.15.123:0/3277759114 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94616678735456] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3580cd070 con 0x560da98622a0 2024-03-20T13:36:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 20 remove_watcher() i=6 2024-03-20T13:36:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94616678743376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560da9868110 con 0x7fc360055040 2024-03-20T13:36:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94616678743376] v32'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc35c00f6a0 con 0x7fc360055040 2024-03-20T13:36:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 20 remove_watcher() i=7 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da985ce70 msgr2=0x560da985f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da985ce70 0x560da985f330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da9858c70 msgr2=0x560da985b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da9858c70 0x560da985b130 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc360055040 msgr2=0x7fc36001f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc360055040 0x7fc36001f800 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560da98622a0 msgr2=0x560da9864760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560da98622a0 0x560da9864760 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc230034300 msgr2=0x7fc2300367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc230034300 0x7fc2300367c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3580cfff0 tx=0x7fc3580ea000 comp rx=0 tx=0).stop 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 msgr2=0x560da984d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da984d4f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc360029e60 tx=0x7fc3600498b0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc364f19640 1 -- 172.21.15.123:0/3277759114 reap_dead start 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 shutdown_connections 2024-03-20T13:36:57.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3277759114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da9846650 0x560da984d4f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 >> 172.21.15.123:0/3277759114 conn(0x560da9842990 msgr2=0x560da983fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 shutdown_connections 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3277759114 wait complete. 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc23c034300 msgr2=0x7fc23c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc23c034300 0x7fc23c0367c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x560da9829c30 tx=0x7fc3580e1040 comp rx=0 tx=0).stop 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 msgr2=0x560da9839af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 0x560da9839af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc360016cf0 tx=0x7fc36000d790 comp rx=0 tx=0).stop 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 shutdown_connections 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc23c034300 0x7fc23c0367c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/3464428191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da98396d0 0x560da9839af0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 >> 172.21.15.123:0/3464428191 conn(0x560da982e510 msgr2=0x560da982f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 shutdown_connections 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/3464428191 wait complete. 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da9826cd0 msgr2=0x560da98290c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da9826cd0 0x560da98290c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da972c870 msgr2=0x560da9825f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da972c870 0x560da9825f20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc24c034300 msgr2=0x7fc24c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc24c034300 0x7fc24c0367c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc35c001e50 tx=0x7fc35c0013b0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 msgr2=0x560da981f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da981f340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc358018f70 tx=0x7fc3580180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 shutdown_connections 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560da9826cd0 0x560da98290c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560da972c870 0x560da9825f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc24c034300 0x7fc24c0367c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 --2- 172.21.15.123:0/144385704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560da972bf50 0x560da981f340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 >> 172.21.15.123:0/144385704 conn(0x560da9727820 msgr2=0x560da96a0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 shutdown_connections 2024-03-20T13:36:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.834+0000 7fc367bff980 1 -- 172.21.15.123:0/144385704 wait complete. 2024-03-20T13:36:57.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'COii3K7A7QBcq7Dn6zIw3bBCIO9mm04oHvESv8el'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:57.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-03-20T13:36:57.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-03-20T13:36:57.851 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-03-20T13:36:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f2837ca6980 1 Processor -- start 2024-03-20T13:36:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f2837ca6980 1 -- start start 2024-03-20T13:36:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f2837ca6980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557c8fe8bf20 0x557c8fe8c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f2837ca6980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557c8fdd84c0 con 0x557c8fe8c840 2024-03-20T13:36:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f2837ca6980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557c8fd9f0f0 con 0x557c8fe8bf20 2024-03-20T13:36:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f28357c1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557c8fe8bf20 0x557c8fe8c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f28357c1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557c8fe8bf20 0x557c8fe8c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53786/0 (socket says 172.21.15.123:53786) 2024-03-20T13:36:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f28357c1640 1 -- 172.21.15.123:0/2126387944 learned_addr learned my addr 172.21.15.123:0/2126387944 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f2834fc0640 1 --1- 172.21.15.123:0/2126387944 >> v1:172.21.15.89:6789/0 conn(0x557c8fe8c840 0x557c8fe8d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59012/0 (socket says 172.21.15.123:59012) 2024-03-20T13:36:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f28357c1640 1 -- 172.21.15.123:0/2126387944 >> v1:172.21.15.89:6789/0 conn(0x557c8fe8c840 legacy=0x557c8fe8d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.926+0000 7f28357c1640 1 -- 172.21.15.123:0/2126387944 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8fe8d9e0 con 0x557c8fe8bf20 2024-03-20T13:36:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f28357c1640 1 --2- 172.21.15.123:0/2126387944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8fe8c300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f283000a4e0 tx=0x7f283001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1f17e28836829b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2827fff640 1 -- 172.21.15.123:0/2126387944 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28300aa540 con 0x557c8fe8bf20 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2827fff640 1 -- 172.21.15.123:0/2126387944 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300a6070 con 0x557c8fe8bf20 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2827fff640 1 -- 172.21.15.123:0/2126387944 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28300aa850 con 0x557c8fe8bf20 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 -- 172.21.15.123:0/2126387944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 msgr2=0x557c8fe8c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 --2- 172.21.15.123:0/2126387944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8fe8c300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f283000a4e0 tx=0x7f283001b090 comp rx=0 tx=0).stop 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 -- 172.21.15.123:0/2126387944 shutdown_connections 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 --2- 172.21.15.123:0/2126387944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8fe8c300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 -- 172.21.15.123:0/2126387944 >> 172.21.15.123:0/2126387944 conn(0x557c8fe877f0 msgr2=0x557c8fe89c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 -- 172.21.15.123:0/2126387944 shutdown_connections 2024-03-20T13:36:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.930+0000 7f2837ca6980 1 -- 172.21.15.123:0/2126387944 wait complete. 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.942+0000 7f2837ca6980 1 Processor -- start 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.942+0000 7f2837ca6980 1 -- start start 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.942+0000 7f2837ca6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff76390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.942+0000 7f2837ca6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8fd9c620 con 0x557c8fe8bf20 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff76390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff76390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53788/0 (socket says 172.21.15.123:53788) 2024-03-20T13:36:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 -- 172.21.15.123:0/437387534 learned_addr learned my addr 172.21.15.123:0/437387534 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 -- 172.21.15.123:0/437387534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283000a1c0 con 0x557c8fe8bf20 2024-03-20T13:36:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 --2- 172.21.15.123:0/437387534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff76390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2830017ca0 tx=0x7f28300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648b7f50727d3eb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2723606640 1 -- 172.21.15.123:0/437387534 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28300aa780 con 0x557c8fe8bf20 2024-03-20T13:36:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2723606640 1 -- 172.21.15.123:0/437387534 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300aa8e0 con 0x557c8fe8bf20 2024-03-20T13:36:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2723606640 1 -- 172.21.15.123:0/437387534 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28300aab80 con 0x557c8fe8bf20 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- 172.21.15.123:0/437387534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 msgr2=0x557c8ff76390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 --2- 172.21.15.123:0/437387534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff76390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2830017ca0 tx=0x7f28300033b0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- 172.21.15.123:0/437387534 shutdown_connections 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 --2- 172.21.15.123:0/437387534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff76390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- 172.21.15.123:0/437387534 >> 172.21.15.123:0/437387534 conn(0x557c8fe877f0 msgr2=0x557c8ff71f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- 172.21.15.123:0/437387534 shutdown_connections 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- 172.21.15.123:0/437387534 wait complete. 2024-03-20T13:36:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 Processor -- start 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- start start 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff7d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8fd97e00 con 0x557c8fe8bf20 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff7d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff7d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53802/0 (socket says 172.21.15.123:53802) 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 -- 172.21.15.123:0/1614291712 learned_addr learned my addr 172.21.15.123:0/1614291712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8fe8d9e0 con 0x557c8fe8bf20 2024-03-20T13:36:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f28357c1640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff7d140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f283001aec0 tx=0x7f2830017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2721e03640 1 -- 172.21.15.123:0/1614291712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28300c4070 con 0x557c8fe8bf20 2024-03-20T13:36:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2721e03640 1 -- 172.21.15.123:0/1614291712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300b5650 con 0x557c8fe8bf20 2024-03-20T13:36:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c8ff7d680 con 0x557c8fe8bf20 2024-03-20T13:36:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.946+0000 7f2721e03640 1 -- 172.21.15.123:0/1614291712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28300b5910 con 0x557c8fe8bf20 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c8ff7dab0 con 0x557c8fe8bf20 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2721e03640 1 -- 172.21.15.123:0/1614291712 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f28300a8070 con 0x557c8fe8bf20 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2721e03640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f271c034300 0x7f271c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2721e03640 1 -- 172.21.15.123:0/1614291712 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f28300e37d0 con 0x557c8fe8bf20 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2834fc0640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f271c034300 0x7f271c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8fe8c840 0x557c8ff83dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ff84300 con 0x557c8fe8c840 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2835fc2640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8fe8c840 0x557c8ff83dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2834fc0640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f271c034300 0x7f271c0367c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f282c001e50 tx=0x7f282c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2835fc2640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8fe8c840 0x557c8ff83dc0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2835fc2640 1 -- 172.21.15.123:0/1614291712 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f28280083f0 con 0x557c8fe8c840 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ff84b70 0x557c8ff86f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ff87660 con 0x557c8ff84b70 2024-03-20T13:36:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f28357c1640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ff84b70 0x557c8ff86f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.950+0000 7f28357c1640 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ff84b70 0x557c8ff86f60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f28357c1640 1 -- 172.21.15.123:0/1614291712 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f28300d09f0 con 0x557c8ff84b70 2024-03-20T13:36:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ff88e70 con 0x557c8ff84b70 2024-03-20T13:36:57.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f28357c1640 1 -- 172.21.15.123:0/1614291712 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f28300d09f0 con 0x557c8ff84b70 2024-03-20T13:36:57.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ff88070 con 0x557c8ff84b70 2024-03-20T13:36:57.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f28357c1640 1 -- 172.21.15.123:0/1614291712 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f28300d09f0 con 0x557c8ff84b70 2024-03-20T13:36:57.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ff88480 con 0x557c8fe8c840 2024-03-20T13:36:57.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2835fc2640 1 -- 172.21.15.123:0/1614291712 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f28280083f0 con 0x557c8fe8c840 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 Processor -- start 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 -- start start 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 0x557c8ff979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8fd30e30 con 0x557c8ff97590 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2835fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 0x557c8ff979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2835fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 0x557c8ff979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53814/0 (socket says 172.21.15.123:53814) 2024-03-20T13:36:57.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2835fc2640 1 -- 172.21.15.123:0/1254253451 learned_addr learned my addr 172.21.15.123:0/1254253451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2835fc2640 1 -- 172.21.15.123:0/1254253451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8ff97ef0 con 0x557c8ff97590 2024-03-20T13:36:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2835fc2640 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 0x557c8ff979b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f282800aae0 tx=0x7f2828008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f271affd640 1 -- 172.21.15.123:0/1254253451 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f282801d070 con 0x557c8ff97590 2024-03-20T13:36:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c8ff98140 con 0x557c8ff97590 2024-03-20T13:36:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f271affd640 1 -- 172.21.15.123:0/1254253451 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828010040 con 0x557c8ff97590 2024-03-20T13:36:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.954+0000 7f271affd640 1 -- 172.21.15.123:0/1254253451 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2828007e70 con 0x557c8ff97590 2024-03-20T13:36:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c8ff98c90 con 0x557c8ff97590 2024-03-20T13:36:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f271affd640 1 -- 172.21.15.123:0/1254253451 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2828018430 con 0x557c8ff97590 2024-03-20T13:36:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f271affd640 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f270c0342b0 0x7f270c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f271affd640 1 -- 172.21.15.123:0/1254253451 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f282804a700 con 0x557c8ff97590 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f28357c1640 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f270c0342b0 0x7f270c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 Processor -- start 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f28357c1640 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f270c0342b0 0x7f270c036770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x557c8ff87b70 tx=0x7f28300d8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- start start 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffa4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8fd24790 con 0x557c8ffa4530 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2835fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffa4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2835fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffa4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53818/0 (socket says 172.21.15.123:53818) 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2835fc2640 1 -- 172.21.15.123:0/3629830099 learned_addr learned my addr 172.21.15.123:0/3629830099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2835fc2640 1 -- 172.21.15.123:0/3629830099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8ffa4f20 con 0x557c8ffa4530 2024-03-20T13:36:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2835fc2640 1 --2- 172.21.15.123:0/3629830099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffa4950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2828048a30 tx=0x7f2828020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db6a1798b6d81fe server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2718ff9640 1 -- 172.21.15.123:0/3629830099 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2828047070 con 0x557c8ffa4530 2024-03-20T13:36:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2718ff9640 1 -- 172.21.15.123:0/3629830099 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828021790 con 0x557c8ffa4530 2024-03-20T13:36:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2718ff9640 1 -- 172.21.15.123:0/3629830099 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2828022410 con 0x557c8ffa4530 2024-03-20T13:36:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- 172.21.15.123:0/3629830099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 msgr2=0x557c8ffa4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3629830099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffa4950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2828048a30 tx=0x7f2828020f00 comp rx=0 tx=0).stop 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- 172.21.15.123:0/3629830099 shutdown_connections 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3629830099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffa4950 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- 172.21.15.123:0/3629830099 >> 172.21.15.123:0/3629830099 conn(0x557c8ffa0870 msgr2=0x557c8ff9e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- 172.21.15.123:0/3629830099 shutdown_connections 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.958+0000 7f2837ca6980 1 -- 172.21.15.123:0/3629830099 wait complete. 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 Processor -- start 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 -- start start 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8ffab8c0 con 0x557c8ffa4530 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2835fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2835fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53826/0 (socket says 172.21.15.123:53826) 2024-03-20T13:36:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 learned_addr learned my addr 172.21.15.123:0/3056474349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8ff98c90 con 0x557c8ffa4530 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2835fc2640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffab380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f28280077a0 tx=0x7f28280489c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f270affd640 1 -- 172.21.15.123:0/3056474349 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f282804a4e0 con 0x557c8ffa4530 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c8ffabac0 con 0x557c8ffa4530 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f270affd640 1 -- 172.21.15.123:0/3056474349 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828048c30 con 0x557c8ffa4530 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f270affd640 1 -- 172.21.15.123:0/3056474349 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f282803acc0 con 0x557c8ffa4530 2024-03-20T13:36:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c8ffabef0 con 0x557c8ffa4530 2024-03-20T13:36:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f270affd640 1 -- 172.21.15.123:0/3056474349 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f28280186e0 con 0x557c8ffa4530 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f270affd640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27000342b0 0x7f2700036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f270affd640 1 -- 172.21.15.123:0/3056474349 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2828048e40 con 0x557c8ffa4530 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f28357c1640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27000342b0 0x7f2700036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8ffb6ad0 0x557c8ffb8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffb96e0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2834fc0640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8ffb6ad0 0x557c8ffb8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f28357c1640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27000342b0 0x7f2700036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28300a3c80 tx=0x7f28300e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2834fc0640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8ffb6ad0 0x557c8ffb8f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 20 realm 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.962+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffb5f70 con 0x557c8ffb6ad0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffba160 con 0x557c8ffb6ad0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ffbacd0 0x557c8ffbd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffbd900 con 0x557c8ffbacd0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2835fc2640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ffbacd0 0x557c8ffbd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2835fc2640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ffbacd0 0x557c8ffbd190 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffbe100 con 0x557c8ffbacd0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 20 searching for the correct realm 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c8ffc0100 0x557c8ffc25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffc0100 2024-03-20T13:36:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f28357c1640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c8ffc0100 0x557c8ffc25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f28357c1640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c8ffc0100 0x557c8ffc25c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.966+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffbacd0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2828037b70 0x7f2828037460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x7f2828037b70 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2828037b70 0x7f2828037460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2828037b70 0x7f2828037460 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffb6ad0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffb6ad0 2024-03-20T13:36:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffc0100 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffb6ad0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffbacd0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffbacd0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffb6ad0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.970+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x7f2828037b70 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc2c90 con 0x557c8ffb6ad0 2024-03-20T13:36:57.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x7f2828037b70 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffbacd0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffc0100 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffb6ad0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffbacd0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffc0100 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffb6ad0 2024-03-20T13:36:57.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffc0100 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x7f2828037b70 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.974+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x7f2828037b70 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffc0100 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x7f2828037b70 2024-03-20T13:36:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffbacd0 2024-03-20T13:36:57.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffc0100 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f282c02d080 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.978+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffbf660 con 0x557c8ffb6ad0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffbe5e0 con 0x557c8ffbacd0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffbeef0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 zone default found 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 4 Realm: () 2024-03-20T13:36:57.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 zonegroup default 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc3570 con 0x7f2828037b70 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc5750 con 0x557c8ffc0100 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc5ab0 con 0x557c8ffc0100 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 started sync module instance, tier type = 2024-03-20T13:36:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc4d20 con 0x557c8ffbacd0 2024-03-20T13:36:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93993479983312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc4d20 con 0x557c8ffbacd0 2024-03-20T13:36:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.982+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc6420 con 0x557c8ffb6ad0 2024-03-20T13:36:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93993479987072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc6840 con 0x557c8ffb6ad0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc72e0 con 0x557c8ffbacd0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93993479987072] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93993479983312] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93993479990720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc63a0 con 0x557c8ffbacd0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.986+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc7b30 con 0x7f2828037b70 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93993479992976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc63a0 con 0x7f2828037b70 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc8640 con 0x557c8ffbacd0 2024-03-20T13:36:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93993479990720] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93993479992976] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93993479995680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc8600 con 0x557c8ffbacd0 2024-03-20T13:36:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc7c20 con 0x557c8ffc0100 2024-03-20T13:36:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93993479997936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc8600 con 0x557c8ffc0100 2024-03-20T13:36:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.990+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc98c0 con 0x557c8ffc0100 2024-03-20T13:36:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93993479995680] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93993479981184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc98c0 con 0x557c8ffc0100 2024-03-20T13:36:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffca280 con 0x7f2828037b70 2024-03-20T13:36:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93993479997936] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93993479981184] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93993480000544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc9840 con 0x7f2828037b70 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=0 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=1 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=2 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=3 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=4 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=5 2024-03-20T13:36:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=6 2024-03-20T13:36:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93993480000544] v32'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 20 add_watcher() i=7 2024-03-20T13:36:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffcd2b0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.994+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93993480003040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffca7f0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93993480003040] v32'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f26eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 5 note: GC not initialized 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f26ea7e4640 20 reqs_thread_entry: start 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 20 Filter name: none 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f265bfff640 20 reqs_thread_entry: start 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffef110 con 0x557c8ffb6ad0 2024-03-20T13:36:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:36:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:58.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8fff5180 con 0x557c8ffb6ad0 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v32'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:57.998+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93993480178688 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8fff0ac0 con 0x557c8ffbacd0 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 93993479995680 notify 137438953481 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x557c8ffabef0 con 0x557c8ffbacd0 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2718ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 93993479995680 notifier 4367 bl.length()=689 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2718ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2718ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2718ff9640 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f26f8003ea0 con 0x557c8ffbacd0 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 93993480178688 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 93993480178688 notify 137438953481 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557c8ffabac0 con 0x557c8ffbacd0 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f26eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.002+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93993480003040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8fff3870 con 0x557c8ffb6ad0 2024-03-20T13:36:58.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93993480003040] v32'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93993479983312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc9de0 con 0x557c8ffbacd0 2024-03-20T13:36:58.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93993479983312] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:58.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2837ca6980 20 remove_watcher() i=0 2024-03-20T13:36:58.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2837ca6980 2 removed watcher, disabling cache 2024-03-20T13:36:58.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93993479987072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc50d0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93993479987072] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x557c8ffb6ad0 2024-03-20T13:36:58.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2837ca6980 20 remove_watcher() i=1 2024-03-20T13:36:58.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.006+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93993479990720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc50d0 con 0x557c8ffbacd0 2024-03-20T13:36:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.010+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93993479990720] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.010+0000 7f2837ca6980 20 remove_watcher() i=2 2024-03-20T13:36:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.010+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93993479992976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc6dc0 con 0x7f2828037b70 2024-03-20T13:36:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.010+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93993479992976] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.010+0000 7f2837ca6980 20 remove_watcher() i=3 2024-03-20T13:36:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.010+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93993479995680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc7690 con 0x557c8ffbacd0 2024-03-20T13:36:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.014+0000 7f2835fc2640 1 -- 172.21.15.123:0/3056474349 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93993479995680] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2828033020 con 0x557c8ffbacd0 2024-03-20T13:36:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.014+0000 7f2837ca6980 20 remove_watcher() i=4 2024-03-20T13:36:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.014+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93993479997936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc6dc0 con 0x557c8ffc0100 2024-03-20T13:36:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93993479997936] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 20 remove_watcher() i=5 2024-03-20T13:36:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93993479981184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc7690 con 0x557c8ffc0100 2024-03-20T13:36:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f28357c1640 1 -- 172.21.15.123:0/3056474349 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93993479981184] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28300eb040 con 0x557c8ffc0100 2024-03-20T13:36:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 20 remove_watcher() i=6 2024-03-20T13:36:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93993480000544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557c8ffc89f0 con 0x7f2828037b70 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93993480000544] v32'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f282c00f6a0 con 0x7f2828037b70 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 20 remove_watcher() i=7 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ffbacd0 msgr2=0x557c8ffbd190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ffbacd0 0x557c8ffbd190 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8ffb6ad0 msgr2=0x557c8ffb8f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8ffb6ad0 0x557c8ffb8f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2828037b70 msgr2=0x7f2828037460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2828037b70 0x7f2828037460 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c8ffc0100 msgr2=0x557c8ffc25c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557c8ffc0100 0x557c8ffc25c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27000342b0 msgr2=0x7f2700036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27000342b0 0x7f2700036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28300a3c80 tx=0x7f28300e4000 comp rx=0 tx=0).stop 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 msgr2=0x557c8ffab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/3056474349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ffa4530 0x557c8ffab380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f28280077a0 tx=0x7f28280489c0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 reap_dead start 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2834fc0640 1 -- 172.21.15.123:0/3056474349 reap_dead start 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 shutdown_connections 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 >> 172.21.15.123:0/3056474349 conn(0x557c8ffa0870 msgr2=0x557c8ff9ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 shutdown_connections 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/3056474349 wait complete. 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f270c0342b0 msgr2=0x7f270c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f270c0342b0 0x7f270c036770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x557c8ff87b70 tx=0x7f28300d8040 comp rx=0 tx=0).stop 2024-03-20T13:36:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 msgr2=0x557c8ff979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 0x557c8ff979b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f282800aae0 tx=0x7f2828008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 shutdown_connections 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f270c0342b0 0x7f270c036770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1254253451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8ff97590 0x557c8ff979b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 >> 172.21.15.123:0/1254253451 conn(0x557c8ff8c3a0 msgr2=0x557c8ff8ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 shutdown_connections 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1254253451 wait complete. 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ff84b70 msgr2=0x557c8ff86f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ff84b70 0x557c8ff86f60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8fe8c840 msgr2=0x557c8ff83dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8fe8c840 0x557c8ff83dc0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f271c034300 msgr2=0x7f271c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f271c034300 0x7f271c0367c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f282c001e50 tx=0x7f282c0013b0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 msgr2=0x557c8ff7d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff7d140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f283001aec0 tx=0x7f2830017e30 comp rx=0 tx=0).stop 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 shutdown_connections 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557c8ff84b70 0x557c8ff86f60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557c8fe8c840 0x557c8ff83dc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f271c034300 0x7f271c0367c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 --2- 172.21.15.123:0/1614291712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c8fe8bf20 0x557c8ff7d140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 >> 172.21.15.123:0/1614291712 conn(0x557c8fe877f0 msgr2=0x557c8ff70a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 shutdown_connections 2024-03-20T13:36:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.018+0000 7f2837ca6980 1 -- 172.21.15.123:0/1614291712 wait complete. 2024-03-20T13:36:58.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:58.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:58.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:58.035 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.098+0000 7f4100ebf980 1 Processor -- start 2024-03-20T13:36:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.098+0000 7f4100ebf980 1 -- start start 2024-03-20T13:36:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f4100ebf980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562c3c405310 0x562c3c407700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f4100ebf980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562c3c34d520 con 0x562c3c3758f0 2024-03-20T13:36:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f4100ebf980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x562c3c3140f0 con 0x562c3c405310 2024-03-20T13:36:58.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fe9da640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x562c3c3758f0 0x562c3c403bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59018/0 (socket says 172.21.15.123:59018) 2024-03-20T13:36:58.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fe9da640 1 -- 172.21.15.123:0/1614081446 learned_addr learned my addr 172.21.15.123:0/1614081446 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:58.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fe1d9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562c3c405310 0x562c3c407700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fd9d8640 1 -- 172.21.15.123:0/1614081446 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176744155 0 0) 0x562c3c34d520 con 0x562c3c3758f0 2024-03-20T13:36:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fd9d8640 1 -- 172.21.15.123:0/1614081446 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e8001e20 con 0x562c3c3758f0 2024-03-20T13:36:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fe1d9640 1 -- 172.21.15.123:0/1614081446 >> v1:172.21.15.89:6789/0 conn(0x562c3c3758f0 legacy=0x562c3c403bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fe1d9640 1 -- 172.21.15.123:0/1614081446 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c3c408ce0 con 0x562c3c405310 2024-03-20T13:36:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/1614081446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c405310 0x562c3c407700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40f400a480 tx=0x7f40f401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5735b595b1739f6a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fd9d8640 1 -- 172.21.15.123:0/1614081446 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f40ab540 con 0x562c3c405310 2024-03-20T13:36:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fd9d8640 1 -- 172.21.15.123:0/1614081446 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f40ab6a0 con 0x562c3c405310 2024-03-20T13:36:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.102+0000 7f40fd9d8640 1 -- 172.21.15.123:0/1614081446 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f40ab940 con 0x562c3c405310 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 -- 172.21.15.123:0/1614081446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c405310 msgr2=0x562c3c407700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 --2- 172.21.15.123:0/1614081446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c405310 0x562c3c407700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40f400a480 tx=0x7f40f401b280 comp rx=0 tx=0).stop 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 -- 172.21.15.123:0/1614081446 shutdown_connections 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 --2- 172.21.15.123:0/1614081446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c405310 0x562c3c407700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 -- 172.21.15.123:0/1614081446 >> 172.21.15.123:0/1614081446 conn(0x562c3c3fb710 msgr2=0x562c3c3fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 -- 172.21.15.123:0/1614081446 shutdown_connections 2024-03-20T13:36:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.106+0000 7f4100ebf980 1 -- 172.21.15.123:0/1614081446 wait complete. 2024-03-20T13:36:58.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 Processor -- start 2024-03-20T13:36:58.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- start start 2024-03-20T13:36:58.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4eae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3c311620 con 0x562c3c3758f0 2024-03-20T13:36:58.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f40fe9da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f40fe9da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53854/0 (socket says 172.21.15.123:53854) 2024-03-20T13:36:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f40fe9da640 1 -- 172.21.15.123:0/1089564895 learned_addr learned my addr 172.21.15.123:0/1089564895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f40fe9da640 1 -- 172.21.15.123:0/1089564895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4005d30 con 0x562c3c3758f0 2024-03-20T13:36:58.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f40fe9da640 1 --2- 172.21.15.123:0/1089564895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4eae00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40f0001c30 tx=0x7f40f000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d363e86e3ad524c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f3fece09640 1 -- 172.21.15.123:0/1089564895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f000e690 con 0x562c3c3758f0 2024-03-20T13:36:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f3fece09640 1 -- 172.21.15.123:0/1089564895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f000e7f0 con 0x562c3c3758f0 2024-03-20T13:36:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f3fece09640 1 -- 172.21.15.123:0/1089564895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f000eb50 con 0x562c3c3758f0 2024-03-20T13:36:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- 172.21.15.123:0/1089564895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 msgr2=0x562c3c4eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 --2- 172.21.15.123:0/1089564895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4eae00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40f0001c30 tx=0x7f40f000b6d0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- 172.21.15.123:0/1089564895 shutdown_connections 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 --2- 172.21.15.123:0/1089564895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4eae00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- 172.21.15.123:0/1089564895 >> 172.21.15.123:0/1089564895 conn(0x562c3c3fb710 msgr2=0x562c3c4e68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- 172.21.15.123:0/1089564895 shutdown_connections 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- 172.21.15.123:0/1089564895 wait complete. 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 Processor -- start 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- start start 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.118+0000 7f4100ebf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3c30ce00 con 0x562c3c3758f0 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe9da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe9da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53860/0 (socket says 172.21.15.123:53860) 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe9da640 1 -- 172.21.15.123:0/4209922741 learned_addr learned my addr 172.21.15.123:0/4209922741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe9da640 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8001e20 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe9da640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4f1cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b710 tx=0x7f40f0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f3feb606640 1 -- 172.21.15.123:0/4209922741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f001f070 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c3c4f21f0 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f3feb606640 1 -- 172.21.15.123:0/4209922741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f001a2e0 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f3feb606640 1 -- 172.21.15.123:0/4209922741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f001a820 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c3c4f2620 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f3feb606640 1 -- 172.21.15.123:0/4209922741 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f40f000a040 con 0x562c3c3758f0 2024-03-20T13:36:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f3feb606640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fe40342b0 0x7f3fe4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f3feb606640 1 -- 172.21.15.123:0/4209922741 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f40f00498a0 con 0x562c3c3758f0 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fe40342b0 0x7f3fe4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c4f68d0 0x562c3c4f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c4f9200 con 0x562c3c4f68d0 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40ff1db640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c4f68d0 0x562c3c4f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fe40342b0 0x7f3fe4036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40f40ad000 tx=0x7f40f40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40ff1db640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c4f68d0 0x562c3c4f8cc0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40ff1db640 1 -- 172.21.15.123:0/4209922741 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40f800a4d0 con 0x562c3c4f68d0 2024-03-20T13:36:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c4f9a70 0x562c3c4fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c4fc560 con 0x562c3c4f9a70 2024-03-20T13:36:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.122+0000 7f40fe9da640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c4f9a70 0x562c3c4fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40fe9da640 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c4f9a70 0x562c3c4fbe60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40fe9da640 1 -- 172.21.15.123:0/4209922741 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c4f9a70 2024-03-20T13:36:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c4fdd70 con 0x562c3c4f9a70 2024-03-20T13:36:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40fe9da640 1 -- 172.21.15.123:0/4209922741 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c4f9a70 2024-03-20T13:36:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c4fcf70 con 0x562c3c4f9a70 2024-03-20T13:36:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40fe9da640 1 -- 172.21.15.123:0/4209922741 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c4f9a70 2024-03-20T13:36:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c4fd380 con 0x562c3c4f68d0 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40ff1db640 1 -- 172.21.15.123:0/4209922741 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f40f800a4d0 con 0x562c3c4f68d0 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 Processor -- start 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 -- start start 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 0x562c3c3ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f4100ebf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3c2a5e30 con 0x562c3c401730 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40ff1db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 0x562c3c3ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40ff1db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 0x562c3c3ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53868/0 (socket says 172.21.15.123:53868) 2024-03-20T13:36:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.126+0000 7f40ff1db640 1 -- 172.21.15.123:0/3855640658 learned_addr learned my addr 172.21.15.123:0/3855640658 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 -- 172.21.15.123:0/3855640658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c3c400110 con 0x562c3c401730 2024-03-20T13:36:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 0x562c3c3ffbd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40f8016cf0 tx=0x7f40f800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe8e01640 1 -- 172.21.15.123:0/3855640658 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f8017660 con 0x562c3c401730 2024-03-20T13:36:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c3c4003c0 con 0x562c3c401730 2024-03-20T13:36:58.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe8e01640 1 -- 172.21.15.123:0/3855640658 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f80177c0 con 0x562c3c401730 2024-03-20T13:36:58.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe8e01640 1 -- 172.21.15.123:0/3855640658 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f8017a60 con 0x562c3c401730 2024-03-20T13:36:58.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c3c400850 con 0x562c3c401730 2024-03-20T13:36:58.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe8e01640 1 -- 172.21.15.123:0/3855640658 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f40f801d020 con 0x562c3c401730 2024-03-20T13:36:58.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe8e01640 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fd80342b0 0x7f3fd8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe8e01640 1 -- 172.21.15.123:0/3855640658 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f40f804b340 con 0x562c3c401730 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40fe9da640 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fd80342b0 0x7f3fd8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f4100ebf980 1 Processor -- start 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f4100ebf980 1 -- start start 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40fe9da640 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fd80342b0 0x7f3fd8036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x562c3c4fca70 tx=0x7f40f00163b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f4100ebf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c51bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f4100ebf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3c299790 con 0x562c3c51b810 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c51bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c51bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53872/0 (socket says 172.21.15.123:53872) 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 -- 172.21.15.123:0/3412557789 learned_addr learned my addr 172.21.15.123:0/3412557789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 -- 172.21.15.123:0/3412557789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c3c51c200 con 0x562c3c51b810 2024-03-20T13:36:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f40ff1db640 1 --2- 172.21.15.123:0/3412557789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c51bc30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40f804b190 tx=0x7f40f8028f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82076cab62c33b59 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe27fc640 1 -- 172.21.15.123:0/3412557789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f8048070 con 0x562c3c51b810 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe27fc640 1 -- 172.21.15.123:0/3412557789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f803b470 con 0x562c3c51b810 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.130+0000 7f3fe27fc640 1 -- 172.21.15.123:0/3412557789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f8014570 con 0x562c3c51b810 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3412557789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 msgr2=0x562c3c51bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3412557789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c51bc30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40f804b190 tx=0x7f40f8028f20 comp rx=0 tx=0).stop 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3412557789 shutdown_connections 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3412557789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c51bc30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3412557789 >> 172.21.15.123:0/3412557789 conn(0x562c3c517b50 msgr2=0x562c3c515bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3412557789 shutdown_connections 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3412557789 wait complete. 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 Processor -- start 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- start start 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c522750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3c522c90 con 0x562c3c51b810 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f40ff1db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c522750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f40ff1db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c522750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53882/0 (socket says 172.21.15.123:53882) 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 learned_addr learned my addr 172.21.15.123:0/3482515476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c3c400850 con 0x562c3c51b810 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f40ff1db640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c522750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40f8028fd0 tx=0x7f40f80496c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f3fe0ff9640 1 -- 172.21.15.123:0/3482515476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f8030070 con 0x562c3c51b810 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f3fe0ff9640 1 -- 172.21.15.123:0/3482515476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f8012340 con 0x562c3c51b810 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c3c522e90 con 0x562c3c51b810 2024-03-20T13:36:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f3fe0ff9640 1 -- 172.21.15.123:0/3482515476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40f80499c0 con 0x562c3c51b810 2024-03-20T13:36:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c3c523320 con 0x562c3c51b810 2024-03-20T13:36:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f3fe0ff9640 1 -- 172.21.15.123:0/3482515476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f40f8049bb0 con 0x562c3c51b810 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f3fe0ff9640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fc80342b0 0x7f3fc8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f3fe0ff9640 1 -- 172.21.15.123:0/3482515476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f40f802c040 con 0x562c3c51b810 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f40fe9da640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fc80342b0 0x7f3fc8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c52dcb0 0x562c3c530150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.134+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5308a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c52dcb0 0x562c3c530150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe9da640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fc80342b0 0x7f3fc8036770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40f0049bd0 tx=0x7f40f0034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c52dcb0 0x562c3c530150 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 realm 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c530c90 con 0x562c3c52dcb0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5314e0 con 0x562c3c52dcb0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c531ec0 0x562c3c5342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c534a60 con 0x562c3c531ec0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40ff1db640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c531ec0 0x562c3c5342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40ff1db640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c531ec0 0x562c3c5342f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5352b0 con 0x562c3c531ec0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 20 searching for the correct realm 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562c3c536fd0 0x562c3c5393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe9da640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562c3c536fd0 0x562c3c5393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe9da640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562c3c536fd0 0x562c3c5393c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.138+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f40f801fc20 0x7f40f800b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x7f40f801fc20 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f40f801fc20 0x7f40f800b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f40f801fc20 0x7f40f800b9f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x7f40f801fc20 2024-03-20T13:36:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.142+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x7f40f801fc20 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x7f40f801fc20 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x7f40f801fc20 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f40f40be040 con 0x7f40f801fc20 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40be040 con 0x562c3c52dcb0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x7f40f801fc20 2024-03-20T13:36:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.146+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c52dcb0 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x7f40f801fc20 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x7f40f801fc20 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c536fd0 2024-03-20T13:36:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5399a0 con 0x562c3c531ec0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.150+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c535bb0 con 0x562c3c52dcb0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c535f60 con 0x562c3c531ec0 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c535f60 con 0x562c3c52dcb0 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 zone default found 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 4 Realm: () 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 zonegroup default 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c539e10 con 0x7f40f801fc20 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53bff0 con 0x562c3c536fd0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53c350 con 0x562c3c536fd0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 started sync module instance, tier type = 2024-03-20T13:36:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.154+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53b5c0 con 0x562c3c531ec0 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747990669680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53b5c0 con 0x562c3c531ec0 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53ccc0 con 0x562c3c52dcb0 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747990673440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53d510 con 0x562c3c52dcb0 2024-03-20T13:36:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53df10 con 0x562c3c531ec0 2024-03-20T13:36:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747990673440] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747990669680] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747990678032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53d070 con 0x562c3c531ec0 2024-03-20T13:36:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.158+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53e760 con 0x7f40f801fc20 2024-03-20T13:36:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747990680256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53d070 con 0x7f40f801fc20 2024-03-20T13:36:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53f230 con 0x562c3c531ec0 2024-03-20T13:36:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747990678032] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747990680256] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747990681312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53f230 con 0x562c3c531ec0 2024-03-20T13:36:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.162+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53f5e0 con 0x562c3c536fd0 2024-03-20T13:36:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747990682912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53fe30 con 0x562c3c536fd0 2024-03-20T13:36:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c540800 con 0x562c3c536fd0 2024-03-20T13:36:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747990682912] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747990688512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c540bb0 con 0x562c3c536fd0 2024-03-20T13:36:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5415c0 con 0x7f40f801fc20 2024-03-20T13:36:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747990681312] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747990667552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c541580 con 0x7f40f801fc20 2024-03-20T13:36:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=0 2024-03-20T13:36:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=1 2024-03-20T13:36:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=2 2024-03-20T13:36:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=3 2024-03-20T13:36:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=4 2024-03-20T13:36:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=5 2024-03-20T13:36:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747990688512] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=6 2024-03-20T13:36:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747990667552] v32'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 20 add_watcher() i=7 2024-03-20T13:36:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.166+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53f990 con 0x562c3c52dcb0 2024-03-20T13:36:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747990692064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53f990 con 0x562c3c52dcb0 2024-03-20T13:36:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747990692064] v32'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f3fb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 5 note: GC not initialized 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f3f2ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 20 Filter name: none 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f3f2dffb640 20 reqs_thread_entry: start 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c566070 con 0x562c3c52dcb0 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.170+0000 7f4100ebf980 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:36:58.179 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.174+0000 7f3fb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.174+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747990692064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5650f0 con 0x562c3c52dcb0 2024-03-20T13:36:58.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.174+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94747990692064] v32'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.174+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747990669680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5410e0 con 0x562c3c531ec0 2024-03-20T13:36:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94747990669680] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f4100ebf980 20 remove_watcher() i=0 2024-03-20T13:36:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f4100ebf980 2 removed watcher, disabling cache 2024-03-20T13:36:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747990673440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5410e0 con 0x562c3c52dcb0 2024-03-20T13:36:58.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94747990673440] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x562c3c52dcb0 2024-03-20T13:36:58.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f4100ebf980 20 remove_watcher() i=1 2024-03-20T13:36:58.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.178+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747990678032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5410e0 con 0x562c3c531ec0 2024-03-20T13:36:58.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94747990678032] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f4100ebf980 20 remove_watcher() i=2 2024-03-20T13:36:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747990680256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53da10 con 0x7f40f801fc20 2024-03-20T13:36:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94747990680256] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f4100ebf980 20 remove_watcher() i=3 2024-03-20T13:36:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747990681312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c5410e0 con 0x562c3c531ec0 2024-03-20T13:36:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f40ff1db640 1 -- 172.21.15.123:0/3482515476 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94747990681312] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f8041020 con 0x562c3c531ec0 2024-03-20T13:36:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f4100ebf980 20 remove_watcher() i=4 2024-03-20T13:36:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.182+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747990682912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53e760 con 0x562c3c536fd0 2024-03-20T13:36:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94747990682912] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 20 remove_watcher() i=5 2024-03-20T13:36:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747990688512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53e760 con 0x562c3c536fd0 2024-03-20T13:36:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f40fe9da640 1 -- 172.21.15.123:0/3482515476 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94747990688512] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f0014070 con 0x562c3c536fd0 2024-03-20T13:36:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 20 remove_watcher() i=6 2024-03-20T13:36:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747990667552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562c3c53e760 con 0x7f40f801fc20 2024-03-20T13:36:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94747990667552] v32'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40f40d7060 con 0x7f40f801fc20 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 20 remove_watcher() i=7 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c531ec0 msgr2=0x562c3c5342f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c531ec0 0x562c3c5342f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c52dcb0 msgr2=0x562c3c530150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c52dcb0 0x562c3c530150 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f40f801fc20 msgr2=0x7f40f800b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f40f801fc20 0x7f40f800b9f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562c3c536fd0 msgr2=0x562c3c5393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562c3c536fd0 0x562c3c5393c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fc80342b0 msgr2=0x7f3fc8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fc80342b0 0x7f3fc8036770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40f0049bd0 tx=0x7f40f0034000 comp rx=0 tx=0).stop 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 msgr2=0x562c3c522750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3482515476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c51b810 0x562c3c522750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40f8028fd0 tx=0x7f40f80496c0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 reap_dead start 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f40fe1d9640 1 -- 172.21.15.123:0/3482515476 reap_dead start 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 shutdown_connections 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 >> 172.21.15.123:0/3482515476 conn(0x562c3c517b50 msgr2=0x562c3c5151b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 shutdown_connections 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3482515476 wait complete. 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fd80342b0 msgr2=0x7f3fd8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fd80342b0 0x7f3fd8036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x562c3c4fca70 tx=0x7f40f00163b0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 msgr2=0x562c3c3ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 0x562c3c3ffbd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40f8016cf0 tx=0x7f40f800d790 comp rx=0 tx=0).stop 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 shutdown_connections 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fd80342b0 0x7f3fd8036770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/3855640658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c401730 0x562c3c3ffbd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 >> 172.21.15.123:0/3855640658 conn(0x562c3c5012c0 msgr2=0x562c3c501dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 shutdown_connections 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/3855640658 wait complete. 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c4f9a70 msgr2=0x562c3c4fbe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c4f9a70 0x562c3c4fbe60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c4f68d0 msgr2=0x562c3c4f8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c4f68d0 0x562c3c4f8cc0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fe40342b0 msgr2=0x7f3fe4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fe40342b0 0x7f3fe4036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40f40ad000 tx=0x7f40f40a5040 comp rx=0 tx=0).stop 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 msgr2=0x562c3c4f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4f1cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b710 tx=0x7f40f0000bd0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 shutdown_connections 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562c3c4f9a70 0x562c3c4fbe60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562c3c4f68d0 0x562c3c4f8cc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3fe40342b0 0x7f3fe4036770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 --2- 172.21.15.123:0/4209922741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c3c3758f0 0x562c3c4f1cb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 >> 172.21.15.123:0/4209922741 conn(0x562c3c3fb710 msgr2=0x562c3c4e5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 shutdown_connections 2024-03-20T13:36:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.186+0000 7f4100ebf980 1 -- 172.21.15.123:0/4209922741 wait complete. 2024-03-20T13:36:58.203 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:58.203 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:58.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:58.203 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:58.273 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:58.273 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:58.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.266+0000 7fa93ef07980 1 Processor -- start 2024-03-20T13:36:58.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.266+0000 7fa93ef07980 1 -- start start 2024-03-20T13:36:58.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ef07980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f4630938b0 0x55f463124030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ef07980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f46306b520 con 0x55f463124570 2024-03-20T13:36:58.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ef07980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f4630320f0 con 0x55f4630938b0 2024-03-20T13:36:58.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ca22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f4630938b0 0x55f463124030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ca22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f4630938b0 0x55f463124030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53892/0 (socket says 172.21.15.123:53892) 2024-03-20T13:36:58.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ca22640 1 -- 172.21.15.123:0/536405859 learned_addr learned my addr 172.21.15.123:0/536405859 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93c221640 1 --1- 172.21.15.123:0/536405859 >> v1:172.21.15.89:6789/0 conn(0x55f463124570 0x55f463126960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59030/0 (socket says 172.21.15.123:59030) 2024-03-20T13:36:58.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ca22640 1 -- 172.21.15.123:0/536405859 >> v1:172.21.15.89:6789/0 conn(0x55f463124570 legacy=0x55f463126960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ca22640 1 -- 172.21.15.123:0/536405859 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46311fa50 con 0x55f4630938b0 2024-03-20T13:36:58.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ca22640 1 --2- 172.21.15.123:0/536405859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463124030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa93000a5c0 tx=0x7fa93001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e4488ee72098f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ba20640 1 -- 172.21.15.123:0/536405859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300aa470 con 0x55f4630938b0 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ba20640 1 -- 172.21.15.123:0/536405859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300aa5d0 con 0x55f4630938b0 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.270+0000 7fa93ba20640 1 -- 172.21.15.123:0/536405859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300aa890 con 0x55f4630938b0 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 -- 172.21.15.123:0/536405859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 msgr2=0x55f463124030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 --2- 172.21.15.123:0/536405859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463124030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa93000a5c0 tx=0x7fa93001b340 comp rx=0 tx=0).stop 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 -- 172.21.15.123:0/536405859 shutdown_connections 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 --2- 172.21.15.123:0/536405859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463124030 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 -- 172.21.15.123:0/536405859 >> 172.21.15.123:0/536405859 conn(0x55f463119710 msgr2=0x55f46311bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 -- 172.21.15.123:0/536405859 shutdown_connections 2024-03-20T13:36:58.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.274+0000 7fa93ef07980 1 -- 172.21.15.123:0/536405859 wait complete. 2024-03-20T13:36:58.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 Processor -- start 2024-03-20T13:36:58.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- start start 2024-03-20T13:36:58.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f46320b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46302f620 con 0x55f4630938b0 2024-03-20T13:36:58.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ca22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f46320b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ca22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f46320b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53896/0 (socket says 172.21.15.123:53896) 2024-03-20T13:36:58.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ca22640 1 -- 172.21.15.123:0/2358719444 learned_addr learned my addr 172.21.15.123:0/2358719444 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ca22640 1 -- 172.21.15.123:0/2358719444 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930005df0 con 0x55f4630938b0 2024-03-20T13:36:58.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ca22640 1 --2- 172.21.15.123:0/2358719444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f46320b0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa930018f70 tx=0x7fa930003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f67137c12c6226b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa82ae0d640 1 -- 172.21.15.123:0/2358719444 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300aa9c0 con 0x55f4630938b0 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa82ae0d640 1 -- 172.21.15.123:0/2358719444 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300aab20 con 0x55f4630938b0 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa82ae0d640 1 -- 172.21.15.123:0/2358719444 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300aadc0 con 0x55f4630938b0 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- 172.21.15.123:0/2358719444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 msgr2=0x55f46320b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 --2- 172.21.15.123:0/2358719444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f46320b0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa930018f70 tx=0x7fa930003030 comp rx=0 tx=0).stop 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- 172.21.15.123:0/2358719444 shutdown_connections 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 --2- 172.21.15.123:0/2358719444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f46320b0c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- 172.21.15.123:0/2358719444 >> 172.21.15.123:0/2358719444 conn(0x55f463119710 msgr2=0x55f463206c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- 172.21.15.123:0/2358719444 shutdown_connections 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- 172.21.15.123:0/2358719444 wait complete. 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 Processor -- start 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- start start 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463211e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.286+0000 7fa93ef07980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46302ae00 con 0x55f4630938b0 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ca22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463211e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ca22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463211e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53906/0 (socket says 172.21.15.123:53906) 2024-03-20T13:36:58.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ca22640 1 -- 172.21.15.123:0/4118181513 learned_addr learned my addr 172.21.15.123:0/4118181513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ca22640 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46311fa50 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ca22640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463211e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa930018f70 tx=0x7fa9300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa82960a640 1 -- 172.21.15.123:0/4118181513 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300cb070 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f463212350 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa82960a640 1 -- 172.21.15.123:0/4118181513 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300bd810 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa82960a640 1 -- 172.21.15.123:0/4118181513 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300bdab0 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f463212720 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa82960a640 1 -- 172.21.15.123:0/4118181513 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa9300bdc10 con 0x55f4630938b0 2024-03-20T13:36:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa82960a640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8240342b0 0x7fa824036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa82960a640 1 -- 172.21.15.123:0/4118181513 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa9300e4a00 con 0x55f4630938b0 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93c221640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8240342b0 0x7fa824036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f463124570 0x55f463218a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463218f80 con 0x55f463124570 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93d223640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f463124570 0x55f463218a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93c221640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8240342b0 0x7fa824036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000f70 tx=0x7fa92c001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93d223640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f463124570 0x55f463218a40 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93d223640 1 -- 172.21.15.123:0/4118181513 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f463124570 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f4632197f0 0x55f46321bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46321c290 con 0x55f4632197f0 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.290+0000 7fa93ca22640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f4632197f0 0x55f46321bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ca22640 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f4632197f0 0x55f46321bbe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ca22640 1 -- 172.21.15.123:0/4118181513 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa9300cd070 con 0x55f4632197f0 2024-03-20T13:36:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46321dad0 con 0x55f4632197f0 2024-03-20T13:36:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ca22640 1 -- 172.21.15.123:0/4118181513 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa9300cd070 con 0x55f4632197f0 2024-03-20T13:36:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46321ccd0 con 0x55f4632197f0 2024-03-20T13:36:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ca22640 1 -- 172.21.15.123:0/4118181513 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa9300cd070 con 0x55f4632197f0 2024-03-20T13:36:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46321d0e0 con 0x55f463124570 2024-03-20T13:36:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93d223640 1 -- 172.21.15.123:0/4118181513 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f463124570 2024-03-20T13:36:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 Processor -- start 2024-03-20T13:36:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 -- start start 2024-03-20T13:36:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 0x55f46322c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93ef07980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f462fc3e30 con 0x55f46322c1b0 2024-03-20T13:36:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.294+0000 7fa93d223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 0x55f46322c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa93d223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 0x55f46322c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53908/0 (socket says 172.21.15.123:53908) 2024-03-20T13:36:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa93d223640 1 -- 172.21.15.123:0/1977253814 learned_addr learned my addr 172.21.15.123:0/1977253814 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa93d223640 1 -- 172.21.15.123:0/1977253814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46322cb10 con 0x55f46322c1b0 2024-03-20T13:36:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa93d223640 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 0x55f46322c5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa934016cf0 tx=0x7fa93400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa8227fc640 1 -- 172.21.15.123:0/1977253814 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa934017660 con 0x55f46322c1b0 2024-03-20T13:36:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa8227fc640 1 -- 172.21.15.123:0/1977253814 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340177c0 con 0x55f46322c1b0 2024-03-20T13:36:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f46322cd60 con 0x55f46322c1b0 2024-03-20T13:36:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa8227fc640 1 -- 172.21.15.123:0/1977253814 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa934017a60 con 0x55f46322c1b0 2024-03-20T13:36:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.298+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f46322d8b0 con 0x55f46322c1b0 2024-03-20T13:36:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa8227fc640 1 -- 172.21.15.123:0/1977253814 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa93401d020 con 0x55f46322c1b0 2024-03-20T13:36:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa8227fc640 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8140342b0 0x7fa814036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa8227fc640 1 -- 172.21.15.123:0/1977253814 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa93404b270 con 0x55f46322c1b0 2024-03-20T13:36:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ca22640 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8140342b0 0x7fa814036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 Processor -- start 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- start start 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f463239530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ca22640 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8140342b0 0x7fa814036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55f46321c7d0 tx=0x7fa9300e1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f462fb7790 con 0x55f463239130 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93d223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f463239530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93d223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f463239530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53922/0 (socket says 172.21.15.123:53922) 2024-03-20T13:36:58.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93d223640 1 -- 172.21.15.123:0/3626485194 learned_addr learned my addr 172.21.15.123:0/3626485194 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93d223640 1 -- 172.21.15.123:0/3626485194 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f463239b00 con 0x55f463239130 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93d223640 1 --2- 172.21.15.123:0/3626485194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f463239530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa9340495a0 tx=0x7fa934049850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1012acf533e7aff5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa813fff640 1 -- 172.21.15.123:0/3626485194 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93403b070 con 0x55f463239130 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa813fff640 1 -- 172.21.15.123:0/3626485194 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340481d0 con 0x55f463239130 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa813fff640 1 -- 172.21.15.123:0/3626485194 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93403b300 con 0x55f463239130 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- 172.21.15.123:0/3626485194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 msgr2=0x55f463239530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 --2- 172.21.15.123:0/3626485194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f463239530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa9340495a0 tx=0x7fa934049850 comp rx=0 tx=0).stop 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- 172.21.15.123:0/3626485194 shutdown_connections 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 --2- 172.21.15.123:0/3626485194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f463239530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- 172.21.15.123:0/3626485194 >> 172.21.15.123:0/3626485194 conn(0x55f463235470 msgr2=0x55f4632334d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- 172.21.15.123:0/3626485194 shutdown_connections 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.302+0000 7fa93ef07980 1 -- 172.21.15.123:0/3626485194 wait complete. 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 Processor -- start 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 -- start start 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f46323ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f463240510 con 0x55f463239130 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93d223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f46323ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93d223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f46323ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53938/0 (socket says 172.21.15.123:53938) 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 learned_addr learned my addr 172.21.15.123:0/244400275 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46322d8b0 con 0x55f463239130 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93d223640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f46323ffd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa934016ff0 tx=0x7fa934049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa8127fc640 1 -- 172.21.15.123:0/244400275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa934028e60 con 0x55f463239130 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f463240710 con 0x55f463239130 2024-03-20T13:36:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa8127fc640 1 -- 172.21.15.123:0/244400275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340499b0 con 0x55f463239130 2024-03-20T13:36:58.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f463240ba0 con 0x55f463239130 2024-03-20T13:36:58.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa8127fc640 1 -- 172.21.15.123:0/244400275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa934049c50 con 0x55f463239130 2024-03-20T13:36:58.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa8127fc640 1 -- 172.21.15.123:0/244400275 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa93401f8b0 con 0x55f463239130 2024-03-20T13:36:58.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa8127fc640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8080342b0 0x7fa808036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa8127fc640 1 -- 172.21.15.123:0/244400275 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa93404cdb0 con 0x55f463239130 2024-03-20T13:36:58.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ca22640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8080342b0 0x7fa808036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f46324b6b0 0x55f46324db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46324e290 con 0x55f46324b6b0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93c221640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f46324b6b0 0x55f46324db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ca22640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8080342b0 0x7fa808036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9300b37e0 tx=0x7fa9300ea000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93c221640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f46324b6b0 0x55f46324db40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 20 realm 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.306+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46324ac20 con 0x55f46324b6b0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46324ed10 con 0x55f46324b6b0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f46324f880 0x55f463251d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632524b0 con 0x55f46324f880 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93d223640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f46324f880 0x55f463251d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93d223640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f46324f880 0x55f463251d40 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463252d00 con 0x55f46324f880 2024-03-20T13:36:58.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 20 searching for the correct realm 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f463254a20 0x55f463256e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f463254a20 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ca22640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f463254a20 0x55f463256e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ca22640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f463254a20 0x55f463256e10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.310+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324f880 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa934033070 0x7fa934038540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x7fa934033070 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa934033070 0x7fa934038540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa934033070 0x7fa934038540 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324b6b0 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324b6b0 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f463254a20 2024-03-20T13:36:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324b6b0 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324f880 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324f880 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324b6b0 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x7fa934033070 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632573a0 con 0x55f46324b6b0 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x7fa934033070 2024-03-20T13:36:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.314+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324f880 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f463254a20 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324b6b0 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324f880 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f463254a20 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324b6b0 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324b6b0 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324b6b0 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f463254a20 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x7fa934033070 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324b6b0 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x7fa934033070 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f463254a20 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x7fa934033070 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.318+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324f880 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324f880 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f463254a20 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324f880 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa92c02d080 con 0x55f46324f880 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463253630 con 0x55f46324b6b0 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463253a40 con 0x55f46324f880 2024-03-20T13:36:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463253a40 con 0x55f46324b6b0 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 zone default found 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 4 Realm: () 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 zonegroup default 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632577e0 con 0x7fa934033070 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.322+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f4632599c0 con 0x55f463254a20 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463259d20 con 0x55f463254a20 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 20 started sync module instance, tier type = 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463258f90 con 0x55f46324f880 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94508123788096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463258f90 con 0x55f46324f880 2024-03-20T13:36:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325a6d0 con 0x55f46324b6b0 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94508123791856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325a610 con 0x55f46324b6b0 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.326+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325b590 con 0x55f46324f880 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94508123788096] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94508123791856] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94508123794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325b550 con 0x55f46324f880 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325be10 con 0x7fa934033070 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94508123797872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325b550 con 0x7fa934033070 2024-03-20T13:36:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.330+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325c8c0 con 0x55f46324f880 2024-03-20T13:36:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.334+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94508123797872] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.334+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94508123794048] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.334+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.334+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94508123795600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325c880 con 0x55f46324f880 2024-03-20T13:36:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.334+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325d110 con 0x55f463254a20 2024-03-20T13:36:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94508123802736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325c880 con 0x55f463254a20 2024-03-20T13:36:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325df20 con 0x55f463254a20 2024-03-20T13:36:58.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94508123795600] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94508123802736] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94508123804784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325da80 con 0x55f463254a20 2024-03-20T13:36:58.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325e430 con 0x7fa934033070 2024-03-20T13:36:58.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94508123804784] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94508123800480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325e3f0 con 0x7fa934033070 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=0 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=1 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=2 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=3 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=4 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=5 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=6 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94508123800480] v32'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 20 add_watcher() i=7 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.338+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463261930 con 0x55f46324b6b0 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94508123808032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325ee10 con 0x55f46324b6b0 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94508123808032] v32'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa7f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 5 note: GC not initialized 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa7f1fe3640 20 reqs_thread_entry: start 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 20 Filter name: none 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa7637fe640 20 reqs_thread_entry: start 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463283370 con 0x55f46324b6b0 2024-03-20T13:36:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:36:58.350 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa7f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.342+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94508123808032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463282450 con 0x55f46324b6b0 2024-03-20T13:36:58.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.346+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94508123808032] v32'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.346+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94508123788096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325e0f0 con 0x55f46324f880 2024-03-20T13:36:58.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94508123788096] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 20 remove_watcher() i=0 2024-03-20T13:36:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 2 removed watcher, disabling cache 2024-03-20T13:36:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94508123791856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463259340 con 0x55f46324b6b0 2024-03-20T13:36:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94508123791856] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x55f46324b6b0 2024-03-20T13:36:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 20 remove_watcher() i=1 2024-03-20T13:36:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94508123794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463259340 con 0x55f46324f880 2024-03-20T13:36:58.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94508123794048] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 20 remove_watcher() i=2 2024-03-20T13:36:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.350+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94508123797872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325aa80 con 0x7fa934033070 2024-03-20T13:36:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94508123797872] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ef07980 20 remove_watcher() i=3 2024-03-20T13:36:58.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94508123795600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463259340 con 0x55f46324f880 2024-03-20T13:36:58.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93d223640 1 -- 172.21.15.123:0/244400275 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94508123795600] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93400a4d0 con 0x55f46324f880 2024-03-20T13:36:58.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ef07980 20 remove_watcher() i=4 2024-03-20T13:36:58.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94508123802736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463259340 con 0x55f463254a20 2024-03-20T13:36:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94508123802736] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ef07980 20 remove_watcher() i=5 2024-03-20T13:36:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.354+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94508123804784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f463259340 con 0x55f463254a20 2024-03-20T13:36:58.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ca22640 1 -- 172.21.15.123:0/244400275 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94508123804784] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9300cd070 con 0x55f463254a20 2024-03-20T13:36:58.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 20 remove_watcher() i=6 2024-03-20T13:36:58.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94508123800480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f46325d470 con 0x7fa934033070 2024-03-20T13:36:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94508123800480] v32'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa92c00f620 con 0x7fa934033070 2024-03-20T13:36:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 20 remove_watcher() i=7 2024-03-20T13:36:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f46324f880 msgr2=0x55f463251d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f46324f880 0x55f463251d40 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f46324b6b0 msgr2=0x55f46324db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f46324b6b0 0x55f46324db40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa934033070 msgr2=0x7fa934038540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa934033070 0x7fa934038540 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f463254a20 msgr2=0x55f463256e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f463254a20 0x55f463256e10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8080342b0 msgr2=0x7fa808036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8080342b0 0x7fa808036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9300b37e0 tx=0x7fa9300ea000 comp rx=0 tx=0).stop 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 msgr2=0x55f46323ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/244400275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f463239130 0x55f46323ffd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa934016ff0 tx=0x7fa934049530 comp rx=0 tx=0).stop 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 reap_dead start 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93c221640 1 -- 172.21.15.123:0/244400275 reap_dead start 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 shutdown_connections 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 >> 172.21.15.123:0/244400275 conn(0x55f463235470 msgr2=0x55f4632334a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 shutdown_connections 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/244400275 wait complete. 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8140342b0 msgr2=0x7fa814036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8140342b0 0x7fa814036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55f46321c7d0 tx=0x7fa9300e1040 comp rx=0 tx=0).stop 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 msgr2=0x55f46322c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 0x55f46322c5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa934016cf0 tx=0x7fa93400d790 comp rx=0 tx=0).stop 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 shutdown_connections 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8140342b0 0x7fa814036770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/1977253814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46322c1b0 0x55f46322c5d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 >> 172.21.15.123:0/1977253814 conn(0x55f463220fc0 msgr2=0x55f463221ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 shutdown_connections 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/1977253814 wait complete. 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f4632197f0 msgr2=0x55f46321bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f4632197f0 0x55f46321bbe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f463124570 msgr2=0x55f463218a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f463124570 0x55f463218a40 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8240342b0 msgr2=0x7fa824036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8240342b0 0x7fa824036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000f70 tx=0x7fa92c001380 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 msgr2=0x55f463211e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463211e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa930018f70 tx=0x7fa9300180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 shutdown_connections 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f4632197f0 0x55f46321bbe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f463124570 0x55f463218a40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa8240342b0 0x7fa824036770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 --2- 172.21.15.123:0/4118181513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4630938b0 0x55f463211e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 >> 172.21.15.123:0/4118181513 conn(0x55f463119710 msgr2=0x55f463205760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 shutdown_connections 2024-03-20T13:36:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.358+0000 7fa93ef07980 1 -- 172.21.15.123:0/4118181513 wait complete. 2024-03-20T13:36:58.373 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:58.374 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-03-20T13:36:58.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-03-20T13:36:58.374 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-03-20T13:36:58.451 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:58.451 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:58.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe140d37980 1 Processor -- start 2024-03-20T13:36:58.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe140d37980 1 -- start start 2024-03-20T13:36:58.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe140d37980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5653c201cee0 0x5653c201d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe140d37980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5653c1f694c0 con 0x5653c201d800 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe140d37980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5653c1f300f0 con 0x5653c201cee0 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe13e852640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5653c201cee0 0x5653c201d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe13e852640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5653c201cee0 0x5653c201d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53954/0 (socket says 172.21.15.123:53954) 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe13e051640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5653c201d800 0x5653c201e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59034/0 (socket says 172.21.15.123:59034) 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe13e852640 1 -- 172.21.15.123:0/1311390637 learned_addr learned my addr 172.21.15.123:0/1311390637 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe13e852640 1 -- 172.21.15.123:0/1311390637 >> v1:172.21.15.89:6789/0 conn(0x5653c201d800 legacy=0x5653c201e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.446+0000 7fe13e852640 1 -- 172.21.15.123:0/1311390637 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653c201e9f0 con 0x5653c201cee0 2024-03-20T13:36:58.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe13e852640 1 --2- 172.21.15.123:0/1311390637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c201d2c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe13000a5c0 tx=0x7fe13001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14847ecd3b30269a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe13d850640 1 -- 172.21.15.123:0/1311390637 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1300aa470 con 0x5653c201cee0 2024-03-20T13:36:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe13d850640 1 -- 172.21.15.123:0/1311390637 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1300aa5d0 con 0x5653c201cee0 2024-03-20T13:36:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe13d850640 1 -- 172.21.15.123:0/1311390637 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1300aa890 con 0x5653c201cee0 2024-03-20T13:36:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 -- 172.21.15.123:0/1311390637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 msgr2=0x5653c201d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 --2- 172.21.15.123:0/1311390637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c201d2c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe13000a5c0 tx=0x7fe13001b340 comp rx=0 tx=0).stop 2024-03-20T13:36:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 -- 172.21.15.123:0/1311390637 shutdown_connections 2024-03-20T13:36:58.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 --2- 172.21.15.123:0/1311390637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c201d2c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 -- 172.21.15.123:0/1311390637 >> 172.21.15.123:0/1311390637 conn(0x5653c20187b0 msgr2=0x5653c201abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 -- 172.21.15.123:0/1311390637 shutdown_connections 2024-03-20T13:36:58.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.450+0000 7fe140d37980 1 -- 172.21.15.123:0/1311390637 wait complete. 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe140d37980 1 Processor -- start 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe140d37980 1 -- start start 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe140d37980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c21073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe140d37980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653c1f2d620 con 0x5653c201cee0 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe13e852640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c21073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe13e852640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c21073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53962/0 (socket says 172.21.15.123:53962) 2024-03-20T13:36:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe13e852640 1 -- 172.21.15.123:0/2706479932 learned_addr learned my addr 172.21.15.123:0/2706479932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.462+0000 7fe13e852640 1 -- 172.21.15.123:0/2706479932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe130005df0 con 0x5653c201cee0 2024-03-20T13:36:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe13e852640 1 --2- 172.21.15.123:0/2706479932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c21073a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe130018f70 tx=0x7fe130003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41eca35d262db8f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe02ce09640 1 -- 172.21.15.123:0/2706479932 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1300aa9c0 con 0x5653c201cee0 2024-03-20T13:36:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe02ce09640 1 -- 172.21.15.123:0/2706479932 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1300aab20 con 0x5653c201cee0 2024-03-20T13:36:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe02ce09640 1 -- 172.21.15.123:0/2706479932 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1300aadc0 con 0x5653c201cee0 2024-03-20T13:36:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/2706479932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 msgr2=0x5653c21073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 --2- 172.21.15.123:0/2706479932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c21073a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe130018f70 tx=0x7fe130003030 comp rx=0 tx=0).stop 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/2706479932 shutdown_connections 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 --2- 172.21.15.123:0/2706479932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c21073a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/2706479932 >> 172.21.15.123:0/2706479932 conn(0x5653c20187b0 msgr2=0x5653c2102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/2706479932 shutdown_connections 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/2706479932 wait complete. 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 Processor -- start 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- start start 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c210e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653c1f28e00 con 0x5653c201cee0 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe13e852640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c210e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe13e852640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c210e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53972/0 (socket says 172.21.15.123:53972) 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe13e852640 1 -- 172.21.15.123:0/1121074463 learned_addr learned my addr 172.21.15.123:0/1121074463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe13e852640 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653c201e9f0 con 0x5653c201cee0 2024-03-20T13:36:58.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe13e852640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c210e150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe130018f70 tx=0x7fe1300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe02b606640 1 -- 172.21.15.123:0/1121074463 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1300cb070 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe02b606640 1 -- 172.21.15.123:0/1121074463 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1300c6690 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653c210e690 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe02b606640 1 -- 172.21.15.123:0/1121074463 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1300c6930 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.466+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653c210eac0 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe02b606640 1 -- 172.21.15.123:0/1121074463 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe1300c6a90 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe02b606640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0240342b0 0x7fe024036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe02b606640 1 -- 172.21.15.123:0/1121074463 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe1300e49e0 con 0x5653c201cee0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13e051640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0240342b0 0x7fe024036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c201d800 0x5653c2114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2115310 con 0x5653c201d800 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13f053640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c201d800 0x5653c2114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13e051640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0240342b0 0x7fe024036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe134001e50 tx=0x7fe1340013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13f053640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c201d800 0x5653c2114dd0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13f053640 1 -- 172.21.15.123:0/1121074463 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x5653c201d800 2024-03-20T13:36:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c2115b80 0x5653c2117f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2118690 con 0x5653c2115b80 2024-03-20T13:36:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13e852640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c2115b80 0x5653c2117f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13e852640 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c2115b80 0x5653c2117f70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe13e852640 1 -- 172.21.15.123:0/1121074463 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2115b80 2024-03-20T13:36:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.470+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2119ef0 con 0x5653c2115b80 2024-03-20T13:36:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13e852640 1 -- 172.21.15.123:0/1121074463 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2115b80 2024-03-20T13:36:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2119030 con 0x5653c2115b80 2024-03-20T13:36:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13e852640 1 -- 172.21.15.123:0/1121074463 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2115b80 2024-03-20T13:36:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2119440 con 0x5653c201d800 2024-03-20T13:36:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13f053640 1 -- 172.21.15.123:0/1121074463 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe13800a4d0 con 0x5653c201d800 2024-03-20T13:36:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 Processor -- start 2024-03-20T13:36:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 -- start start 2024-03-20T13:36:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 0x5653c2128a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653c1ec1e30 con 0x5653c2128600 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13f053640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 0x5653c2128a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13f053640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 0x5653c2128a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:53984/0 (socket says 172.21.15.123:53984) 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13f053640 1 -- 172.21.15.123:0/2761893596 learned_addr learned my addr 172.21.15.123:0/2761893596 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13f053640 1 -- 172.21.15.123:0/2761893596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653c2128f60 con 0x5653c2128600 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe13f053640 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 0x5653c2128a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe13800b010 tx=0x7fe13800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe028e01640 1 -- 172.21.15.123:0/2761893596 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe138017660 con 0x5653c2128600 2024-03-20T13:36:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653c21291b0 con 0x5653c2128600 2024-03-20T13:36:58.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653c2129d00 con 0x5653c2128600 2024-03-20T13:36:58.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe028e01640 1 -- 172.21.15.123:0/2761893596 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380177c0 con 0x5653c2128600 2024-03-20T13:36:58.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.474+0000 7fe028e01640 1 -- 172.21.15.123:0/2761893596 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe138017a60 con 0x5653c2128600 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe028e01640 1 -- 172.21.15.123:0/2761893596 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe13801d020 con 0x5653c2128600 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe028e01640 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0180342b0 0x7fe018036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe028e01640 1 -- 172.21.15.123:0/2761893596 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe13804b560 con 0x5653c2128600 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13e852640 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0180342b0 0x7fe018036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 Processor -- start 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- start start 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13e852640 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0180342b0 0x7fe018036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5653c2118b30 tx=0x7fe1300e1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c2135970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653c1eb5790 con 0x5653c2135550 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c2135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c2135970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54000/0 (socket says 172.21.15.123:54000) 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 -- 172.21.15.123:0/1971230460 learned_addr learned my addr 172.21.15.123:0/1971230460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 -- 172.21.15.123:0/1971230460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653c2135f40 con 0x5653c2135550 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 --2- 172.21.15.123:0/1971230460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c2135970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1380498d0 tx=0x7fe1380293a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3ea211550c9eeb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe0227fc640 1 -- 172.21.15.123:0/1971230460 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe138048070 con 0x5653c2135550 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe0227fc640 1 -- 172.21.15.123:0/1971230460 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380204c0 con 0x5653c2135550 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe0227fc640 1 -- 172.21.15.123:0/1971230460 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe138017bc0 con 0x5653c2135550 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- 172.21.15.123:0/1971230460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 msgr2=0x5653c2135970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 --2- 172.21.15.123:0/1971230460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c2135970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1380498d0 tx=0x7fe1380293a0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- 172.21.15.123:0/1971230460 shutdown_connections 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 --2- 172.21.15.123:0/1971230460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c2135970 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- 172.21.15.123:0/1971230460 >> 172.21.15.123:0/1971230460 conn(0x5653c21318e0 msgr2=0x5653c212f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- 172.21.15.123:0/1971230460 shutdown_connections 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- 172.21.15.123:0/1971230460 wait complete. 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 Processor -- start 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- start start 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c213c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe140d37980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653c213c870 con 0x5653c2135550 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c213c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c213c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54014/0 (socket says 172.21.15.123:54014) 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.478+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 learned_addr learned my addr 172.21.15.123:0/677169521 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653c2129d00 con 0x5653c2135550 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13f053640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c213c330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe13800dce0 tx=0x7fe138049860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe020ff9640 1 -- 172.21.15.123:0/677169521 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe138030070 con 0x5653c2135550 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe020ff9640 1 -- 172.21.15.123:0/677169521 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138020630 con 0x5653c2135550 2024-03-20T13:36:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653c213ca70 con 0x5653c2135550 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe020ff9640 1 -- 172.21.15.123:0/677169521 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe138011ae0 con 0x5653c2135550 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653c213cf00 con 0x5653c2135550 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe020ff9640 1 -- 172.21.15.123:0/677169521 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe138011c40 con 0x5653c2135550 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe020ff9640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe008034300 0x7fe0080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe020ff9640 1 -- 172.21.15.123:0/677169521 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe138036c80 con 0x5653c2135550 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e852640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe008034300 0x7fe0080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c2147a80 0x5653c2149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214a690 con 0x5653c2147a80 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e051640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c2147a80 0x5653c2149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e852640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe008034300 0x7fe0080367c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe1300c7df0 tx=0x7fe1300e7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e051640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c2147a80 0x5653c2149f40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 realm 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2146ee0 con 0x5653c2147a80 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214b0d0 con 0x5653c2147a80 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c214be60 0x5653c214e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.482+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214e8d0 con 0x5653c214be60 2024-03-20T13:36:58.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c214be60 0x5653c214e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c214be60 0x5653c214e250 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe138042040 con 0x5653c214be60 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c214be60 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe138042040 con 0x5653c214be60 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 20 searching for the correct realm 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5653c2151110 0x5653c21535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2153ca0 con 0x5653c2151110 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13e852640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5653c2151110 0x5653c21535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13e852640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5653c2151110 0x5653c21535d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2153ca0 con 0x5653c214be60 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138042040 con 0x5653c214be60 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe138014c60 0x7fe138048aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x7fe138014c60 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.486+0000 7fe13e051640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe138014c60 0x7fe138048aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe138014c60 0x7fe138048aa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c2147a80 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c2147a80 2024-03-20T13:36:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c2151110 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c2147a80 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c214be60 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138042040 con 0x5653c214be60 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c214be60 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138042040 con 0x5653c214be60 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c2147a80 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x7fe138014c60 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f0d0 con 0x5653c2147a80 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x7fe138014c60 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.490+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c214be60 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2151110 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2147a80 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c214be60 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2151110 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2147a80 2024-03-20T13:36:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2147a80 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2147a80 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2151110 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x7fe138014c60 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2147a80 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x7fe138014c60 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2151110 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.494+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x7fe138014c60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c2151110 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe13402d080 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f550 con 0x5653c2147a80 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.498+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f900 con 0x5653c214be60 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c214f900 con 0x5653c2147a80 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 zone default found 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 4 Realm: () 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 zonegroup default 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2150180 con 0x7fe138014c60 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2155f60 con 0x5653c2151110 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21562c0 con 0x5653c2151110 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 started sync module instance, tier type = 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:58.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21553a0 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94917738452864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21553a0 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.502+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2156b10 con 0x5653c2147a80 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.506+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.506+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94917738456688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2156f30 con 0x5653c2147a80 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.506+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21578a0 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.506+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94917738452864] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.506+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94917738456688] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94917738460160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2156f30 con 0x5653c214be60 2024-03-20T13:36:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2157820 con 0x7fe138014c60 2024-03-20T13:36:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94917738462288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2157820 con 0x7fe138014c60 2024-03-20T13:36:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2158c50 con 0x5653c214be60 2024-03-20T13:36:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94917738460160] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.510+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94917738462288] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94917738463344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2158c10 con 0x5653c214be60 2024-03-20T13:36:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2159000 con 0x5653c2151110 2024-03-20T13:36:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94917738457744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2159000 con 0x5653c2151110 2024-03-20T13:36:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2159ef0 con 0x5653c2151110 2024-03-20T13:36:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.514+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94917738463344] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94917738457744] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94917738468272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2159eb0 con 0x5653c2151110 2024-03-20T13:36:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c215a740 con 0x7fe138014c60 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94917738472096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2159ef0 con 0x7fe138014c60 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=0 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=1 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=2 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=3 2024-03-20T13:36:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=4 2024-03-20T13:36:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=5 2024-03-20T13:36:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94917738468272] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=6 2024-03-20T13:36:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94917738472096] v32'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 20 add_watcher() i=7 2024-03-20T13:36:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21599f0 con 0x5653c2147a80 2024-03-20T13:36:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.518+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94917738473152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21599f0 con 0x5653c2147a80 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94917738473152] v32'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fdff57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 5 note: GC not initialized 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fdf6ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 Filter name: none 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fdf6dffb640 20 reqs_thread_entry: start 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c217f790 con 0x5653c2147a80 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2180130 con 0x7fe138014c60 2024-03-20T13:36:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-03-20T13:36:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-03-20T13:36:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-03-20T13:36:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2185ad0 con 0x5653c2147a80 2024-03-20T13:36:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~621] v32'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.522+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94917738648912 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2181340 con 0x5653c214be60 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94917738463344 notify 137438953482 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x7fe13806d040 con 0x5653c214be60 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe0227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94917738463344 notifier 4388 bl.length()=797 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe0227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe0227fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 notify.4 [notify cookie 94917738648912 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe0227fc640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe004003ea0 con 0x5653c214be60 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94917738648912 notify 137438953482 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5653c213cf00 con 0x5653c214be60 2024-03-20T13:36:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2185550 con 0x7fe138014c60 2024-03-20T13:36:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe140d37980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe140d37980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe140d37980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94917738648912 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2180ea0 con 0x5653c214be60 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify (1) cookie 94917738452864 notify 137438953483 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x5653c213cf00 con 0x5653c214be60 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe021ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94917738452864 notifier 4388 bl.length()=166 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe021ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe021ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe021ffb640 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdf74003400 con 0x5653c214be60 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.526+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(68 notify.0 [notify cookie 94917738648912 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.530+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== watch-notify(notify_complete (2) cookie 94917738648912 notify 137438953483 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5653c213ca70 con 0x5653c214be60 2024-03-20T13:36:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.530+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.536 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.530+0000 7fdff57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.530+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94917738473152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2181730 con 0x5653c2147a80 2024-03-20T13:36:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.530+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94917738473152] v32'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.530+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94917738452864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c215a6c0 con 0x5653c214be60 2024-03-20T13:36:58.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94917738452864] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 20 remove_watcher() i=0 2024-03-20T13:36:58.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 2 removed watcher, disabling cache 2024-03-20T13:36:58.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94917738456688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2155780 con 0x5653c2147a80 2024-03-20T13:36:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94917738456688] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x5653c2147a80 2024-03-20T13:36:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 20 remove_watcher() i=1 2024-03-20T13:36:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94917738460160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2155780 con 0x5653c214be60 2024-03-20T13:36:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94917738460160] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 20 remove_watcher() i=2 2024-03-20T13:36:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.534+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94917738462288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2157400 con 0x7fe138014c60 2024-03-20T13:36:58.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94917738462288] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe140d37980 20 remove_watcher() i=3 2024-03-20T13:36:58.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94917738463344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2155780 con 0x5653c214be60 2024-03-20T13:36:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe13f053640 1 -- 172.21.15.123:0/677169521 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94917738463344] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe138064040 con 0x5653c214be60 2024-03-20T13:36:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe140d37980 20 remove_watcher() i=4 2024-03-20T13:36:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94917738457744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c21580f0 con 0x5653c2151110 2024-03-20T13:36:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94917738457744] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe140d37980 20 remove_watcher() i=5 2024-03-20T13:36:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.538+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94917738468272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2156b10 con 0x5653c2151110 2024-03-20T13:36:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe13e852640 1 -- 172.21.15.123:0/677169521 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94917738468272] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1300cd070 con 0x5653c2151110 2024-03-20T13:36:58.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 20 remove_watcher() i=6 2024-03-20T13:36:58.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94917738472096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653c2156b10 con 0x7fe138014c60 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94917738472096] v32'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe13400f6a0 con 0x7fe138014c60 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 20 remove_watcher() i=7 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c214be60 msgr2=0x5653c214e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c214be60 0x5653c214e250 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c2147a80 msgr2=0x5653c2149f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c2147a80 0x5653c2149f40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe138014c60 msgr2=0x7fe138048aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe138014c60 0x7fe138048aa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5653c2151110 msgr2=0x5653c21535d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5653c2151110 0x5653c21535d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe008034300 msgr2=0x7fe0080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe008034300 0x7fe0080367c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe1300c7df0 tx=0x7fe1300e7040 comp rx=0 tx=0).stop 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 msgr2=0x5653c213c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe13e051640 1 -- 172.21.15.123:0/677169521 reap_dead start 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c213c330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe13800dce0 tx=0x7fe138049860 comp rx=0 tx=0).stop 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 shutdown_connections 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/677169521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2135550 0x5653c213c330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 >> 172.21.15.123:0/677169521 conn(0x5653c21318e0 msgr2=0x5653c212ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 shutdown_connections 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/677169521 wait complete. 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0180342b0 msgr2=0x7fe018036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0180342b0 0x7fe018036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5653c2118b30 tx=0x7fe1300e1040 comp rx=0 tx=0).stop 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 msgr2=0x5653c2128a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 0x5653c2128a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe13800b010 tx=0x7fe13800d790 comp rx=0 tx=0).stop 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 shutdown_connections 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0180342b0 0x7fe018036770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/2761893596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c2128600 0x5653c2128a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 >> 172.21.15.123:0/2761893596 conn(0x5653c211d410 msgr2=0x5653c211df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 shutdown_connections 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/2761893596 wait complete. 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c2115b80 msgr2=0x5653c2117f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c2115b80 0x5653c2117f70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c201d800 msgr2=0x5653c2114dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c201d800 0x5653c2114dd0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0240342b0 msgr2=0x7fe024036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0240342b0 0x7fe024036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe134001e50 tx=0x7fe1340013b0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 msgr2=0x5653c210e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c210e150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe130018f70 tx=0x7fe1300180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 shutdown_connections 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5653c2115b80 0x5653c2117f70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5653c201d800 0x5653c2114dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe0240342b0 0x7fe024036770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 --2- 172.21.15.123:0/1121074463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653c201cee0 0x5653c210e150 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 >> 172.21.15.123:0/1121074463 conn(0x5653c20187b0 msgr2=0x5653c2101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 shutdown_connections 2024-03-20T13:36:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.542+0000 7fe140d37980 1 -- 172.21.15.123:0/1121074463 wait complete. 2024-03-20T13:36:58.557 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:58.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:58.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:58.558 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:58.634 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:58.634 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f53124b4980 1 Processor -- start 2024-03-20T13:36:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f53124b4980 1 -- start start 2024-03-20T13:36:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f53124b4980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ce22f908b0 0x55ce2301ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f53124b4980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ce22f68520 con 0x55ce2301f170 2024-03-20T13:36:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f53124b4980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ce22f2f0f0 con 0x55ce22f908b0 2024-03-20T13:36:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f530ffcf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ce22f908b0 0x55ce2301ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f530f7ce640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55ce2301f170 0x55ce23021560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59044/0 (socket says 172.21.15.123:59044) 2024-03-20T13:36:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f530f7ce640 1 -- 172.21.15.123:0/4274517224 learned_addr learned my addr 172.21.15.123:0/4274517224 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f530ffcf640 1 -- 172.21.15.123:0/4274517224 >> v1:172.21.15.89:6789/0 conn(0x55ce2301f170 legacy=0x55ce23021560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.630+0000 7f530ffcf640 1 -- 172.21.15.123:0/4274517224 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce23023cc0 con 0x55ce22f908b0 2024-03-20T13:36:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f530ffcf640 1 --2- 172.21.15.123:0/4274517224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce22f908b0 0x55ce2301ec30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f530000a480 tx=0x7f530001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de4facc7088dd95 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f530efcd640 1 -- 172.21.15.123:0/4274517224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53000ab540 con 0x55ce22f908b0 2024-03-20T13:36:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f530efcd640 1 -- 172.21.15.123:0/4274517224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53000ab6a0 con 0x55ce22f908b0 2024-03-20T13:36:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f530efcd640 1 -- 172.21.15.123:0/4274517224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53000ab960 con 0x55ce22f908b0 2024-03-20T13:36:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 -- 172.21.15.123:0/4274517224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce22f908b0 msgr2=0x55ce2301ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 --2- 172.21.15.123:0/4274517224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce22f908b0 0x55ce2301ec30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f530000a480 tx=0x7f530001b280 comp rx=0 tx=0).stop 2024-03-20T13:36:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 -- 172.21.15.123:0/4274517224 shutdown_connections 2024-03-20T13:36:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 --2- 172.21.15.123:0/4274517224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce22f908b0 0x55ce2301ec30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 -- 172.21.15.123:0/4274517224 >> 172.21.15.123:0/4274517224 conn(0x55ce23016710 msgr2=0x55ce23018b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 -- 172.21.15.123:0/4274517224 shutdown_connections 2024-03-20T13:36:58.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.634+0000 7f53124b4980 1 -- 172.21.15.123:0/4274517224 wait complete. 2024-03-20T13:36:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f53124b4980 1 Processor -- start 2024-03-20T13:36:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f53124b4980 1 -- start start 2024-03-20T13:36:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f53124b4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce23105fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f53124b4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce22f2c620 con 0x55ce2301f170 2024-03-20T13:36:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f530ffcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce23105fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f530ffcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce23105fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54032/0 (socket says 172.21.15.123:54032) 2024-03-20T13:36:58.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f530ffcf640 1 -- 172.21.15.123:0/2151613369 learned_addr learned my addr 172.21.15.123:0/2151613369 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f530ffcf640 1 -- 172.21.15.123:0/2151613369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300005d30 con 0x55ce2301f170 2024-03-20T13:36:58.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f530ffcf640 1 --2- 172.21.15.123:0/2151613369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce23105fd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f530001b2c0 tx=0x7f5300003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c79d22511c1968 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f51fde0b640 1 -- 172.21.15.123:0/2151613369 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53000ab940 con 0x55ce2301f170 2024-03-20T13:36:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f51fde0b640 1 -- 172.21.15.123:0/2151613369 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53000abaa0 con 0x55ce2301f170 2024-03-20T13:36:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.646+0000 7f51fde0b640 1 -- 172.21.15.123:0/2151613369 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53000abd80 con 0x55ce2301f170 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/2151613369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 msgr2=0x55ce23105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 --2- 172.21.15.123:0/2151613369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce23105fd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f530001b2c0 tx=0x7f5300003030 comp rx=0 tx=0).stop 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/2151613369 shutdown_connections 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 --2- 172.21.15.123:0/2151613369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce23105fd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/2151613369 >> 172.21.15.123:0/2151613369 conn(0x55ce23016710 msgr2=0x55ce23101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/2151613369 shutdown_connections 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/2151613369 wait complete. 2024-03-20T13:36:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 Processor -- start 2024-03-20T13:36:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- start start 2024-03-20T13:36:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce2310cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce22f27e00 con 0x55ce2301f170 2024-03-20T13:36:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f530ffcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce2310cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f530ffcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce2310cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54048/0 (socket says 172.21.15.123:54048) 2024-03-20T13:36:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f530ffcf640 1 -- 172.21.15.123:0/3555309398 learned_addr learned my addr 172.21.15.123:0/3555309398 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f530ffcf640 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce23023cc0 con 0x55ce2301f170 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f530ffcf640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce2310cd00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f530001b2c0 tx=0x7f5300018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f51f7fff640 1 -- 172.21.15.123:0/3555309398 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53000c3070 con 0x55ce2301f170 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce2310d240 con 0x55ce2301f170 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce2310d6d0 con 0x55ce2301f170 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f51f7fff640 1 -- 172.21.15.123:0/3555309398 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53000beba0 con 0x55ce2301f170 2024-03-20T13:36:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f51f7fff640 1 -- 172.21.15.123:0/3555309398 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53000bee40 con 0x55ce2301f170 2024-03-20T13:36:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f51f7fff640 1 -- 172.21.15.123:0/3555309398 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f53000b2070 con 0x55ce2301f170 2024-03-20T13:36:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f51f7fff640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f80342b0 0x7f51f8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f51f7fff640 1 -- 172.21.15.123:0/3555309398 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f53000e3e80 con 0x55ce2301f170 2024-03-20T13:36:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f530f7ce640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f80342b0 0x7f51f8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce23111920 0x55ce23113d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23114250 con 0x55ce23111920 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.650+0000 7f53107d0640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce23111920 0x55ce23113d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f530f7ce640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f80342b0 0x7f51f8036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5304001da0 tx=0x7f5304001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53107d0640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce23111920 0x55ce23113d10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53107d0640 1 -- 172.21.15.123:0/3555309398 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce23111920 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce23114ac0 0x55ce23116eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23117570 con 0x55ce23114ac0 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f530ffcf640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce23114ac0 0x55ce23116eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f530ffcf640 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce23114ac0 0x55ce23116eb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f530ffcf640 1 -- 172.21.15.123:0/3555309398 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce23114ac0 2024-03-20T13:36:58.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23118db0 con 0x55ce23114ac0 2024-03-20T13:36:58.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f530ffcf640 1 -- 172.21.15.123:0/3555309398 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce23114ac0 2024-03-20T13:36:58.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23117fb0 con 0x55ce23114ac0 2024-03-20T13:36:58.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f530ffcf640 1 -- 172.21.15.123:0/3555309398 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce23114ac0 2024-03-20T13:36:58.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231183c0 con 0x55ce23111920 2024-03-20T13:36:58.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.654+0000 7f53107d0640 1 -- 172.21.15.123:0/3555309398 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce23111920 2024-03-20T13:36:58.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 Processor -- start 2024-03-20T13:36:58.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 -- start start 2024-03-20T13:36:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 0x55ce23127940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce22ec0e30 con 0x55ce23127520 2024-03-20T13:36:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53107d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 0x55ce23127940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53107d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 0x55ce23127940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54064/0 (socket says 172.21.15.123:54064) 2024-03-20T13:36:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53107d0640 1 -- 172.21.15.123:0/1958512942 learned_addr learned my addr 172.21.15.123:0/1958512942 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53107d0640 1 -- 172.21.15.123:0/1958512942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce23127e80 con 0x55ce23127520 2024-03-20T13:36:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53107d0640 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 0x55ce23127940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5308016cf0 tx=0x7f530800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f51f57fa640 1 -- 172.21.15.123:0/1958512942 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5308017660 con 0x55ce23127520 2024-03-20T13:36:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce231280d0 con 0x55ce23127520 2024-03-20T13:36:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce23128c20 con 0x55ce23127520 2024-03-20T13:36:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f51f57fa640 1 -- 172.21.15.123:0/1958512942 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080177c0 con 0x55ce23127520 2024-03-20T13:36:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f51f57fa640 1 -- 172.21.15.123:0/1958512942 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5308017a60 con 0x55ce23127520 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f51f57fa640 1 -- 172.21.15.123:0/1958512942 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f530801d020 con 0x55ce23127520 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f51f57fa640 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e8034300 0x7f51e80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f51f57fa640 1 -- 172.21.15.123:0/1958512942 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f530804b4b0 con 0x55ce23127520 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f530ffcf640 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e8034300 0x7f51e80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 Processor -- start 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 -- start start 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f530ffcf640 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e8034300 0x7f51e80367c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55ce231179f0 tx=0x7f53000c8f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce23134850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.658+0000 7f53124b4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce22eb4790 con 0x55ce23134430 2024-03-20T13:36:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce23134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce23134850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54070/0 (socket says 172.21.15.123:54070) 2024-03-20T13:36:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 -- 172.21.15.123:0/3899721537 learned_addr learned my addr 172.21.15.123:0/3899721537 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 -- 172.21.15.123:0/3899721537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce23134e20 con 0x55ce23134430 2024-03-20T13:36:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 --2- 172.21.15.123:0/3899721537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce23134850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f530800a100 tx=0x7f5308020710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704836ff69065fc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f51eeffd640 1 -- 172.21.15.123:0/3899721537 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5308048070 con 0x55ce23134430 2024-03-20T13:36:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f51eeffd640 1 -- 172.21.15.123:0/3899721537 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011cb0 con 0x55ce23134430 2024-03-20T13:36:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f51eeffd640 1 -- 172.21.15.123:0/3899721537 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f530804b0d0 con 0x55ce23134430 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- 172.21.15.123:0/3899721537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 msgr2=0x55ce23134850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 --2- 172.21.15.123:0/3899721537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce23134850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f530800a100 tx=0x7f5308020710 comp rx=0 tx=0).stop 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- 172.21.15.123:0/3899721537 shutdown_connections 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 --2- 172.21.15.123:0/3899721537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce23134850 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- 172.21.15.123:0/3899721537 >> 172.21.15.123:0/3899721537 conn(0x55ce231307c0 msgr2=0x55ce2312e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- 172.21.15.123:0/3899721537 shutdown_connections 2024-03-20T13:36:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- 172.21.15.123:0/3899721537 wait complete. 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 Processor -- start 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- start start 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce2313b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53124b4980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2313b840 con 0x55ce23134430 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce2313b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce2313b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54076/0 (socket says 172.21.15.123:54076) 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 learned_addr learned my addr 172.21.15.123:0/2365915717 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce23128c20 con 0x55ce23134430 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.662+0000 7f53107d0640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce2313b300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5308029930 tx=0x7f5308049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f51ed7fa640 1 -- 172.21.15.123:0/2365915717 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f530802f070 con 0x55ce23134430 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce2313ba40 con 0x55ce23134430 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f51ed7fa640 1 -- 172.21.15.123:0/2365915717 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011e20 con 0x55ce23134430 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f51ed7fa640 1 -- 172.21.15.123:0/2365915717 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5308048070 con 0x55ce23134430 2024-03-20T13:36:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce2313be70 con 0x55ce23134430 2024-03-20T13:36:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f51ed7fa640 1 -- 172.21.15.123:0/2365915717 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f53080481d0 con 0x55ce23134430 2024-03-20T13:36:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f51ed7fa640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d80342b0 0x7f51d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f51ed7fa640 1 -- 172.21.15.123:0/2365915717 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f5308034c70 con 0x55ce23134430 2024-03-20T13:36:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530ffcf640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d80342b0 0x7f51d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce231469f0 0x55ce23148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231495e0 con 0x55ce231469f0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530f7ce640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce231469f0 0x55ce23148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530ffcf640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d80342b0 0x7f51d8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53000be6a0 tx=0x7f53000de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530f7ce640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce231469f0 0x55ce23148e90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 realm 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23145f10 con 0x55ce231469f0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2314a060 con 0x55ce231469f0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce2314abd0 0x55ce2314d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2314d800 con 0x55ce2314abd0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53107d0640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce2314abd0 0x55ce2314d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.666+0000 7f53107d0640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce2314abd0 0x55ce2314d090 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2314e050 con 0x55ce2314abd0 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 20 searching for the correct realm 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ce2314fd70 0x55ce23152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530ffcf640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ce2314fd70 0x55ce23152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530ffcf640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ce2314fd70 0x55ce23152160 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53107d0640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5308047b80 0x7f530801f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x7f5308047b80 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5308047b80 0x7f530801f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5308047b80 0x7f530801f3d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.670+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x7f5308047b80 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x7f5308047b80 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.674+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x7f5308047b80 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x7f5308047b80 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x7f5308047b80 2024-03-20T13:36:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.678+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314fd70 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231526f0 con 0x55ce2314abd0 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2314e980 con 0x55ce231469f0 2024-03-20T13:36:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2314edc0 con 0x55ce2314abd0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2314f1a0 con 0x55ce231469f0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f530400e640 con 0x55ce231469f0 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 zone default found 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 4 Realm: () 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 zonegroup default 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23152b80 con 0x7f5308047b80 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f530400e640 con 0x7f5308047b80 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23154d60 con 0x55ce2314fd70 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231550c0 con 0x55ce2314fd70 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 started sync module instance, tier type = 2024-03-20T13:36:58.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:58.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.682+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23154330 con 0x55ce2314abd0 2024-03-20T13:36:58.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94343840220896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23154330 con 0x55ce2314abd0 2024-03-20T13:36:58.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23155a70 con 0x55ce231469f0 2024-03-20T13:36:58.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94343840224656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231562c0 con 0x55ce231469f0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23156cc0 con 0x55ce2314abd0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.686+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94343840220896] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94343840224656] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94343840229312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23155e20 con 0x55ce2314abd0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23157510 con 0x7f5308047b80 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x7f5308047b80 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94343840231536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23155e20 con 0x7f5308047b80 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23158000 con 0x55ce2314abd0 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94343840231536] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x7f5308047b80 2024-03-20T13:36:58.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.690+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94343840229312] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94343840218768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23157fc0 con 0x55ce2314abd0 2024-03-20T13:36:58.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23157600 con 0x55ce2314fd70 2024-03-20T13:36:58.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94343840236464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23158c70 con 0x55ce2314fd70 2024-03-20T13:36:58.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231595e0 con 0x55ce2314fd70 2024-03-20T13:36:58.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94343840218768] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94343840239936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23159560 con 0x55ce2314fd70 2024-03-20T13:36:58.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2315a300 con 0x7f5308047b80 2024-03-20T13:36:58.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94343840236464] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x7f5308047b80 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94343840237520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2315a300 con 0x7f5308047b80 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=0 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94343840239936] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=1 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=2 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=3 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=4 2024-03-20T13:36:58.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=5 2024-03-20T13:36:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.694+0000 7f53124b4980 20 add_watcher() i=6 2024-03-20T13:36:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94343840237520] v32'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x7f5308047b80 2024-03-20T13:36:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 20 add_watcher() i=7 2024-03-20T13:36:58.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2315a1f0 con 0x55ce231469f0 2024-03-20T13:36:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94343840244160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2315aaa0 con 0x55ce231469f0 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94343840244160] v32'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f51c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 5 note: GC not initialized 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f51c4fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:58.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 20 Filter name: none 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f513e7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.698+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2317ec90 con 0x55ce231469f0 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.702+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.702+0000 7f53124b4980 20 rados_obj.operate() r=0 bl.length=621 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.702+0000 7f51c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.702+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94343840244160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2317ddf0 con 0x55ce231469f0 2024-03-20T13:36:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.702+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94343840244160] v32'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.702+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94343840220896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2315a1c0 con 0x55ce2314abd0 2024-03-20T13:36:58.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94343840220896] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f53124b4980 20 remove_watcher() i=0 2024-03-20T13:36:58.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f53124b4980 2 removed watcher, disabling cache 2024-03-20T13:36:58.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94343840224656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce2315a1c0 con 0x55ce231469f0 2024-03-20T13:36:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94343840224656] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x55ce231469f0 2024-03-20T13:36:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f53124b4980 20 remove_watcher() i=1 2024-03-20T13:36:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.706+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94343840229312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231546e0 con 0x55ce2314abd0 2024-03-20T13:36:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94343840229312] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53124b4980 20 remove_watcher() i=2 2024-03-20T13:36:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94343840231536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231546e0 con 0x7f5308047b80 2024-03-20T13:36:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94343840231536] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x7f5308047b80 2024-03-20T13:36:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53124b4980 20 remove_watcher() i=3 2024-03-20T13:36:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94343840218768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23157070 con 0x55ce2314abd0 2024-03-20T13:36:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53107d0640 1 -- 172.21.15.123:0/2365915717 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94343840218768] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f530800a4d0 con 0x55ce2314abd0 2024-03-20T13:36:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53124b4980 20 remove_watcher() i=4 2024-03-20T13:36:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.710+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94343840236464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231546e0 con 0x55ce2314fd70 2024-03-20T13:36:58.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94343840236464] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 20 remove_watcher() i=5 2024-03-20T13:36:58.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94343840239936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce23153e90 con 0x55ce2314fd70 2024-03-20T13:36:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f530ffcf640 1 -- 172.21.15.123:0/2365915717 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94343840239936] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53000d09b0 con 0x55ce2314fd70 2024-03-20T13:36:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 20 remove_watcher() i=6 2024-03-20T13:36:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94343840237520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ce231583b0 con 0x7f5308047b80 2024-03-20T13:36:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94343840237520] v32'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304043040 con 0x7f5308047b80 2024-03-20T13:36:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 20 remove_watcher() i=7 2024-03-20T13:36:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce2314abd0 msgr2=0x55ce2314d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce2314abd0 0x55ce2314d090 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce231469f0 msgr2=0x55ce23148e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce231469f0 0x55ce23148e90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5308047b80 msgr2=0x7f530801f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5308047b80 0x7f530801f3d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ce2314fd70 msgr2=0x55ce23152160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ce2314fd70 0x55ce23152160 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d80342b0 msgr2=0x7f51d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d80342b0 0x7f51d8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53000be6a0 tx=0x7f53000de000 comp rx=0 tx=0).stop 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 msgr2=0x55ce2313b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f530f7ce640 1 -- 172.21.15.123:0/2365915717 reap_dead start 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce2313b300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5308029930 tx=0x7f5308049830 comp rx=0 tx=0).stop 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 shutdown_connections 2024-03-20T13:36:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/2365915717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23134430 0x55ce2313b300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 >> 172.21.15.123:0/2365915717 conn(0x55ce231307c0 msgr2=0x55ce2312de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 shutdown_connections 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/2365915717 wait complete. 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e8034300 msgr2=0x7f51e80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e8034300 0x7f51e80367c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55ce231179f0 tx=0x7f53000c8f90 comp rx=0 tx=0).stop 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 msgr2=0x55ce23127940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 0x55ce23127940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5308016cf0 tx=0x7f530800d790 comp rx=0 tx=0).stop 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 shutdown_connections 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e8034300 0x7f51e80367c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/1958512942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce23127520 0x55ce23127940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 >> 172.21.15.123:0/1958512942 conn(0x55ce2311c330 msgr2=0x55ce2311ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 shutdown_connections 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/1958512942 wait complete. 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce23114ac0 msgr2=0x55ce23116eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce23114ac0 0x55ce23116eb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce23111920 msgr2=0x55ce23113d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.714+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce23111920 0x55ce23113d10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f80342b0 msgr2=0x7f51f8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f80342b0 0x7f51f8036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5304001da0 tx=0x7f5304001300 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 msgr2=0x55ce2310cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce2310cd00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f530001b2c0 tx=0x7f5300018020 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 shutdown_connections 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ce23114ac0 0x55ce23116eb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ce23111920 0x55ce23113d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f80342b0 0x7f51f8036770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 --2- 172.21.15.123:0/3555309398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2301f170 0x55ce2310cd00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 >> 172.21.15.123:0/3555309398 conn(0x55ce23016710 msgr2=0x55ce231005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 shutdown_connections 2024-03-20T13:36:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.718+0000 7f53124b4980 1 -- 172.21.15.123:0/3555309398 wait complete. 2024-03-20T13:36:58.731 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:58.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-03-20T13:36:58.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-03-20T13:36:58.732 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdedbb980 1 Processor -- start 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdedbb980 1 -- start start 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdedbb980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56271b5c3860 0x56271b5c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdedbb980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56271b5094c0 con 0x56271b5bd5c0 2024-03-20T13:36:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdedbb980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56271b4d00f0 con 0x56271b5c3860 2024-03-20T13:36:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdc0d5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56271b5c3860 0x56271b5c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdc8d6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56271b5bd5c0 0x56271b5bd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59054/0 (socket says 172.21.15.123:59054) 2024-03-20T13:36:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/1082198742 learned_addr learned my addr 172.21.15.123:0/1082198742 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/1082198742 >> v1:172.21.15.89:6789/0 conn(0x56271b5bd5c0 legacy=0x56271b5bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.802+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/1082198742 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271b5be0e0 con 0x56271b5c3860 2024-03-20T13:36:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/1082198742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5c3860 0x56271b5c5c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000a480 tx=0x7f3bd001b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2220e0873066a254 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdb8d4640 1 -- 172.21.15.123:0/1082198742 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bd00aa530 con 0x56271b5c3860 2024-03-20T13:36:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdb8d4640 1 -- 172.21.15.123:0/1082198742 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd00a6050 con 0x56271b5c3860 2024-03-20T13:36:58.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdb8d4640 1 -- 172.21.15.123:0/1082198742 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bd00aa7e0 con 0x56271b5c3860 2024-03-20T13:36:58.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1082198742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5c3860 msgr2=0x56271b5c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/1082198742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5c3860 0x56271b5c5c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000a480 tx=0x7f3bd001b110 comp rx=0 tx=0).stop 2024-03-20T13:36:58.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1082198742 shutdown_connections 2024-03-20T13:36:58.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/1082198742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5c3860 0x56271b5c5c50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1082198742 >> 172.21.15.123:0/1082198742 conn(0x56271b5b6e60 msgr2=0x56271b5b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1082198742 shutdown_connections 2024-03-20T13:36:58.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.806+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1082198742 wait complete. 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 Processor -- start 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- start start 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b4cd620 con 0x56271b5bd5c0 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdc8d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdc8d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54104/0 (socket says 172.21.15.123:54104) 2024-03-20T13:36:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/3948647728 learned_addr learned my addr 172.21.15.123:0/3948647728 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/3948647728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0005d30 con 0x56271b5bd5c0 2024-03-20T13:36:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/3948647728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6a9080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4001860 tx=0x7f3bd4001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598783f539b427e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3acae0d640 1 -- 172.21.15.123:0/3948647728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bd4003460 con 0x56271b5bd5c0 2024-03-20T13:36:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3acae0d640 1 -- 172.21.15.123:0/3948647728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd40035c0 con 0x56271b5bd5c0 2024-03-20T13:36:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3acae0d640 1 -- 172.21.15.123:0/3948647728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bd40038a0 con 0x56271b5bd5c0 2024-03-20T13:36:58.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- 172.21.15.123:0/3948647728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 msgr2=0x56271b6a9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/3948647728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6a9080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4001860 tx=0x7f3bd4001d20 comp rx=0 tx=0).stop 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- 172.21.15.123:0/3948647728 shutdown_connections 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/3948647728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6a9080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- 172.21.15.123:0/3948647728 >> 172.21.15.123:0/3948647728 conn(0x56271b5b6e60 msgr2=0x56271b6a4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- 172.21.15.123:0/3948647728 shutdown_connections 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.818+0000 7f3bdedbb980 1 -- 172.21.15.123:0/3948647728 wait complete. 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 Processor -- start 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 -- start start 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b4c8e00 con 0x56271b5bd5c0 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc8d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc8d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54106/0 (socket says 172.21.15.123:54106) 2024-03-20T13:36:58.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/989750884 learned_addr learned my addr 172.21.15.123:0/989750884 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4006e30 con 0x56271b5bd5c0 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6aff60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4001d60 tx=0x7f3bd4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3ac960a640 1 -- 172.21.15.123:0/989750884 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bd4013760 con 0x56271b5bd5c0 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3ac960a640 1 -- 172.21.15.123:0/989750884 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd40138c0 con 0x56271b5bd5c0 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56271b6b04a0 con 0x56271b5bd5c0 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3ac960a640 1 -- 172.21.15.123:0/989750884 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bd4013bc0 con 0x56271b5bd5c0 2024-03-20T13:36:58.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56271b6b0870 con 0x56271b5bd5c0 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3ac960a640 1 -- 172.21.15.123:0/989750884 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3bd4028460 con 0x56271b5bd5c0 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3ac960a640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ac40342b0 0x7f3ac4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3ac960a640 1 -- 172.21.15.123:0/989750884 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3bd4049890 con 0x56271b5bd5c0 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ac40342b0 0x7f3ac4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b5c3860 0x56271b6b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6b70d0 con 0x56271b5c3860 2024-03-20T13:36:58.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b5c3860 0x56271b6b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ac40342b0 0x7f3ac4036770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00ac000 tx=0x7f3bd00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.822+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b5c3860 0x56271b6b6b90 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/989750884 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3bcc0083f0 con 0x56271b5c3860 2024-03-20T13:36:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6b7940 0x56271b6b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6ba430 con 0x56271b6b7940 2024-03-20T13:36:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6b7940 0x56271b6b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6b7940 0x56271b6b9d30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/989750884 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6b7940 2024-03-20T13:36:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6bbc90 con 0x56271b6b7940 2024-03-20T13:36:58.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/989750884 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6b7940 2024-03-20T13:36:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6badd0 con 0x56271b6b7940 2024-03-20T13:36:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/989750884 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6b7940 2024-03-20T13:36:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6bb1e0 con 0x56271b5c3860 2024-03-20T13:36:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/989750884 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3bcc0083f0 con 0x56271b5c3860 2024-03-20T13:36:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 Processor -- start 2024-03-20T13:36:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.826+0000 7f3bdedbb980 1 -- start start 2024-03-20T13:36:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 0x56271b6ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b461e30 con 0x56271b6ca3a0 2024-03-20T13:36:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdd0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 0x56271b6ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdd0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 0x56271b6ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54114/0 (socket says 172.21.15.123:54114) 2024-03-20T13:36:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/185603398 learned_addr learned my addr 172.21.15.123:0/185603398 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/185603398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271b6cad00 con 0x56271b6ca3a0 2024-03-20T13:36:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 0x56271b6ca7c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00aae0 tx=0x7f3bcc008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3ac27fc640 1 -- 172.21.15.123:0/185603398 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bcc01d070 con 0x56271b6ca3a0 2024-03-20T13:36:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56271b6caf50 con 0x56271b6ca3a0 2024-03-20T13:36:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56271b6cbaa0 con 0x56271b6ca3a0 2024-03-20T13:36:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3ac27fc640 1 -- 172.21.15.123:0/185603398 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc010040 con 0x56271b6ca3a0 2024-03-20T13:36:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3ac27fc640 1 -- 172.21.15.123:0/185603398 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bcc007e50 con 0x56271b6ca3a0 2024-03-20T13:36:58.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3ac27fc640 1 -- 172.21.15.123:0/185603398 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3bcc018430 con 0x56271b6ca3a0 2024-03-20T13:36:58.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3ac27fc640 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ab4034260 0x7f3ab4036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3ac27fc640 1 -- 172.21.15.123:0/185603398 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3bcc04a680 con 0x56271b6ca3a0 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ab4034260 0x7f3ab4036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 Processor -- start 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 -- start start 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ab4034260 0x7f3ab4036720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x56271b6ba8d0 tx=0x7f3bd4036040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6d7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.830+0000 7f3bdedbb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b455790 con 0x56271b6d72f0 2024-03-20T13:36:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6d7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54120/0 (socket says 172.21.15.123:54120) 2024-03-20T13:36:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/1697005509 learned_addr learned my addr 172.21.15.123:0/1697005509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/1697005509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271b6d7ce0 con 0x56271b6d72f0 2024-03-20T13:36:58.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/1697005509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6d7710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc048aa0 tx=0x7f3bcc0165b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58a0ad89d77ba14 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3ab3fff640 1 -- 172.21.15.123:0/1697005509 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bcc047070 con 0x56271b6d72f0 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3ab3fff640 1 -- 172.21.15.123:0/1697005509 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc022410 con 0x56271b6d72f0 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3ab3fff640 1 -- 172.21.15.123:0/1697005509 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bcc020310 con 0x56271b6d72f0 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1697005509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 msgr2=0x56271b6d7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/1697005509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6d7710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc048aa0 tx=0x7f3bcc0165b0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1697005509 shutdown_connections 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/1697005509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6d7710 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1697005509 >> 172.21.15.123:0/1697005509 conn(0x56271b6d3680 msgr2=0x56271b6d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1697005509 shutdown_connections 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/1697005509 wait complete. 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 Processor -- start 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- start start 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271b6de5c0 con 0x56271b6d72f0 2024-03-20T13:36:58.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54128/0 (socket says 172.21.15.123:54128) 2024-03-20T13:36:58.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 learned_addr learned my addr 172.21.15.123:0/485651401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271b6cbaa0 con 0x56271b6d72f0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6de080 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc03e040 tx=0x7f3bcc048a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3ab27fc640 1 -- 172.21.15.123:0/485651401 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bcc022580 con 0x56271b6d72f0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56271b6de7c0 con 0x56271b6d72f0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3ab27fc640 1 -- 172.21.15.123:0/485651401 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc0206a0 con 0x56271b6d72f0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56271b6dec50 con 0x56271b6d72f0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.834+0000 7f3ab27fc640 1 -- 172.21.15.123:0/485651401 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bcc0209c0 con 0x56271b6d72f0 2024-03-20T13:36:58.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3ab27fc640 1 -- 172.21.15.123:0/485651401 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3bcc016a10 con 0x56271b6d72f0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3ab27fc640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3aa8034260 0x7f3aa8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3ab27fc640 1 -- 172.21.15.123:0/485651401 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3bcc036c60 con 0x56271b6d72f0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3aa8034260 0x7f3aa8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b6e9820 0x56271b6ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6ec430 con 0x56271b6e9820 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b6e9820 0x56271b6ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3aa8034260 0x7f3aa8036720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4047c80 tx=0x7f3bd403d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b6e9820 0x56271b6ebce0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3bd00aaa50 con 0x56271b6e9820 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 realm 2024-03-20T13:36:58.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6ec820 con 0x56271b6e9820 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3bd00aaa50 con 0x56271b6e9820 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6ed070 con 0x56271b6e9820 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3bd00aaa50 con 0x56271b6e9820 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6eda50 0x56271b6efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f0610 con 0x56271b6eda50 2024-03-20T13:36:58.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6eda50 0x56271b6efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.838+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6eda50 0x56271b6efea0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3bcc032070 con 0x56271b6eda50 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f0e10 con 0x56271b6eda50 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3bcc032070 con 0x56271b6eda50 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 20 searching for the correct realm 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56271b6f2e90 0x56271b6f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56271b6f2e90 0x56271b6f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc8d6640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56271b6f2e90 0x56271b6f5350 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc032070 con 0x56271b6eda50 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdd0d7640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3bcc035020 0x7f3bcc03a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3bcc035020 0x7f3bcc03a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3bcc035020 0x7f3bcc03a050 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00aaa50 con 0x7f3bcc035020 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.842+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc032070 con 0x56271b6eda50 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc032070 con 0x56271b6eda50 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x7f3bcc035020 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3bd00c7040 con 0x7f3bcc035020 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.846+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00c7040 con 0x56271b6e9820 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.850+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:58.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f2420 con 0x56271b6e9820 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f17f0 con 0x56271b6eda50 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f12f0 con 0x56271b6e9820 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 zone default found 2024-03-20T13:36:58.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 4 Realm: () 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 zonegroup default 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5e60 con 0x7f3bcc035020 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f8040 con 0x56271b6f2e90 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f83a0 con 0x56271b6f2e90 2024-03-20T13:36:58.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:58.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 started sync module instance, tier type = 2024-03-20T13:36:58.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:58.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.854+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f7610 con 0x56271b6eda50 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725964003824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f7610 con 0x56271b6eda50 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f8d10 con 0x56271b6e9820 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725964007536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f9510 con 0x56271b6e9820 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f9f00 con 0x56271b6eda50 2024-03-20T13:36:58.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.858+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725964003824] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725964007536] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725964012000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f9070 con 0x56271b6eda50 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fa750 con 0x7f3bcc035020 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725964014256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f9070 con 0x7f3bcc035020 2024-03-20T13:36:58.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fb210 con 0x56271b6eda50 2024-03-20T13:36:58.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.862+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725964014256] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725964012000] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725964001648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fb1d0 con 0x56271b6eda50 2024-03-20T13:36:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fba60 con 0x56271b6f2e90 2024-03-20T13:36:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725964019136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fb1d0 con 0x56271b6f2e90 2024-03-20T13:36:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fc870 con 0x56271b6f2e90 2024-03-20T13:36:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725964019136] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725964001648] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725964021184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fae20 con 0x56271b6f2e90 2024-03-20T13:36:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.866+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fd0c0 con 0x7f3bcc035020 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725964024864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fd4e0 con 0x7f3bcc035020 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=0 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=1 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=2 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=3 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=4 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=5 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725964021184] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=6 2024-03-20T13:36:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725964024864] v32'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 20 add_watcher() i=7 2024-03-20T13:36:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fd4e0 con 0x56271b6e9820 2024-03-20T13:36:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725964025920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fd460 con 0x56271b6e9820 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725964025920] v32'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.870+0000 7f3a92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 5 note: GC not initialized 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3a91fe3640 20 reqs_thread_entry: start 2024-03-20T13:36:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 20 Filter name: none 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 20 rados->read ofs=0 len=0 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3a037fe640 20 reqs_thread_entry: start 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b7223e0 con 0x56271b6e9820 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 20 rados_obj.operate() r=0 bl.length=621 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b728800 con 0x56271b6e9820 2024-03-20T13:36:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~539] v32'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94725964202688 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b724160 con 0x56271b6eda50 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94725964001648 notify 137438953484 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x56271b6dec50 con 0x56271b6eda50 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3ab3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94725964001648 notifier 4402 bl.length()=715 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 94725964202688 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3ab3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3ab3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.874+0000 7f3ab3fff640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3aa0003ea0 con 0x56271b6eda50 2024-03-20T13:36:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify_complete (2) cookie 94725964202688 notify 137438953484 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3bcc04e020 con 0x56271b6eda50 2024-03-20T13:36:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdedbb980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-03-20T13:36:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94725964202688 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b723cc0 con 0x56271b6eda50 2024-03-20T13:36:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify (1) cookie 94725964003824 notify 137438953485 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f3bcc069040 con 0x56271b6eda50 2024-03-20T13:36:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3ab3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94725964003824 notifier 4402 bl.length()=159 2024-03-20T13:36:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3ab3fff640 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3aa0004200 con 0x56271b6eda50 2024-03-20T13:36:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(66 notify.0 [notify cookie 94725964202688 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== watch-notify(notify_complete (2) cookie 94725964202688 notify 137438953485 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3bcc04e020 con 0x56271b6eda50 2024-03-20T13:36:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b7282c0 con 0x56271b6e9820 2024-03-20T13:36:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(68 foo:foo1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.885 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:58.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3a92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:58.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.878+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725964025920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b723c90 con 0x56271b6e9820 2024-03-20T13:36:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.882+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94725964025920] v32'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.882+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725964003824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6fd040 con 0x56271b6eda50 2024-03-20T13:36:58.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94725964003824] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdedbb980 20 remove_watcher() i=0 2024-03-20T13:36:58.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdedbb980 2 removed watcher, disabling cache 2024-03-20T13:36:58.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725964007536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6e9820 2024-03-20T13:36:58.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94725964007536] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x56271b6e9820 2024-03-20T13:36:58.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdedbb980 20 remove_watcher() i=1 2024-03-20T13:36:58.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.886+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725964012000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.890+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94725964012000] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.890+0000 7f3bdedbb980 20 remove_watcher() i=2 2024-03-20T13:36:58.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.890+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725964014256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.890+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94725964014256] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.890+0000 7f3bdedbb980 20 remove_watcher() i=3 2024-03-20T13:36:58.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.890+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725964001648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6eda50 2024-03-20T13:36:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.894+0000 7f3bdd0d7640 1 -- 172.21.15.123:0/485651401 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94725964001648] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bcc060040 con 0x56271b6eda50 2024-03-20T13:36:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.894+0000 7f3bdedbb980 20 remove_watcher() i=4 2024-03-20T13:36:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.894+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725964019136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.894+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94725964019136] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.894+0000 7f3bdedbb980 20 remove_watcher() i=5 2024-03-20T13:36:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.894+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725964021184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x56271b6f2e90 2024-03-20T13:36:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdc8d6640 1 -- 172.21.15.123:0/485651401 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94725964021184] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd4024020 con 0x56271b6f2e90 2024-03-20T13:36:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 20 remove_watcher() i=6 2024-03-20T13:36:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725964024864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56271b6f5a20 con 0x7f3bcc035020 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94725964024864] v32'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3bd00d4060 con 0x7f3bcc035020 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 20 remove_watcher() i=7 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6eda50 msgr2=0x56271b6efea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6eda50 0x56271b6efea0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b6e9820 msgr2=0x56271b6ebce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b6e9820 0x56271b6ebce0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3bcc035020 msgr2=0x7f3bcc03a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3bcc035020 0x7f3bcc03a050 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56271b6f2e90 msgr2=0x56271b6f5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56271b6f2e90 0x56271b6f5350 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3aa8034260 msgr2=0x7f3aa8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3aa8034260 0x7f3aa8036720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4047c80 tx=0x7f3bd403d000 comp rx=0 tx=0).stop 2024-03-20T13:36:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 msgr2=0x56271b6de080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdc0d5640 1 -- 172.21.15.123:0/485651401 reap_dead start 2024-03-20T13:36:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6de080 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc03e040 tx=0x7f3bcc048a00 comp rx=0 tx=0).stop 2024-03-20T13:36:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 shutdown_connections 2024-03-20T13:36:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/485651401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6d72f0 0x56271b6de080 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 >> 172.21.15.123:0/485651401 conn(0x56271b6d3680 msgr2=0x56271b6d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 shutdown_connections 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/485651401 wait complete. 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ab4034260 msgr2=0x7f3ab4036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ab4034260 0x7f3ab4036720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x56271b6ba8d0 tx=0x7f3bd4036040 comp rx=0 tx=0).stop 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 msgr2=0x56271b6ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 0x56271b6ca7c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00aae0 tx=0x7f3bcc008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 shutdown_connections 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ab4034260 0x7f3ab4036720 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/185603398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b6ca3a0 0x56271b6ca7c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 >> 172.21.15.123:0/185603398 conn(0x56271b6bf1b0 msgr2=0x56271b6bfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 shutdown_connections 2024-03-20T13:36:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/185603398 wait complete. 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6b7940 msgr2=0x56271b6b9d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6b7940 0x56271b6b9d30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b5c3860 msgr2=0x56271b6b6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b5c3860 0x56271b6b6b90 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ac40342b0 msgr2=0x7f3ac4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ac40342b0 0x7f3ac4036770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00ac000 tx=0x7f3bd00a5000 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 msgr2=0x56271b6aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6aff60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4001d60 tx=0x7f3bd4000f50 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 shutdown_connections 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56271b6b7940 0x56271b6b9d30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56271b5c3860 0x56271b6b6b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3ac40342b0 0x7f3ac4036770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 --2- 172.21.15.123:0/989750884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271b5bd5c0 0x56271b6aff60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 >> 172.21.15.123:0/989750884 conn(0x56271b5b6e60 msgr2=0x56271b6a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 shutdown_connections 2024-03-20T13:36:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.898+0000 7f3bdedbb980 1 -- 172.21.15.123:0/989750884 wait complete. 2024-03-20T13:36:58.915 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:58.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-03-20T13:36:58.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-03-20T13:36:58.915 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-03-20T13:36:58.991 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:58.991 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:58.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796c6ab980 1 Processor -- start 2024-03-20T13:36:58.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796c6ab980 1 -- start start 2024-03-20T13:36:58.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796c6ab980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560cf22c7e40 0x560cf22c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:58.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796c6ab980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560cf2215520 con 0x560cf22c8760 2024-03-20T13:36:58.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796c6ab980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x560cf21dc0f0 con 0x560cf22c7e40 2024-03-20T13:36:58.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796a1c6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560cf22c7e40 0x560cf22c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:58.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796a1c6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560cf22c7e40 0x560cf22c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54142/0 (socket says 172.21.15.123:54142) 2024-03-20T13:36:58.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796a1c6640 1 -- 172.21.15.123:0/704856085 learned_addr learned my addr 172.21.15.123:0/704856085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:58.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796a1c6640 1 -- 172.21.15.123:0/704856085 >> v1:172.21.15.89:6789/0 conn(0x560cf22c8760 legacy=0x560cf22c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.986+0000 7f796a1c6640 1 -- 172.21.15.123:0/704856085 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf22c9950 con 0x560cf22c7e40 2024-03-20T13:36:58.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796a1c6640 1 --2- 172.21.15.123:0/704856085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf22c8220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f796400a4e0 tx=0x7f796401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba484f5cd9accb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:58.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f79691c4640 1 -- 172.21.15.123:0/704856085 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79640aa540 con 0x560cf22c7e40 2024-03-20T13:36:58.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f79691c4640 1 -- 172.21.15.123:0/704856085 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640a6070 con 0x560cf22c7e40 2024-03-20T13:36:58.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f79691c4640 1 -- 172.21.15.123:0/704856085 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79640aa850 con 0x560cf22c7e40 2024-03-20T13:36:58.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 -- 172.21.15.123:0/704856085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 msgr2=0x560cf22c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:58.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 --2- 172.21.15.123:0/704856085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf22c8220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f796400a4e0 tx=0x7f796401b090 comp rx=0 tx=0).stop 2024-03-20T13:36:58.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 -- 172.21.15.123:0/704856085 shutdown_connections 2024-03-20T13:36:58.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 --2- 172.21.15.123:0/704856085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf22c8220 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:58.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 -- 172.21.15.123:0/704856085 >> 172.21.15.123:0/704856085 conn(0x560cf22c3710 msgr2=0x560cf22c5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:58.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 -- 172.21.15.123:0/704856085 shutdown_connections 2024-03-20T13:36:58.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:58.990+0000 7f796c6ab980 1 -- 172.21.15.123:0/704856085 wait complete. 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.002+0000 7f796c6ab980 1 Processor -- start 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.002+0000 7f796c6ab980 1 -- start start 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf21d9620 con 0x560cf22c7e40 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54148/0 (socket says 172.21.15.123:54148) 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 -- 172.21.15.123:0/4071406059 learned_addr learned my addr 172.21.15.123:0/4071406059 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 -- 172.21.15.123:0/4071406059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796400a1c0 con 0x560cf22c7e40 2024-03-20T13:36:59.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 --2- 172.21.15.123:0/4071406059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b2300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7964017ca0 tx=0x7f79640033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf328813a0406318 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f7858608640 1 -- 172.21.15.123:0/4071406059 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79640b7070 con 0x560cf22c7e40 2024-03-20T13:36:59.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f7858608640 1 -- 172.21.15.123:0/4071406059 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640b2740 con 0x560cf22c7e40 2024-03-20T13:36:59.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f7858608640 1 -- 172.21.15.123:0/4071406059 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79640b29e0 con 0x560cf22c7e40 2024-03-20T13:36:59.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- 172.21.15.123:0/4071406059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 msgr2=0x560cf23b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 --2- 172.21.15.123:0/4071406059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b2300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7964017ca0 tx=0x7f79640033b0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- 172.21.15.123:0/4071406059 shutdown_connections 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 --2- 172.21.15.123:0/4071406059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b2300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- 172.21.15.123:0/4071406059 >> 172.21.15.123:0/4071406059 conn(0x560cf22c3710 msgr2=0x560cf23ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- 172.21.15.123:0/4071406059 shutdown_connections 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- 172.21.15.123:0/4071406059 wait complete. 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 Processor -- start 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- start start 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796c6ab980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf21d4e00 con 0x560cf22c7e40 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54152/0 (socket says 172.21.15.123:54152) 2024-03-20T13:36:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 -- 172.21.15.123:0/3095495118 learned_addr learned my addr 172.21.15.123:0/3095495118 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf22c9950 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.006+0000 7f796a1c6640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b7f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7964017ca0 tx=0x7f7964017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f7856e05640 1 -- 172.21.15.123:0/3095495118 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79640b2c40 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560cf23b8480 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f7856e05640 1 -- 172.21.15.123:0/3095495118 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640b2da0 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f7856e05640 1 -- 172.21.15.123:0/3095495118 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79640c65a0 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf23b88b0 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f7856e05640 1 -- 172.21.15.123:0/3095495118 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79640c4040 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f7856e05640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78500342b0 0x7f7850036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f7856e05640 1 -- 172.21.15.123:0/3095495118 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f79640e4f20 con 0x560cf22c7e40 2024-03-20T13:36:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f79699c5640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78500342b0 0x7f7850036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf22c8760 0x560cf23bebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23bf100 con 0x560cf22c8760 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796a9c7640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf22c8760 0x560cf23bebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f79699c5640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78500342b0 0x7f7850036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7954001e20 tx=0x7f79540013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796a9c7640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf22c8760 0x560cf23bebc0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796a9c7640 1 -- 172.21.15.123:0/3095495118 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f795c0083f0 con 0x560cf22c8760 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23bf970 0x560cf23c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23c23e0 con 0x560cf23bf970 2024-03-20T13:36:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796a1c6640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23bf970 0x560cf23c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796a1c6640 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23bf970 0x560cf23c1d60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.010+0000 7f796a1c6640 1 -- 172.21.15.123:0/3095495118 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23bf970 2024-03-20T13:36:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23c3c40 con 0x560cf23bf970 2024-03-20T13:36:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a1c6640 1 -- 172.21.15.123:0/3095495118 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23bf970 2024-03-20T13:36:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23c2e40 con 0x560cf23bf970 2024-03-20T13:36:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a1c6640 1 -- 172.21.15.123:0/3095495118 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23bf970 2024-03-20T13:36:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23c3250 con 0x560cf22c8760 2024-03-20T13:36:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a9c7640 1 -- 172.21.15.123:0/3095495118 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f795c0083f0 con 0x560cf22c8760 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 Processor -- start 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- start start 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 0x560cf23d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf216de30 con 0x560cf23d23d0 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a9c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 0x560cf23d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a9c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 0x560cf23d27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54158/0 (socket says 172.21.15.123:54158) 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a9c7640 1 -- 172.21.15.123:0/1503893854 learned_addr learned my addr 172.21.15.123:0/1503893854 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a9c7640 1 -- 172.21.15.123:0/1503893854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf23d2d30 con 0x560cf23d23d0 2024-03-20T13:36:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796a9c7640 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 0x560cf23d27f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f795c00aae0 tx=0x7f795c008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f784ffff640 1 -- 172.21.15.123:0/1503893854 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795c01d070 con 0x560cf23d23d0 2024-03-20T13:36:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f784ffff640 1 -- 172.21.15.123:0/1503893854 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c010040 con 0x560cf23d23d0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560cf23d2f80 con 0x560cf23d23d0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f784ffff640 1 -- 172.21.15.123:0/1503893854 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795c007e70 con 0x560cf23d23d0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.014+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf23d3ad0 con 0x560cf23d23d0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f784ffff640 1 -- 172.21.15.123:0/1503893854 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f795c018430 con 0x560cf23d23d0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f784ffff640 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78440342b0 0x7f7844036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f784ffff640 1 -- 172.21.15.123:0/1503893854 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f795c04a640 con 0x560cf23d23d0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a1c6640 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78440342b0 0x7f7844036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 Processor -- start 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- start start 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a1c6640 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78440342b0 0x7f7844036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x560cf23c2880 tx=0x7f79640b2f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23df7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf2161790 con 0x560cf23df390 2024-03-20T13:36:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a9c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23df7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a9c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23df7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54172/0 (socket says 172.21.15.123:54172) 2024-03-20T13:36:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a9c7640 1 -- 172.21.15.123:0/3837857616 learned_addr learned my addr 172.21.15.123:0/3837857616 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a9c7640 1 -- 172.21.15.123:0/3837857616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf23dfd80 con 0x560cf23df390 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796a9c7640 1 --2- 172.21.15.123:0/3837857616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23df7b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f795c048a30 tx=0x7f795c021830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c7b21145d9cd2c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f784dffb640 1 -- 172.21.15.123:0/3837857616 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795c047070 con 0x560cf23df390 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f784dffb640 1 -- 172.21.15.123:0/3837857616 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c016330 con 0x560cf23df390 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f784dffb640 1 -- 172.21.15.123:0/3837857616 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795c0225f0 con 0x560cf23df390 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- 172.21.15.123:0/3837857616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 msgr2=0x560cf23df7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3837857616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23df7b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f795c048a30 tx=0x7f795c021830 comp rx=0 tx=0).stop 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- 172.21.15.123:0/3837857616 shutdown_connections 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3837857616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23df7b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- 172.21.15.123:0/3837857616 >> 172.21.15.123:0/3837857616 conn(0x560cf23db6d0 msgr2=0x560cf23d9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- 172.21.15.123:0/3837857616 shutdown_connections 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- 172.21.15.123:0/3837857616 wait complete. 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 Processor -- start 2024-03-20T13:36:59.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- start start 2024-03-20T13:36:59.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.018+0000 7f796c6ab980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf23e6740 con 0x560cf23df390 2024-03-20T13:36:59.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a9c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a9c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54188/0 (socket says 172.21.15.123:54188) 2024-03-20T13:36:59.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 learned_addr learned my addr 172.21.15.123:0/2794413860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf23d3ad0 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a9c7640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23e6200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f795c0077a0 tx=0x7f795c0489c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f783bfff640 1 -- 172.21.15.123:0/2794413860 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795c048e90 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560cf23e6940 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f783bfff640 1 -- 172.21.15.123:0/2794413860 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c016a90 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f783bfff640 1 -- 172.21.15.123:0/2794413860 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795c021a30 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf23e6dd0 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f783bfff640 1 -- 172.21.15.123:0/2794413860 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f795c021b90 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f783bfff640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78340342b0 0x7f7834036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f783bfff640 1 -- 172.21.15.123:0/2794413860 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f795c030970 con 0x560cf23df390 2024-03-20T13:36:59.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a1c6640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78340342b0 0x7f7834036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf23f1960 0x560cf23f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f4550 con 0x560cf23f1960 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f79699c5640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf23f1960 0x560cf23f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796a1c6640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78340342b0 0x7f7834036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79640b7f90 tx=0x7f79640db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f79699c5640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf23f1960 0x560cf23f3e00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 20 realm 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f0e80 con 0x560cf23f1960 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f4fd0 con 0x560cf23f1960 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.022+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23f5d60 0x560cf23f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f8820 con 0x560cf23f5d60 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23f5d60 0x560cf23f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23f5d60 0x560cf23f8150 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f9020 con 0x560cf23f5d60 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 20 searching for the correct realm 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560cf23fafa0 0x560cf23fd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a1c6640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560cf23fafa0 0x560cf23fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a1c6640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560cf23fafa0 0x560cf23fd460 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f795c037030 0x7f795c039880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.026+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x7f795c037030 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f795c037030 0x7f795c039880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f795c037030 0x7f795c039880 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x7f795c037030 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x7f795c037030 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x7f795c037030 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x7f795c037030 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f79540105b0 con 0x7f795c037030 2024-03-20T13:36:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.030+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79540105b0 con 0x560cf23f1960 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x7f795c037030 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f1960 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x7f795c037030 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.034+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x7f795c037030 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23fafa0 2024-03-20T13:36:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fdb30 con 0x560cf23f5d60 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fa550 con 0x560cf23f1960 2024-03-20T13:36:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.038+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f9970 con 0x560cf23f5d60 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23f9d90 con 0x560cf23f1960 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 zone default found 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 4 Realm: () 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 zonegroup default 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fe410 con 0x7f795c037030 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fe090 con 0x560cf23fafa0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24006e0 con 0x560cf23fafa0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 started sync module instance, tier type = 2024-03-20T13:36:59.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:59.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23ffbc0 con 0x560cf23f5d60 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94613603876768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23ffbc0 con 0x560cf23f5d60 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.042+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2401170 con 0x560cf23f1960 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.046+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.046+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94613603880048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2401130 con 0x560cf23f1960 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.046+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2402070 con 0x560cf23f5d60 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.046+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94613603880048] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.046+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94613603876768] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.050+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.050+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94613603874592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2402070 con 0x560cf23f5d60 2024-03-20T13:36:59.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.050+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2401690 con 0x7f795c037030 2024-03-20T13:36:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.050+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.050+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94613603886112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2401690 con 0x7f795c037030 2024-03-20T13:36:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.050+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24033e0 con 0x560cf23f5d60 2024-03-20T13:36:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.058+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94613603874592] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94613603886112] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94613603887168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24033e0 con 0x560cf23f5d60 2024-03-20T13:36:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2403790 con 0x560cf23fafa0 2024-03-20T13:36:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94613603888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2403fe0 con 0x560cf23fafa0 2024-03-20T13:36:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.062+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24049b0 con 0x560cf23fafa0 2024-03-20T13:36:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.066+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94613603888848] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.066+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94613603887168] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.066+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.066+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94613603883920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2403b40 con 0x560cf23fafa0 2024-03-20T13:36:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.066+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2405200 con 0x7f795c037030 2024-03-20T13:36:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94613603883920] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94613603894448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2405200 con 0x7f795c037030 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=0 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=1 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=2 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=3 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=4 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=5 2024-03-20T13:36:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=6 2024-03-20T13:36:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94613603894448] v32'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 20 add_watcher() i=7 2024-03-20T13:36:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2408620 con 0x560cf23f1960 2024-03-20T13:36:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.070+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94613603897136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2405b00 con 0x560cf23f1960 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94613603897136] v32'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f7820fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 5 note: GC not initialized 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f779b7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 20 Filter name: none 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f77997fa640 20 reqs_thread_entry: start 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf242e9c0 con 0x560cf23f1960 2024-03-20T13:36:59.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+662 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 20 rados_obj.operate() r=0 bl.length=539 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.074+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2434b70 con 0x560cf23f1960 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v32'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796c6ab980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796c6ab980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796c6ab980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:59.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94613604091376 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2430420 con 0x560cf23f5d60 2024-03-20T13:36:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94613603887168 notify 137438953486 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x560cf23e6dd0 con 0x560cf23f5d60 2024-03-20T13:36:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f784dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94613603887168 notifier 4409 bl.length()=689 2024-03-20T13:36:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 94613604091376 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f784dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f784dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:59.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f784dffb640 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f7830003ea0 con 0x560cf23f5d60 2024-03-20T13:36:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify_complete (2) cookie 94613604091376 notify 137438953486 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f795c04f070 con 0x560cf23f5d60 2024-03-20T13:36:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.085 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f7820fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.078+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94613603897136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf242ff80 con 0x560cf23f1960 2024-03-20T13:36:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.082+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94613603897136] v32'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.082+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94613603876768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2430ae0 con 0x560cf23f5d60 2024-03-20T13:36:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94613603876768] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f796c6ab980 20 remove_watcher() i=0 2024-03-20T13:36:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f796c6ab980 2 removed watcher, disabling cache 2024-03-20T13:36:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94613603880048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fffa0 con 0x560cf23f1960 2024-03-20T13:36:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94613603880048] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x560cf23f1960 2024-03-20T13:36:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f796c6ab980 20 remove_watcher() i=1 2024-03-20T13:36:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.086+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94613603874592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fffa0 con 0x560cf23f5d60 2024-03-20T13:36:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.090+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94613603874592] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.090+0000 7f796c6ab980 20 remove_watcher() i=2 2024-03-20T13:36:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.090+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94613603886112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fffa0 con 0x7f795c037030 2024-03-20T13:36:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.090+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94613603886112] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.090+0000 7f796c6ab980 20 remove_watcher() i=3 2024-03-20T13:36:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.090+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94613603887168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2402420 con 0x560cf23f5d60 2024-03-20T13:36:59.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796a9c7640 1 -- 172.21.15.123:0/2794413860 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94613603887168] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f795c01f070 con 0x560cf23f5d60 2024-03-20T13:36:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 20 remove_watcher() i=4 2024-03-20T13:36:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94613603888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fffa0 con 0x560cf23fafa0 2024-03-20T13:36:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94613603888848] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 20 remove_watcher() i=5 2024-03-20T13:36:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94613603883920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fffa0 con 0x560cf23fafa0 2024-03-20T13:36:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796a1c6640 1 -- 172.21.15.123:0/2794413860 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94613603883920] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79640a93c0 con 0x560cf23fafa0 2024-03-20T13:36:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 20 remove_watcher() i=6 2024-03-20T13:36:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94613603894448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf23fffa0 con 0x7f795c037030 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94613603894448] v32'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7954028040 con 0x7f795c037030 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 20 remove_watcher() i=7 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23f5d60 msgr2=0x560cf23f8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23f5d60 0x560cf23f8150 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf23f1960 msgr2=0x560cf23f3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf23f1960 0x560cf23f3e00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f795c037030 msgr2=0x7f795c039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f795c037030 0x7f795c039880 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560cf23fafa0 msgr2=0x560cf23fd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560cf23fafa0 0x560cf23fd460 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78340342b0 msgr2=0x7f7834036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78340342b0 0x7f7834036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79640b7f90 tx=0x7f79640db000 comp rx=0 tx=0).stop 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f79699c5640 1 -- 172.21.15.123:0/2794413860 reap_dead start 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 msgr2=0x560cf23e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23e6200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f795c0077a0 tx=0x7f795c0489c0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 shutdown_connections 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 --2- 172.21.15.123:0/2794413860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23df390 0x560cf23e6200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 >> 172.21.15.123:0/2794413860 conn(0x560cf23db6d0 msgr2=0x560cf23d8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 shutdown_connections 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.098+0000 7f796c6ab980 1 -- 172.21.15.123:0/2794413860 wait complete. 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78440342b0 msgr2=0x7f7844036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78440342b0 0x7f7844036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x560cf23c2880 tx=0x7f79640b2f10 comp rx=0 tx=0).stop 2024-03-20T13:36:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 msgr2=0x560cf23d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 0x560cf23d27f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f795c00aae0 tx=0x7f795c008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 shutdown_connections 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78440342b0 0x7f7844036770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/1503893854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf23d23d0 0x560cf23d27f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 >> 172.21.15.123:0/1503893854 conn(0x560cf23c71e0 msgr2=0x560cf23c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 shutdown_connections 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/1503893854 wait complete. 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23bf970 msgr2=0x560cf23c1d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23bf970 0x560cf23c1d60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf22c8760 msgr2=0x560cf23bebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf22c8760 0x560cf23bebc0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78500342b0 msgr2=0x7f7850036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78500342b0 0x7f7850036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7954001e20 tx=0x7f79540013a0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 msgr2=0x560cf23b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b7f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7964017ca0 tx=0x7f7964017e30 comp rx=0 tx=0).stop 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 shutdown_connections 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560cf23bf970 0x560cf23c1d60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560cf22c8760 0x560cf23bebc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f78500342b0 0x7f7850036770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 --2- 172.21.15.123:0/3095495118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cf22c7e40 0x560cf23b7f40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 >> 172.21.15.123:0/3095495118 conn(0x560cf22c3710 msgr2=0x560cf23ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 shutdown_connections 2024-03-20T13:36:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.102+0000 7f796c6ab980 1 -- 172.21.15.123:0/3095495118 wait complete. 2024-03-20T13:36:59.117 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:59.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-03-20T13:36:59.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-03-20T13:36:59.117 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-03-20T13:36:59.193 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:59.194 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:59.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec93079980 1 Processor -- start 2024-03-20T13:36:59.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec93079980 1 -- start start 2024-03-20T13:36:59.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec93079980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c382fed850 0x55c38307bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec93079980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c382fc54c0 con 0x55c38307c110 2024-03-20T13:36:59.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec93079980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c382f8c0f0 con 0x55c382fed850 2024-03-20T13:36:59.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec90b94640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c382fed850 0x55c38307bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec90b94640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c382fed850 0x55c38307bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54192/0 (socket says 172.21.15.123:54192) 2024-03-20T13:36:59.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec90393640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55c38307c110 0x55c38307e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59064/0 (socket says 172.21.15.123:59064) 2024-03-20T13:36:59.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec90b94640 1 -- 172.21.15.123:0/3214623961 learned_addr learned my addr 172.21.15.123:0/3214623961 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec90b94640 1 -- 172.21.15.123:0/3214623961 >> v1:172.21.15.89:6789/0 conn(0x55c38307c110 legacy=0x55c38307e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.190+0000 7fec90b94640 1 -- 172.21.15.123:0/3214623961 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c383080c60 con 0x55c382fed850 2024-03-20T13:36:59.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec90b94640 1 --2- 172.21.15.123:0/3214623961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c38307bbd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec8000a5c0 tx=0x7fec8001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1494e78e25c327 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec8fb92640 1 -- 172.21.15.123:0/3214623961 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec800aa470 con 0x55c382fed850 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec8fb92640 1 -- 172.21.15.123:0/3214623961 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800aa5d0 con 0x55c382fed850 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec8fb92640 1 -- 172.21.15.123:0/3214623961 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec800aa890 con 0x55c382fed850 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 -- 172.21.15.123:0/3214623961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 msgr2=0x55c38307bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 --2- 172.21.15.123:0/3214623961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c38307bbd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec8000a5c0 tx=0x7fec8001b340 comp rx=0 tx=0).stop 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 -- 172.21.15.123:0/3214623961 shutdown_connections 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 --2- 172.21.15.123:0/3214623961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c38307bbd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 -- 172.21.15.123:0/3214623961 >> 172.21.15.123:0/3214623961 conn(0x55c3830736b0 msgr2=0x55c383075ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 -- 172.21.15.123:0/3214623961 shutdown_connections 2024-03-20T13:36:59.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.194+0000 7fec93079980 1 -- 172.21.15.123:0/3214623961 wait complete. 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.206+0000 7fec93079980 1 Processor -- start 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.206+0000 7fec93079980 1 -- start start 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.206+0000 7fec93079980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383162e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.206+0000 7fec93079980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c382f89620 con 0x55c382fed850 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.206+0000 7fec90b94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383162e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54196/0 (socket says 172.21.15.123:54196) 2024-03-20T13:36:59.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 -- 172.21.15.123:0/3645554873 learned_addr learned my addr 172.21.15.123:0/3645554873 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 -- 172.21.15.123:0/3645554873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80005df0 con 0x55c382fed850 2024-03-20T13:36:59.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 --2- 172.21.15.123:0/3645554873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383162e50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fec80018f70 tx=0x7fec80003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713ddf0c65079b84 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7feb7ee0d640 1 -- 172.21.15.123:0/3645554873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec800aa9c0 con 0x55c382fed850 2024-03-20T13:36:59.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7feb7ee0d640 1 -- 172.21.15.123:0/3645554873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800aab20 con 0x55c382fed850 2024-03-20T13:36:59.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7feb7ee0d640 1 -- 172.21.15.123:0/3645554873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec800aadc0 con 0x55c382fed850 2024-03-20T13:36:59.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/3645554873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 msgr2=0x55c383162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 --2- 172.21.15.123:0/3645554873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383162e50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fec80018f70 tx=0x7fec80003030 comp rx=0 tx=0).stop 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/3645554873 shutdown_connections 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 --2- 172.21.15.123:0/3645554873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383162e50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/3645554873 >> 172.21.15.123:0/3645554873 conn(0x55c3830736b0 msgr2=0x55c38315e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/3645554873 shutdown_connections 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/3645554873 wait complete. 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 Processor -- start 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- start start 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c382f84e00 con 0x55c382fed850 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383169c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54206/0 (socket says 172.21.15.123:54206) 2024-03-20T13:36:59.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 -- 172.21.15.123:0/2894799081 learned_addr learned my addr 172.21.15.123:0/2894799081 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c383080c60 con 0x55c382fed850 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec90b94640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383169c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec80018f70 tx=0x7fec800180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7feb7d60a640 1 -- 172.21.15.123:0/2894799081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec800cb070 con 0x55c382fed850 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7feb7d60a640 1 -- 172.21.15.123:0/2894799081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800bd810 con 0x55c382fed850 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c38316a140 con 0x55c382fed850 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7feb7d60a640 1 -- 172.21.15.123:0/2894799081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec800bdab0 con 0x55c382fed850 2024-03-20T13:36:59.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.210+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c38316a510 con 0x55c382fed850 2024-03-20T13:36:59.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7feb7d60a640 1 -- 172.21.15.123:0/2894799081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fec800bdce0 con 0x55c382fed850 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7feb7d60a640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb780342b0 0x7feb78036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7feb7d60a640 1 -- 172.21.15.123:0/2894799081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fec800e4a10 con 0x55c382fed850 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec90393640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb780342b0 0x7feb78036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c38307c110 0x55c383170880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c383170dc0 con 0x55c38307c110 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec91395640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c38307c110 0x55c383170880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec91395640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c38307c110 0x55c383170880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec90393640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb780342b0 0x7feb78036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec84000f70 tx=0x7fec84001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec91395640 1 -- 172.21.15.123:0/2894799081 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c38307c110 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c383171630 0x55c383173a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c383174080 con 0x55c383171630 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec90b94640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c383171630 0x55c383173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec90b94640 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c383171630 0x55c383173a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec90b94640 1 -- 172.21.15.123:0/2894799081 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fec800cd070 con 0x55c383171630 2024-03-20T13:36:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.214+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831758c0 con 0x55c383171630 2024-03-20T13:36:59.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec90b94640 1 -- 172.21.15.123:0/2894799081 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fec800cd070 con 0x55c383171630 2024-03-20T13:36:59.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831749d0 con 0x55c383171630 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec90b94640 1 -- 172.21.15.123:0/2894799081 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fec800cd070 con 0x55c383171630 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c383174d80 con 0x55c38307c110 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec91395640 1 -- 172.21.15.123:0/2894799081 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c38307c110 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 Processor -- start 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 -- start start 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 0x55c383077bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c382f1de30 con 0x55c383079710 2024-03-20T13:36:59.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec91395640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 0x55c383077bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec91395640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 0x55c383077bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54218/0 (socket says 172.21.15.123:54218) 2024-03-20T13:36:59.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec91395640 1 -- 172.21.15.123:0/2050441573 learned_addr learned my addr 172.21.15.123:0/2050441573 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec91395640 1 -- 172.21.15.123:0/2050441573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3830780f0 con 0x55c383079710 2024-03-20T13:36:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec91395640 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 0x55c383077bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec88016cf0 tx=0x7fec8800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7feb767fc640 1 -- 172.21.15.123:0/2050441573 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec88017660 con 0x55c383079710 2024-03-20T13:36:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7feb767fc640 1 -- 172.21.15.123:0/2050441573 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec880177c0 con 0x55c383079710 2024-03-20T13:36:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c3830783a0 con 0x55c383079710 2024-03-20T13:36:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7feb767fc640 1 -- 172.21.15.123:0/2050441573 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec88017a60 con 0x55c383079710 2024-03-20T13:36:59.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.218+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c383078830 con 0x55c383079710 2024-03-20T13:36:59.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7feb767fc640 1 -- 172.21.15.123:0/2050441573 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fec8801d020 con 0x55c383079710 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7feb767fc640 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb680342b0 0x7feb68036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7feb767fc640 1 -- 172.21.15.123:0/2050441573 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fec8804b6b0 con 0x55c383079710 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec90b94640 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb680342b0 0x7feb68036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 Processor -- start 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- start start 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec90b94640 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb680342b0 0x7feb68036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55c3831744d0 tx=0x7fec800e2e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c383193700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c382f11790 con 0x55c3831932e0 2024-03-20T13:36:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec91395640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c383193700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec91395640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c383193700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54226/0 (socket says 172.21.15.123:54226) 2024-03-20T13:36:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec91395640 1 -- 172.21.15.123:0/2307848950 learned_addr learned my addr 172.21.15.123:0/2307848950 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec91395640 1 -- 172.21.15.123:0/2307848950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c383193cd0 con 0x55c3831932e0 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec91395640 1 --2- 172.21.15.123:0/2307848950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c383193700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec88049ad0 tx=0x7fec88013500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479ece657786e9e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7feb67fff640 1 -- 172.21.15.123:0/2307848950 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec88020550 con 0x55c3831932e0 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7feb67fff640 1 -- 172.21.15.123:0/2307848950 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec880293a0 con 0x55c3831932e0 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7feb67fff640 1 -- 172.21.15.123:0/2307848950 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec8801fcd0 con 0x55c3831932e0 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- 172.21.15.123:0/2307848950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 msgr2=0x55c383193700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 --2- 172.21.15.123:0/2307848950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c383193700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec88049ad0 tx=0x7fec88013500 comp rx=0 tx=0).stop 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- 172.21.15.123:0/2307848950 shutdown_connections 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 --2- 172.21.15.123:0/2307848950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c383193700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- 172.21.15.123:0/2307848950 >> 172.21.15.123:0/2307848950 conn(0x55c38318f670 msgr2=0x55c38318d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- 172.21.15.123:0/2307848950 shutdown_connections 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- 172.21.15.123:0/2307848950 wait complete. 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 Processor -- start 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.222+0000 7fec93079980 1 -- start start 2024-03-20T13:36:59.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c38319a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38319a670 con 0x55c3831932e0 2024-03-20T13:36:59.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec91395640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c38319a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec91395640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c38319a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54228/0 (socket says 172.21.15.123:54228) 2024-03-20T13:36:59.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 learned_addr learned my addr 172.21.15.123:0/328526073 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c383078830 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec91395640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c38319a130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fec88011e80 tx=0x7fec88049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7feb667fc640 1 -- 172.21.15.123:0/328526073 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec88031070 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c38319a870 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7feb667fc640 1 -- 172.21.15.123:0/328526073 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88029510 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7feb667fc640 1 -- 172.21.15.123:0/328526073 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec88017bc0 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c38319aca0 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7feb667fc640 1 -- 172.21.15.123:0/328526073 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fec88017d20 con 0x55c3831932e0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7feb667fc640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb5c0342b0 0x7feb5c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7feb667fc640 1 -- 172.21.15.123:0/328526073 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fec88002390 con 0x55c3831932e0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec90b94640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb5c0342b0 0x7feb5c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c3831a5850 0x55c3831a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831a8440 con 0x55c3831a5850 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec90393640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c3831a5850 0x55c3831a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec90b94640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb5c0342b0 0x7feb5c036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec800e4c80 tx=0x7fec800e7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec90393640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c3831a5850 0x55c3831a7cf0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 20 realm 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831a4d70 con 0x55c3831a5850 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:59.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.226+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831a8ec0 con 0x55c3831a5850 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c3831a9a60 0x55c3831abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831ac690 con 0x55c3831a9a60 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c3831a9a60 0x55c3831abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c3831a9a60 0x55c3831abf20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831ace90 con 0x55c3831a9a60 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 20 searching for the correct realm 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c3831aee90 0x55c3831b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831aee90 2024-03-20T13:36:59.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec90b94640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c3831aee90 0x55c3831b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec90b94640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c3831aee90 0x55c3831b1350 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a9a60 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fec88007be0 0x7fec8801e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.230+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x7fec88007be0 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fec88007be0 0x7fec8801e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fec88007be0 0x7fec8801e560 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a5850 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a5850 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831aee90 2024-03-20T13:36:59.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a5850 2024-03-20T13:36:59.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a9a60 2024-03-20T13:36:59.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a9a60 2024-03-20T13:36:59.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a5850 2024-03-20T13:36:59.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x7fec88007be0 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b1a20 con 0x55c3831a5850 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x7fec88007be0 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.234+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a9a60 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831aee90 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a5850 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a9a60 2024-03-20T13:36:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831aee90 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a5850 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a5850 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a5850 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831aee90 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x7fec88007be0 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a5850 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x7fec88007be0 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831aee90 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.238+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x7fec88007be0 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a9a60 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a9a60 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831aee90 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a9a60 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fec8402d080 con 0x55c3831a9a60 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831ae3f0 con 0x55c3831a5850 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831ad370 con 0x55c3831a9a60 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.242+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831ad380 con 0x55c3831a5850 2024-03-20T13:36:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 zone default found 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 4 Realm: () 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 zonegroup default 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831aded0 con 0x7fec88007be0 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b3f20 con 0x55c3831aee90 2024-03-20T13:36:59.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b4350 con 0x55c3831aee90 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 started sync module instance, tier type = 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b3240 con 0x55c3831a9a60 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298206580128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b35f0 con 0x55c3831a9a60 2024-03-20T13:36:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.246+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b5090 con 0x55c3831a5850 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298206587888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b55b0 con 0x55c3831a5850 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b6080 con 0x55c3831a9a60 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298206580128] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298206587888] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298206591840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b6040 con 0x55c3831a9a60 2024-03-20T13:36:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.250+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b51c0 con 0x7fec88007be0 2024-03-20T13:36:59.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.254+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.254+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298206594096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b6cf0 con 0x7fec88007be0 2024-03-20T13:36:59.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.254+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b76d0 con 0x55c3831a9a60 2024-03-20T13:36:59.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.258+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298206591840] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298206594096] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298206586704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b6850 con 0x55c3831a9a60 2024-03-20T13:36:59.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b7f50 con 0x55c3831aee90 2024-03-20T13:36:59.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298206599856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b6850 con 0x55c3831aee90 2024-03-20T13:36:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b8980 con 0x55c3831aee90 2024-03-20T13:36:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298206586704] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.262+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298206599856] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298206600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b84e0 con 0x55c3831aee90 2024-03-20T13:36:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b9200 con 0x7fec88007be0 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298206600912] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298206604640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b9620 con 0x7fec88007be0 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=0 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=1 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=2 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=3 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=4 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=5 2024-03-20T13:36:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=6 2024-03-20T13:36:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298206604640] v32'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 20 add_watcher() i=7 2024-03-20T13:36:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.266+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831bc2d0 con 0x55c3831a5850 2024-03-20T13:36:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298206597616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b9620 con 0x55c3831a5850 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298206597616] v32'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7feb477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 5 note: GC not initialized 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7feb467e4640 20 reqs_thread_entry: start 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 20 Filter name: none 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7feb3ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831de1f0 con 0x55c3831a5850 2024-03-20T13:36:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:36:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.270+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831e41c0 con 0x55c3831a5850 2024-03-20T13:36:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v32'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec93079980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec93079980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec93079980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94298206780512 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831e0d10 con 0x55c3831a9a60 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94298206586704 notify 137438953487 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55c38319aca0 con 0x55c3831a9a60 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7feb67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94298206586704 notifier 4416 bl.length()=533 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 94298206780512 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7feb67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7feb67fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7feb67fff640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7feb54003ea0 con 0x55c3831a9a60 2024-03-20T13:36:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94298206780512 notify 137438953487 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fec8806f040 con 0x55c3831a9a60 2024-03-20T13:36:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec93079980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-03-20T13:36:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94298206780512 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831e0d10 con 0x55c3831a9a60 2024-03-20T13:36:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify (1) cookie 94298206580128 notify 137438953488 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7fec8806f040 con 0x55c3831a9a60 2024-03-20T13:36:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7feb67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94298206580128 notifier 4416 bl.length()=159 2024-03-20T13:36:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(66 notify.0 [notify cookie 94298206780512 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7feb67fff640 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7feb54003ea0 con 0x55c3831a9a60 2024-03-20T13:36:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.274+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== watch-notify(notify_complete (2) cookie 94298206780512 notify 137438953488 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fec88050070 con 0x55c3831a9a60 2024-03-20T13:36:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831e0d10 con 0x7fec88007be0 2024-03-20T13:36:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 foo:foo2 [delete] v32'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.283 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7feb477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298206597616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831be630 con 0x55c3831a5850 2024-03-20T13:36:59.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94298206597616] v32'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.278+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298206580128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b71f0 con 0x55c3831a9a60 2024-03-20T13:36:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94298206580128] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec93079980 20 remove_watcher() i=0 2024-03-20T13:36:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec93079980 2 removed watcher, disabling cache 2024-03-20T13:36:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298206587888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b71f0 con 0x55c3831a5850 2024-03-20T13:36:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94298206587888] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x55c3831a5850 2024-03-20T13:36:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec93079980 20 remove_watcher() i=1 2024-03-20T13:36:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.282+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298206591840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b4bf0 con 0x55c3831a9a60 2024-03-20T13:36:59.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.286+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94298206591840] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.286+0000 7fec93079980 20 remove_watcher() i=2 2024-03-20T13:36:59.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.286+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298206594096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b71f0 con 0x7fec88007be0 2024-03-20T13:36:59.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.286+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94298206594096] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.286+0000 7fec93079980 20 remove_watcher() i=3 2024-03-20T13:36:59.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.286+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298206586704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b6430 con 0x55c3831a9a60 2024-03-20T13:36:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec91395640 1 -- 172.21.15.123:0/328526073 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94298206586704] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8800a4d0 con 0x55c3831a9a60 2024-03-20T13:36:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 20 remove_watcher() i=4 2024-03-20T13:36:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298206599856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b71f0 con 0x55c3831aee90 2024-03-20T13:36:59.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94298206599856] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 20 remove_watcher() i=5 2024-03-20T13:36:59.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298206600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b71f0 con 0x55c3831aee90 2024-03-20T13:36:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec90b94640 1 -- 172.21.15.123:0/328526073 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94298206600912] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec800cd070 con 0x55c3831aee90 2024-03-20T13:36:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 20 remove_watcher() i=6 2024-03-20T13:36:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298206604640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c3831b71f0 con 0x7fec88007be0 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94298206604640] v32'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec8400f5d0 con 0x7fec88007be0 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 20 remove_watcher() i=7 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c3831a9a60 msgr2=0x55c3831abf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c3831a9a60 0x55c3831abf20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c3831a5850 msgr2=0x55c3831a7cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c3831a5850 0x55c3831a7cf0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fec88007be0 msgr2=0x7fec8801e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fec88007be0 0x7fec8801e560 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c3831aee90 msgr2=0x55c3831b1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c3831aee90 0x55c3831b1350 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb5c0342b0 msgr2=0x7feb5c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb5c0342b0 0x7feb5c036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec800e4c80 tx=0x7fec800e7000 comp rx=0 tx=0).stop 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 msgr2=0x55c38319a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec90393640 1 -- 172.21.15.123:0/328526073 reap_dead start 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c38319a130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fec88011e80 tx=0x7fec88049a30 comp rx=0 tx=0).stop 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 shutdown_connections 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/328526073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c3831932e0 0x55c38319a130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 >> 172.21.15.123:0/328526073 conn(0x55c38318f670 msgr2=0x55c38318ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 shutdown_connections 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/328526073 wait complete. 2024-03-20T13:36:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb680342b0 msgr2=0x7feb68036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb680342b0 0x7feb68036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55c3831744d0 tx=0x7fec800e2e50 comp rx=0 tx=0).stop 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 msgr2=0x55c383077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 0x55c383077bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec88016cf0 tx=0x7fec8800d790 comp rx=0 tx=0).stop 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 shutdown_connections 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb680342b0 0x7feb68036770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 --2- 172.21.15.123:0/2050441573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c383079710 0x55c383077bb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 >> 172.21.15.123:0/2050441573 conn(0x55c383178d90 msgr2=0x55c3831798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 shutdown_connections 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.290+0000 7fec93079980 1 -- 172.21.15.123:0/2050441573 wait complete. 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c383171630 msgr2=0x55c383173a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c383171630 0x55c383173a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c38307c110 msgr2=0x55c383170880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c38307c110 0x55c383170880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb780342b0 msgr2=0x7feb78036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb780342b0 0x7feb78036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec84000f70 tx=0x7fec84001380 comp rx=0 tx=0).stop 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 msgr2=0x55c383169c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383169c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec80018f70 tx=0x7fec800180e0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 shutdown_connections 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c383171630 0x55c383173a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c38307c110 0x55c383170880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feb780342b0 0x7feb78036770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 --2- 172.21.15.123:0/2894799081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c382fed850 0x55c383169c00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 >> 172.21.15.123:0/2894799081 conn(0x55c3830736b0 msgr2=0x55c38315d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 shutdown_connections 2024-03-20T13:36:59.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.294+0000 7fec93079980 1 -- 172.21.15.123:0/2894799081 wait complete. 2024-03-20T13:36:59.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:59.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:36:59.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:36:59.308 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-03-20T13:36:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4efd82980 1 Processor -- start 2024-03-20T13:36:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4efd82980 1 -- start start 2024-03-20T13:36:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4efd82980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b590227630 0x55b590229a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4efd82980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b59016d520 con 0x55b590223130 2024-03-20T13:36:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4efd82980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b5901340f0 con 0x55b590227630 2024-03-20T13:36:59.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4ed09c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b590227630 0x55b590229a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4ed89d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55b590223130 0x55b590223510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59078/0 (socket says 172.21.15.123:59078) 2024-03-20T13:36:59.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4ed89d640 1 -- 172.21.15.123:0/2154144152 learned_addr learned my addr 172.21.15.123:0/2154144152 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:59.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4ed09c640 1 -- 172.21.15.123:0/2154144152 >> v1:172.21.15.89:6789/0 conn(0x55b590223130 legacy=0x55b590223510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.374+0000 7ff4ed09c640 1 -- 172.21.15.123:0/2154144152 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59022af70 con 0x55b590227630 2024-03-20T13:36:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/2154144152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590227630 0x55b590229a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400a480 tx=0x7ff4e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705d3d2731405dc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4ec89b640 1 -- 172.21.15.123:0/2154144152 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e40ab540 con 0x55b590227630 2024-03-20T13:36:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4ec89b640 1 -- 172.21.15.123:0/2154144152 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e40ab6a0 con 0x55b590227630 2024-03-20T13:36:59.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4ec89b640 1 -- 172.21.15.123:0/2154144152 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e40ab960 con 0x55b590227630 2024-03-20T13:36:59.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 -- 172.21.15.123:0/2154144152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590227630 msgr2=0x55b590229a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 --2- 172.21.15.123:0/2154144152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590227630 0x55b590229a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400a480 tx=0x7ff4e401b280 comp rx=0 tx=0).stop 2024-03-20T13:36:59.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 -- 172.21.15.123:0/2154144152 shutdown_connections 2024-03-20T13:36:59.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 --2- 172.21.15.123:0/2154144152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590227630 0x55b590229a20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 -- 172.21.15.123:0/2154144152 >> 172.21.15.123:0/2154144152 conn(0x55b590196850 msgr2=0x55b590196c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 -- 172.21.15.123:0/2154144152 shutdown_connections 2024-03-20T13:36:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.378+0000 7ff4efd82980 1 -- 172.21.15.123:0/2154144152 wait complete. 2024-03-20T13:36:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.390+0000 7ff4efd82980 1 Processor -- start 2024-03-20T13:36:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.390+0000 7ff4efd82980 1 -- start start 2024-03-20T13:36:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.390+0000 7ff4efd82980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b59030d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.390+0000 7ff4efd82980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b590131620 con 0x55b590223130 2024-03-20T13:36:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b59030d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b59030d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54254/0 (socket says 172.21.15.123:54254) 2024-03-20T13:36:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1106589716 learned_addr learned my addr 172.21.15.123:0/1106589716 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1106589716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4005d30 con 0x55b590223130 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1106589716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b59030d070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8001590 tx=0x7ff4e8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5025858861ec99 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff3dbe07640 1 -- 172.21.15.123:0/1106589716 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e8004530 con 0x55b590223130 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff3dbe07640 1 -- 172.21.15.123:0/1106589716 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8004690 con 0x55b590223130 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff3dbe07640 1 -- 172.21.15.123:0/1106589716 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e8004950 con 0x55b590223130 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- 172.21.15.123:0/1106589716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 msgr2=0x55b59030d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1106589716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b59030d070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8001590 tx=0x7ff4e8001a50 comp rx=0 tx=0).stop 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- 172.21.15.123:0/1106589716 shutdown_connections 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1106589716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b59030d070 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- 172.21.15.123:0/1106589716 >> 172.21.15.123:0/1106589716 conn(0x55b590196850 msgr2=0x55b590308c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- 172.21.15.123:0/1106589716 shutdown_connections 2024-03-20T13:36:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- 172.21.15.123:0/1106589716 wait complete. 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 Processor -- start 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- start start 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b590313ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59012ce00 con 0x55b590223130 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b590313ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b590313ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54262/0 (socket says 172.21.15.123:54262) 2024-03-20T13:36:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 -- 172.21.15.123:0/681645263 learned_addr learned my addr 172.21.15.123:0/681645263 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59016d520 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b590313ec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8001a90 tx=0x7ff4e8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff3da604640 1 -- 172.21.15.123:0/681645263 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e8013760 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b590314400 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.394+0000 7ff3da604640 1 -- 172.21.15.123:0/681645263 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80138c0 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b590314830 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff3da604640 1 -- 172.21.15.123:0/681645263 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e8013ba0 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff3da604640 1 -- 172.21.15.123:0/681645263 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4e8013d00 con 0x55b590223130 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff3da604640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d40342b0 0x7ff3d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff3da604640 1 -- 172.21.15.123:0/681645263 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff4e8049570 con 0x55b590223130 2024-03-20T13:36:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d40342b0 0x7ff3d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b590227630 0x55b59031ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59031b080 con 0x55b590227630 2024-03-20T13:36:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b590227630 0x55b59031ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d40342b0 0x7ff3d4036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ad000 tx=0x7ff4e40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b590227630 0x55b59031ab40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ee09e640 1 -- 172.21.15.123:0/681645263 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e00083f0 con 0x55b590227630 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b59031b8f0 0x55b59031dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59031e3e0 con 0x55b59031b8f0 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b59031b8f0 0x55b59031dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.398+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b59031b8f0 0x55b59031dce0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ed89d640 1 -- 172.21.15.123:0/681645263 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4e8024020 con 0x55b59031b8f0 2024-03-20T13:36:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59031fbf0 con 0x55b59031b8f0 2024-03-20T13:36:59.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ed89d640 1 -- 172.21.15.123:0/681645263 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff4e8024020 con 0x55b59031b8f0 2024-03-20T13:36:59.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59031edf0 con 0x55b59031b8f0 2024-03-20T13:36:59.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ed89d640 1 -- 172.21.15.123:0/681645263 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4e8024020 con 0x55b59031b8f0 2024-03-20T13:36:59.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59031f200 con 0x55b590227630 2024-03-20T13:36:59.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ee09e640 1 -- 172.21.15.123:0/681645263 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff4e00083f0 con 0x55b590227630 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 Processor -- start 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 -- start start 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 0x55b59032e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4efd82980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5900c5e30 con 0x55b59032e330 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ee09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 0x55b59032e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ee09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 0x55b59032e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54268/0 (socket says 172.21.15.123:54268) 2024-03-20T13:36:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1608387889 learned_addr learned my addr 172.21.15.123:0/1608387889 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1608387889 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59032ec90 con 0x55b59032e330 2024-03-20T13:36:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 0x55b59032e750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000aae0 tx=0x7ff4e0008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.402+0000 7ff3d37fe640 1 -- 172.21.15.123:0/1608387889 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e001d070 con 0x55b59032e330 2024-03-20T13:36:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d37fe640 1 -- 172.21.15.123:0/1608387889 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0010040 con 0x55b59032e330 2024-03-20T13:36:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b59032eee0 con 0x55b59032e330 2024-03-20T13:36:59.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d37fe640 1 -- 172.21.15.123:0/1608387889 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0007e70 con 0x55b59032e330 2024-03-20T13:36:59.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b59032fa30 con 0x55b59032e330 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d37fe640 1 -- 172.21.15.123:0/1608387889 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4e0018430 con 0x55b59032e330 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d37fe640 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d37fe640 1 -- 172.21.15.123:0/1608387889 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff4e004a600 con 0x55b59032e330 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 Processor -- start 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- start start 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b59031e8f0 tx=0x7ff4e8029f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b59033b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5900b9790 con 0x55b59033b280 2024-03-20T13:36:59.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ee09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b59033b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ee09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b59033b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54278/0 (socket says 172.21.15.123:54278) 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ee09e640 1 -- 172.21.15.123:0/2801194275 learned_addr learned my addr 172.21.15.123:0/2801194275 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ee09e640 1 -- 172.21.15.123:0/2801194275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59033bc70 con 0x55b59033b280 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/2801194275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b59033b6a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00489f0 tx=0x7ff4e0020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff2c1281504020b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d17fa640 1 -- 172.21.15.123:0/2801194275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0020310 con 0x55b59033b280 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d17fa640 1 -- 172.21.15.123:0/2801194275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e003f030 con 0x55b59033b280 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff3d17fa640 1 -- 172.21.15.123:0/2801194275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0022580 con 0x55b59033b280 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/2801194275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 msgr2=0x55b59033b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 --2- 172.21.15.123:0/2801194275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b59033b6a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00489f0 tx=0x7ff4e0020f00 comp rx=0 tx=0).stop 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/2801194275 shutdown_connections 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 --2- 172.21.15.123:0/2801194275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b59033b6a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/2801194275 >> 172.21.15.123:0/2801194275 conn(0x55b590337610 msgr2=0x55b590335670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/2801194275 shutdown_connections 2024-03-20T13:36:59.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.406+0000 7ff4efd82980 1 -- 172.21.15.123:0/2801194275 wait complete. 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 Processor -- start 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 -- start start 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b590342160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5903426a0 con 0x55b59033b280 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ee09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b590342160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ee09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b590342160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54294/0 (socket says 172.21.15.123:54294) 2024-03-20T13:36:59.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 learned_addr learned my addr 172.21.15.123:0/1043880262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b59032fa30 con 0x55b59033b280 2024-03-20T13:36:59.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b590342160 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00489f0 tx=0x7ff4e0048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/1043880262 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e004a410 con 0x55b59033b280 2024-03-20T13:36:59.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/1043880262 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0048b30 con 0x55b59033b280 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5903428a0 con 0x55b59033b280 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/1043880262 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0048dd0 con 0x55b59033b280 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b590342cd0 con 0x55b59033b280 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/1043880262 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4e0031020 con 0x55b59033b280 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff3bf7fe640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3b8034260 0x7ff3b8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff3bf7fe640 1 -- 172.21.15.123:0/1043880262 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff4e003b040 con 0x55b59033b280 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3b8034260 0x7ff3b8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b59034d830 0x55b59034fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590350420 con 0x55b59034d830 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b59034d830 0x55b59034fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3b8034260 0x7ff3b8036720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8013fd0 tx=0x7ff4e8036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b59034d830 0x55b59034fcd0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e40abb40 con 0x55b59034d830 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 20 realm 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.410+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590350810 con 0x55b59034d830 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e40abb40 con 0x55b59034d830 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590351060 con 0x55b59034d830 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e40abb40 con 0x55b59034d830 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b590351a40 0x55b590353e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903545e0 con 0x55b590351a40 2024-03-20T13:36:59.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b590351a40 0x55b590353e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b590351a40 0x55b590353e70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590354e30 con 0x55b590351a40 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 20 searching for the correct realm 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b590356b50 0x55b590358f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b590356b50 0x55b590358f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ed89d640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b590356b50 0x55b590358f40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.414+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4e0017710 0x7ff4e003a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x7ff4e0017710 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4e0017710 0x7ff4e003a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4e0017710 0x7ff4e003a050 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40abb40 con 0x7ff4e0017710 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x7ff4e0017710 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x7ff4e0017710 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.418+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x7ff4e0017710 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff4e40c8040 con 0x7ff4e0017710 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40c8040 con 0x55b59034d830 2024-03-20T13:36:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x7ff4e0017710 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b59034d830 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.422+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x7ff4e0017710 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x7ff4e0017710 2024-03-20T13:36:59.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590356b50 2024-03-20T13:36:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5903594d0 con 0x55b590351a40 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.426+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590355760 con 0x55b59034d830 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590355b40 con 0x55b590351a40 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590355f20 con 0x55b59034d830 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 zone default found 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 4 Realm: () 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 zonegroup default 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590359910 con 0x7ff4e0017710 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035baf0 con 0x55b590356b50 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035be50 con 0x55b590356b50 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 started sync module instance, tier type = 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.430+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035b0c0 con 0x55b590351a40 2024-03-20T13:36:59.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94238296880240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035b0c0 con 0x55b590351a40 2024-03-20T13:36:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035c7c0 con 0x55b59034d830 2024-03-20T13:36:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94238296884000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035c740 con 0x55b59034d830 2024-03-20T13:36:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035d6a0 con 0x55b590351a40 2024-03-20T13:36:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.434+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94238296880240] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94238296884000] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94238296886128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035d660 con 0x55b590351a40 2024-03-20T13:36:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035def0 con 0x7ff4e0017710 2024-03-20T13:36:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94238296889936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035d660 con 0x7ff4e0017710 2024-03-20T13:36:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.438+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035e9a0 con 0x55b590351a40 2024-03-20T13:36:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.442+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94238296886128] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94238296889936] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94238296892640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035e9a0 con 0x55b590351a40 2024-03-20T13:36:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035ed50 con 0x55b590356b50 2024-03-20T13:36:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94238296890992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035f550 con 0x55b590356b50 2024-03-20T13:36:59.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.446+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035fff0 con 0x55b590356b50 2024-03-20T13:36:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.450+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.450+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94238296890992] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.450+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94238296898256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590360880 con 0x55b590356b50 2024-03-20T13:36:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.450+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b59035f0d0 con 0x7ff4e0017710 2024-03-20T13:36:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.450+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94238296892640] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94238296898256] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94238296887680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590360840 con 0x7ff4e0017710 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=0 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=1 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=2 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=3 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=4 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=5 2024-03-20T13:36:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=6 2024-03-20T13:36:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94238296887680] v32'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 20 add_watcher() i=7 2024-03-20T13:36:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590363e60 con 0x55b59034d830 2024-03-20T13:36:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.454+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94238296901024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590361310 con 0x55b59034d830 2024-03-20T13:36:59.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94238296901024] v32'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff39f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:59.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 5 note: GC not initialized 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff39e7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 20 Filter name: none 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff30ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385840 con 0x55b59034d830 2024-03-20T13:36:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385840 con 0x7ff4e0017710 2024-03-20T13:36:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff39f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.458+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94238296901024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b59034d830 2024-03-20T13:36:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.462+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94238296901024] v32'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.462+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94238296880240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b590351a40 2024-03-20T13:36:59.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.462+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94238296880240] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.462+0000 7ff4efd82980 20 remove_watcher() i=0 2024-03-20T13:36:59.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.462+0000 7ff4efd82980 2 removed watcher, disabling cache 2024-03-20T13:36:59.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.462+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94238296884000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b59034d830 2024-03-20T13:36:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.466+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94238296884000] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x55b59034d830 2024-03-20T13:36:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.466+0000 7ff4efd82980 20 remove_watcher() i=1 2024-03-20T13:36:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.466+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94238296886128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b590351a40 2024-03-20T13:36:59.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.466+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94238296886128] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.470+0000 7ff4efd82980 20 remove_watcher() i=2 2024-03-20T13:36:59.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.470+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94238296889936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x7ff4e0017710 2024-03-20T13:36:59.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.470+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94238296889936] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.470+0000 7ff4efd82980 20 remove_watcher() i=3 2024-03-20T13:36:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.470+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94238296892640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b590351a40 2024-03-20T13:36:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4ee09e640 1 -- 172.21.15.123:0/1043880262 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94238296892640] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e001f070 con 0x55b590351a40 2024-03-20T13:36:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4efd82980 20 remove_watcher() i=4 2024-03-20T13:36:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94238296890992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b590356b50 2024-03-20T13:36:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94238296890992] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4efd82980 20 remove_watcher() i=5 2024-03-20T13:36:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94238296898256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x55b590356b50 2024-03-20T13:36:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4ed89d640 1 -- 172.21.15.123:0/1043880262 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94238296898256] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e8024020 con 0x55b590356b50 2024-03-20T13:36:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4efd82980 20 remove_watcher() i=6 2024-03-20T13:36:59.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.474+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94238296887680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b590385800 con 0x7ff4e0017710 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94238296887680] v32'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e40d5060 con 0x7ff4e0017710 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 20 remove_watcher() i=7 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b590351a40 msgr2=0x55b590353e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b590351a40 0x55b590353e70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b59034d830 msgr2=0x55b59034fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b59034d830 0x55b59034fcd0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4e0017710 msgr2=0x7ff4e003a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4e0017710 0x7ff4e003a050 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b590356b50 msgr2=0x55b590358f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b590356b50 0x55b590358f40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3b8034260 msgr2=0x7ff3b8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3b8034260 0x7ff3b8036720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8013fd0 tx=0x7ff4e8036000 comp rx=0 tx=0).stop 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 msgr2=0x55b590342160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4ed09c640 1 -- 172.21.15.123:0/1043880262 reap_dead start 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b590342160 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00489f0 tx=0x7ff4e0048980 comp rx=0 tx=0).stop 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 shutdown_connections 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1043880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59033b280 0x55b590342160 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 >> 172.21.15.123:0/1043880262 conn(0x55b590337610 msgr2=0x55b590334c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 shutdown_connections 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1043880262 wait complete. 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 msgr2=0x7ff3c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b59031e8f0 tx=0x7ff4e8029f20 comp rx=0 tx=0).stop 2024-03-20T13:36:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 msgr2=0x55b59032e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 0x55b59032e750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000aae0 tx=0x7ff4e0008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 shutdown_connections 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/1608387889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b59032e330 0x55b59032e750 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 >> 172.21.15.123:0/1608387889 conn(0x55b590323140 msgr2=0x55b590323c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 shutdown_connections 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/1608387889 wait complete. 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b59031b8f0 msgr2=0x55b59031dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b59031b8f0 0x55b59031dce0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b590227630 msgr2=0x55b59031ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b590227630 0x55b59031ab40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d40342b0 msgr2=0x7ff3d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d40342b0 0x7ff3d4036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ad000 tx=0x7ff4e40a5040 comp rx=0 tx=0).stop 2024-03-20T13:36:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 msgr2=0x55b590313ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b590313ec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8001a90 tx=0x7ff4e8001260 comp rx=0 tx=0).stop 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 shutdown_connections 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b59031b8f0 0x55b59031dce0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b590227630 0x55b59031ab40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d40342b0 0x7ff3d4036770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 --2- 172.21.15.123:0/681645263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b590223130 0x55b590313ec0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 >> 172.21.15.123:0/681645263 conn(0x55b590196850 msgr2=0x55b590307710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 shutdown_connections 2024-03-20T13:36:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.478+0000 7ff4efd82980 1 -- 172.21.15.123:0/681645263 wait complete. 2024-03-20T13:36:59.493 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-03-20T13:36:59.493 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:36:59.494 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-03-20T13:36:59.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-03-20T13:36:59.494 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-03-20T13:36:59.570 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:59.570 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:59.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd3d17980 1 Processor -- start 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd3d17980 1 -- start start 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd3d17980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a1d15043c0 0x55a1d15047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd3d17980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a1d1452520 con 0x55a1d1504ce0 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd3d17980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a1d14190f0 con 0x55a1d15043c0 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd1832640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a1d15043c0 0x55a1d15047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd1832640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a1d15043c0 0x55a1d15047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54306/0 (socket says 172.21.15.123:54306) 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd1832640 1 -- 172.21.15.123:0/541840808 learned_addr learned my addr 172.21.15.123:0/541840808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd1031640 1 --1- 172.21.15.123:0/541840808 >> v1:172.21.15.89:6789/0 conn(0x55a1d1504ce0 0x55a1d150b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59088/0 (socket says 172.21.15.123:59088) 2024-03-20T13:36:59.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd1832640 1 -- 172.21.15.123:0/541840808 >> v1:172.21.15.89:6789/0 conn(0x55a1d1504ce0 legacy=0x55a1d150b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.566+0000 7f2dd1832640 1 -- 172.21.15.123:0/541840808 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d150dcc0 con 0x55a1d15043c0 2024-03-20T13:36:59.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd1832640 1 --2- 172.21.15.123:0/541840808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15047a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00a4e0 tx=0x7f2dcc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a61b6fb6115a02 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd0830640 1 -- 172.21.15.123:0/541840808 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc0aa540 con 0x55a1d15043c0 2024-03-20T13:36:59.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd0830640 1 -- 172.21.15.123:0/541840808 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0a6070 con 0x55a1d15043c0 2024-03-20T13:36:59.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd0830640 1 -- 172.21.15.123:0/541840808 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc0aa850 con 0x55a1d15043c0 2024-03-20T13:36:59.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 -- 172.21.15.123:0/541840808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 msgr2=0x55a1d15047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/541840808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15047a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00a4e0 tx=0x7f2dcc01b090 comp rx=0 tx=0).stop 2024-03-20T13:36:59.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 -- 172.21.15.123:0/541840808 shutdown_connections 2024-03-20T13:36:59.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/541840808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15047a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 -- 172.21.15.123:0/541840808 >> 172.21.15.123:0/541840808 conn(0x55a1d14ffe50 msgr2=0x55a1d1502270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 -- 172.21.15.123:0/541840808 shutdown_connections 2024-03-20T13:36:59.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.570+0000 7f2dd3d17980 1 -- 172.21.15.123:0/541840808 wait complete. 2024-03-20T13:36:59.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd3d17980 1 Processor -- start 2024-03-20T13:36:59.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd3d17980 1 -- start start 2024-03-20T13:36:59.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd3d17980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15efec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd3d17980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1416620 con 0x55a1d15043c0 2024-03-20T13:36:59.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd1832640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd1832640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15efec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54320/0 (socket says 172.21.15.123:54320) 2024-03-20T13:36:59.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd1832640 1 -- 172.21.15.123:0/3712532426 learned_addr learned my addr 172.21.15.123:0/3712532426 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.582+0000 7f2dd1832640 1 -- 172.21.15.123:0/3712532426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc00a1c0 con 0x55a1d15043c0 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd1832640 1 --2- 172.21.15.123:0/3712532426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15efec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc017ca0 tx=0x7f2dcc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a785af4855593bd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2cbfe07640 1 -- 172.21.15.123:0/3712532426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc0aa780 con 0x55a1d15043c0 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2cbfe07640 1 -- 172.21.15.123:0/3712532426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0aa8e0 con 0x55a1d15043c0 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2cbfe07640 1 -- 172.21.15.123:0/3712532426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc0aab80 con 0x55a1d15043c0 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3712532426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 msgr2=0x55a1d15efec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/3712532426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15efec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc017ca0 tx=0x7f2dcc0033b0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3712532426 shutdown_connections 2024-03-20T13:36:59.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/3712532426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15efec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3712532426 >> 172.21.15.123:0/3712532426 conn(0x55a1d14ffe50 msgr2=0x55a1d15eba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3712532426 shutdown_connections 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3712532426 wait complete. 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 Processor -- start 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- start start 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1411e00 con 0x55a1d15043c0 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd1832640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd1832640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54324/0 (socket says 172.21.15.123:54324) 2024-03-20T13:36:59.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd1832640 1 -- 172.21.15.123:0/2949797329 learned_addr learned my addr 172.21.15.123:0/2949797329 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd1832640 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d150dcc0 con 0x55a1d15043c0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15f6bd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc01aec0 tx=0x7f2dcc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2cbe604640 1 -- 172.21.15.123:0/2949797329 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc0c4070 con 0x55a1d15043c0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1d15f7110 con 0x55a1d15043c0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2cbe604640 1 -- 172.21.15.123:0/2949797329 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc005150 con 0x55a1d15043c0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2cbe604640 1 -- 172.21.15.123:0/2949797329 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc0053f0 con 0x55a1d15043c0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.586+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1d15f7540 con 0x55a1d15043c0 2024-03-20T13:36:59.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2cbe604640 1 -- 172.21.15.123:0/2949797329 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2dcc0a8070 con 0x55a1d15043c0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2cbe604640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cb80342b0 0x7f2cb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2cbe604640 1 -- 172.21.15.123:0/2949797329 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2dcc0e3570 con 0x55a1d15043c0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd1031640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cb80342b0 0x7f2cb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1504ce0 0x55a1d15fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d15fdd40 con 0x55a1d1504ce0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd2033640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1504ce0 0x55a1d15fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd1031640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cb80342b0 0x7f2cb8036770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000f70 tx=0x7f2dbc001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd2033640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1504ce0 0x55a1d15fd800 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd2033640 1 -- 172.21.15.123:0/2949797329 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2dc40083f0 con 0x55a1d1504ce0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d15fe5b0 0x55a1d16009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1601110 con 0x55a1d15fe5b0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d15fe5b0 0x55a1d16009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d15fe5b0 0x55a1d16009a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd1832640 1 -- 172.21.15.123:0/2949797329 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d15fe5b0 2024-03-20T13:36:59.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1602970 con 0x55a1d15fe5b0 2024-03-20T13:36:59.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd1832640 1 -- 172.21.15.123:0/2949797329 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d15fe5b0 2024-03-20T13:36:59.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.590+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1601b70 con 0x55a1d15fe5b0 2024-03-20T13:36:59.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd1832640 1 -- 172.21.15.123:0/2949797329 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d15fe5b0 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1601f80 con 0x55a1d1504ce0 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd2033640 1 -- 172.21.15.123:0/2949797329 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2dc40083f0 con 0x55a1d1504ce0 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 Processor -- start 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 -- start start 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 0x55a1d1611520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d13aae30 con 0x55a1d1611100 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd2033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 0x55a1d1611520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd2033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 0x55a1d1611520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54336/0 (socket says 172.21.15.123:54336) 2024-03-20T13:36:59.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd2033640 1 -- 172.21.15.123:0/1932426435 learned_addr learned my addr 172.21.15.123:0/1932426435 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd2033640 1 -- 172.21.15.123:0/1932426435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d1611a60 con 0x55a1d1611100 2024-03-20T13:36:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd2033640 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 0x55a1d1611520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400aae0 tx=0x7f2dc4008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2cb77fe640 1 -- 172.21.15.123:0/1932426435 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc401d070 con 0x55a1d1611100 2024-03-20T13:36:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2cb77fe640 1 -- 172.21.15.123:0/1932426435 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc4010040 con 0x55a1d1611100 2024-03-20T13:36:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1d1611cb0 con 0x55a1d1611100 2024-03-20T13:36:59.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2cb77fe640 1 -- 172.21.15.123:0/1932426435 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc4007e70 con 0x55a1d1611100 2024-03-20T13:36:59.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1d1612800 con 0x55a1d1611100 2024-03-20T13:36:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2cb77fe640 1 -- 172.21.15.123:0/1932426435 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2dc4018430 con 0x55a1d1611100 2024-03-20T13:36:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2cb77fe640 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cac0342b0 0x7f2cac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.594+0000 7f2cb77fe640 1 -- 172.21.15.123:0/1932426435 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2dc404a630 con 0x55a1d1611100 2024-03-20T13:36:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd1832640 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cac0342b0 0x7f2cac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 Processor -- start 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- start start 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd1832640 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cac0342b0 0x7f2cac036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55a1d16015b0 tx=0x7f2dcc0033f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d161e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d139e790 con 0x55a1d161e0a0 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d161e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d161e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54352/0 (socket says 172.21.15.123:54352) 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 -- 172.21.15.123:0/3905103386 learned_addr learned my addr 172.21.15.123:0/3905103386 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 -- 172.21.15.123:0/3905103386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d161ea90 con 0x55a1d161e0a0 2024-03-20T13:36:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 --2- 172.21.15.123:0/3905103386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d161e4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4048a20 tx=0x7f2dc4021970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7353f2dd4e5b53 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2cb57fa640 1 -- 172.21.15.123:0/3905103386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc4047070 con 0x55a1d161e0a0 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2cb57fa640 1 -- 172.21.15.123:0/3905103386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc4022590 con 0x55a1d161e0a0 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2cb57fa640 1 -- 172.21.15.123:0/3905103386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc4016460 con 0x55a1d161e0a0 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3905103386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 msgr2=0x55a1d161e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/3905103386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d161e4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4048a20 tx=0x7f2dc4021970 comp rx=0 tx=0).stop 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3905103386 shutdown_connections 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/3905103386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d161e4c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3905103386 >> 172.21.15.123:0/3905103386 conn(0x55a1d161a3e0 msgr2=0x55a1d1618440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3905103386 shutdown_connections 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/3905103386 wait complete. 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 Processor -- start 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- start start 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d1506d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d15072a0 con 0x55a1d161e0a0 2024-03-20T13:36:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d1506d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d1506d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54354/0 (socket says 172.21.15.123:54354) 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 learned_addr learned my addr 172.21.15.123:0/2493279883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d1612800 con 0x55a1d161e0a0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd2033640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d1506d60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4048ae0 tx=0x7f2dc40489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2ca37fe640 1 -- 172.21.15.123:0/2493279883 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc40167f0 con 0x55a1d161e0a0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1d1505480 con 0x55a1d161e0a0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2ca37fe640 1 -- 172.21.15.123:0/2493279883 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc4016950 con 0x55a1d161e0a0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2ca37fe640 1 -- 172.21.15.123:0/2493279883 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc4021a30 con 0x55a1d161e0a0 2024-03-20T13:36:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.598+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1d1505910 con 0x55a1d161e0a0 2024-03-20T13:36:59.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2ca37fe640 1 -- 172.21.15.123:0/2493279883 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2dc4021b90 con 0x55a1d161e0a0 2024-03-20T13:36:59.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2ca37fe640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2c9c0342b0 0x7f2c9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2ca37fe640 1 -- 172.21.15.123:0/2493279883 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2dc4036020 con 0x55a1d161e0a0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2c9c0342b0 0x7f2c9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1632840 0x55a1d1634d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1635450 con 0x55a1d1632840 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1031640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1632840 0x55a1d1634d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2c9c0342b0 0x7f2c9c036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0b49b0 tx=0x7f2dcc0de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1031640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1632840 0x55a1d1634d00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 realm 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1631ce0 con 0x55a1d1632840 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1635ed0 con 0x55a1d1632840 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d1636a40 0x55a1d1638f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1639670 con 0x55a1d1636a40 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd2033640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d1636a40 0x55a1d1638f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.602+0000 7f2dd2033640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d1636a40 0x55a1d1638f00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2dc4032070 con 0x55a1d1636a40 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1639ec0 con 0x55a1d1636a40 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2dc4032070 con 0x55a1d1636a40 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 20 searching for the correct realm 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a1d163bbe0 0x55a1d163dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d163bbe0 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a1d163bbe0 0x55a1d163dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1832640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a1d163bbe0 0x55a1d163dfd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1636a40 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc4032070 con 0x55a1d1636a40 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd2033640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2dc4035020 0x7f2dc4017710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x7f2dc4035020 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2dc4035020 0x7f2dc4017710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2dc4035020 0x7f2dc4017710 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1632840 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.606+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d163bbe0 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1636a40 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc4032070 con 0x55a1d1636a40 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1636a40 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc4032070 con 0x55a1d1636a40 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x7f2dc4035020 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e560 con 0x55a1d1632840 2024-03-20T13:36:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x7f2dc4035020 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1636a40 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d163bbe0 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1632840 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.610+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1636a40 2024-03-20T13:36:59.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d163bbe0 2024-03-20T13:36:59.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d163bbe0 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x7f2dc4035020 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x7f2dc4035020 2024-03-20T13:36:59.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d163bbe0 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x7f2dc4035020 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1636a40 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.614+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1636a40 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d163bbe0 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1636a40 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2dbc02d080 con 0x55a1d1636a40 2024-03-20T13:36:59.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163a7f0 con 0x55a1d1632840 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163ac00 con 0x55a1d1636a40 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163ac00 con 0x55a1d1632840 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 zone default found 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 4 Realm: () 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 zonegroup default 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d163e9f0 con 0x7f2dc4035020 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1640bd0 con 0x55a1d163bbe0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.618+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1640f30 con 0x55a1d163bbe0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 20 started sync module instance, tier type = 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d16401a0 con 0x55a1d1636a40 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94153491088720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d16401a0 con 0x55a1d1636a40 2024-03-20T13:36:59.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1641900 con 0x55a1d1632840 2024-03-20T13:36:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94153491092480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d16418c0 con 0x55a1d1632840 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.622+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1642800 con 0x55a1d1636a40 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.626+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94153491088720] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.626+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94153491092480] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.626+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.626+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94153491096352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d16418c0 con 0x55a1d1636a40 2024-03-20T13:36:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.626+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1641e20 con 0x7f2dc4035020 2024-03-20T13:36:59.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.630+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.630+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94153491098592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d16418c0 con 0x7f2dc4035020 2024-03-20T13:36:59.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.630+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1643b00 con 0x55a1d1636a40 2024-03-20T13:36:59.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.630+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94153491096352] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94153491098592] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94153491099648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1643b00 con 0x55a1d1636a40 2024-03-20T13:36:59.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1643eb0 con 0x55a1d163bbe0 2024-03-20T13:36:59.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94153491086592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1644700 con 0x55a1d163bbe0 2024-03-20T13:36:59.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.634+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d16450d0 con 0x55a1d163bbe0 2024-03-20T13:36:59.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94153491086592] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94153491099648] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94153491106768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1644260 con 0x55a1d163bbe0 2024-03-20T13:36:59.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1645920 con 0x7f2dc4035020 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94153491108992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1644260 con 0x7f2dc4035020 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=0 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=1 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=2 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=3 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=4 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=5 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94153491106768] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.638+0000 7f2dd3d17980 20 add_watcher() i=6 2024-03-20T13:36:59.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94153491108992] v32'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 add_watcher() i=7 2024-03-20T13:36:59.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:59.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1643640 con 0x55a1d1632840 2024-03-20T13:36:59.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94153491110048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d1643640 con 0x55a1d1632840 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94153491110048] v32'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2c837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 5 note: GC not initialized 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2c827fc640 20 reqs_thread_entry: start 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:59.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 Filter name: none 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2bf3fff640 20 reqs_thread_entry: start 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a480 con 0x55a1d1632840 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.642+0000 7f2dd3d17980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.646+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a480 con 0x7f2dc4035020 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.646+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.646+0000 7f2c837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.646+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94153491110048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d1632840 2024-03-20T13:36:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.646+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94153491110048] v32'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.646+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94153491088720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d1636a40 2024-03-20T13:36:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94153491088720] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd3d17980 20 remove_watcher() i=0 2024-03-20T13:36:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd3d17980 2 removed watcher, disabling cache 2024-03-20T13:36:59.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94153491092480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d1632840 2024-03-20T13:36:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94153491092480] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x55a1d1632840 2024-03-20T13:36:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd3d17980 20 remove_watcher() i=1 2024-03-20T13:36:59.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.650+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94153491096352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d1636a40 2024-03-20T13:36:59.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.654+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94153491096352] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.654+0000 7f2dd3d17980 20 remove_watcher() i=2 2024-03-20T13:36:59.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.654+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94153491098592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x7f2dc4035020 2024-03-20T13:36:59.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.654+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94153491098592] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.654+0000 7f2dd3d17980 20 remove_watcher() i=3 2024-03-20T13:36:59.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.654+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94153491099648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d1636a40 2024-03-20T13:36:59.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd2033640 1 -- 172.21.15.123:0/2493279883 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94153491099648] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dc405f040 con 0x55a1d1636a40 2024-03-20T13:36:59.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd3d17980 20 remove_watcher() i=4 2024-03-20T13:36:59.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94153491086592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d163bbe0 2024-03-20T13:36:59.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94153491086592] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd3d17980 20 remove_watcher() i=5 2024-03-20T13:36:59.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94153491106768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x55a1d163bbe0 2024-03-20T13:36:59.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd1832640 1 -- 172.21.15.123:0/2493279883 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94153491106768] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dcc0b4a00 con 0x55a1d163bbe0 2024-03-20T13:36:59.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd3d17980 20 remove_watcher() i=6 2024-03-20T13:36:59.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.658+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94153491108992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a1d166a440 con 0x7f2dc4035020 2024-03-20T13:36:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94153491108992] v32'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2dbc00f620 con 0x7f2dc4035020 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 20 remove_watcher() i=7 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d1636a40 msgr2=0x55a1d1638f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d1636a40 0x55a1d1638f00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1632840 msgr2=0x55a1d1634d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1632840 0x55a1d1634d00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2dc4035020 msgr2=0x7f2dc4017710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2dc4035020 0x7f2dc4017710 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a1d163bbe0 msgr2=0x55a1d163dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a1d163bbe0 0x55a1d163dfd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2c9c0342b0 msgr2=0x7f2c9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2c9c0342b0 0x7f2c9c036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0b49b0 tx=0x7f2dcc0de000 comp rx=0 tx=0).stop 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 msgr2=0x55a1d1506d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd1031640 1 -- 172.21.15.123:0/2493279883 reap_dead start 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d1506d60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4048ae0 tx=0x7f2dc40489b0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 shutdown_connections 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2493279883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d161e0a0 0x55a1d1506d60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 >> 172.21.15.123:0/2493279883 conn(0x55a1d161a3e0 msgr2=0x55a1d1617a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 shutdown_connections 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2493279883 wait complete. 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cac0342b0 msgr2=0x7f2cac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cac0342b0 0x7f2cac036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55a1d16015b0 tx=0x7f2dcc0033f0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 msgr2=0x55a1d1611520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 0x55a1d1611520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400aae0 tx=0x7f2dc4008e70 comp rx=0 tx=0).stop 2024-03-20T13:36:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 shutdown_connections 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cac0342b0 0x7f2cac036770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/1932426435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d1611100 0x55a1d1611520 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 >> 172.21.15.123:0/1932426435 conn(0x55a1d1605f10 msgr2=0x55a1d1606a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 shutdown_connections 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/1932426435 wait complete. 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d15fe5b0 msgr2=0x55a1d16009a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d15fe5b0 0x55a1d16009a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1504ce0 msgr2=0x55a1d15fd800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1504ce0 0x55a1d15fd800 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cb80342b0 msgr2=0x7f2cb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cb80342b0 0x7f2cb8036770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000f70 tx=0x7f2dbc001380 comp rx=0 tx=0).stop 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 msgr2=0x55a1d15f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15f6bd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc01aec0 tx=0x7f2dcc017e30 comp rx=0 tx=0).stop 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 shutdown_connections 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a1d15fe5b0 0x55a1d16009a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a1d1504ce0 0x55a1d15fd800 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2cb80342b0 0x7f2cb8036770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 --2- 172.21.15.123:0/2949797329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1d15043c0 0x55a1d15f6bd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 >> 172.21.15.123:0/2949797329 conn(0x55a1d14ffe50 msgr2=0x55a1d15ea560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 shutdown_connections 2024-03-20T13:36:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.662+0000 7f2dd3d17980 1 -- 172.21.15.123:0/2949797329 wait complete. 2024-03-20T13:36:59.677 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-03-20T13:36:59.677 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:36:59.695 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:59.695 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-03-20T13:36:59.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-03-20T13:36:59.695 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-03-20T13:36:59.750 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:59.750 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:59.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa99597e980 1 Processor -- start 2024-03-20T13:36:59.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa99597e980 1 -- start start 2024-03-20T13:36:59.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa99597e980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5595ea9df3c0 0x5595ea9df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa99597e980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595ea92d520 con 0x5595ea9dfce0 2024-03-20T13:36:59.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa99597e980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5595ea8f40f0 con 0x5595ea9df3c0 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa992c98640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5595ea9dfce0 0x5595ea9e64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59092/0 (socket says 172.21.15.123:59092) 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa992c98640 1 -- 172.21.15.123:0/3853655015 learned_addr learned my addr 172.21.15.123:0/3853655015 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa993499640 1 --2- 172.21.15.123:0/3853655015 >> v2:172.21.15.89:3300/0 conn(0x5595ea9df3c0 0x5595ea9df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa992497640 1 -- 172.21.15.123:0/3853655015 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683403022 0 0) 0x5595ea92d520 con 0x5595ea9dfce0 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa992497640 1 -- 172.21.15.123:0/3853655015 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c001e20 con 0x5595ea9dfce0 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa993499640 1 -- 172.21.15.123:0/3853655015 >> v1:172.21.15.89:6789/0 conn(0x5595ea9dfce0 legacy=0x5595ea9e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.746+0000 7fa993499640 1 -- 172.21.15.123:0/3853655015 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595ea9e8cc0 con 0x5595ea9df3c0 2024-03-20T13:36:59.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa993499640 1 --2- 172.21.15.123:0/3853655015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9df7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa98400a480 tx=0x7fa98401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10b242c40bdab19 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa992497640 1 -- 172.21.15.123:0/3853655015 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9840ab540 con 0x5595ea9df3c0 2024-03-20T13:36:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa992497640 1 -- 172.21.15.123:0/3853655015 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840ab6a0 con 0x5595ea9df3c0 2024-03-20T13:36:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa992497640 1 -- 172.21.15.123:0/3853655015 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9840ab940 con 0x5595ea9df3c0 2024-03-20T13:36:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 -- 172.21.15.123:0/3853655015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 msgr2=0x5595ea9df7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 --2- 172.21.15.123:0/3853655015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9df7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa98400a480 tx=0x7fa98401b280 comp rx=0 tx=0).stop 2024-03-20T13:36:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 -- 172.21.15.123:0/3853655015 shutdown_connections 2024-03-20T13:36:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 --2- 172.21.15.123:0/3853655015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9df7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 -- 172.21.15.123:0/3853655015 >> 172.21.15.123:0/3853655015 conn(0x5595ea9dae50 msgr2=0x5595ea9dd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 -- 172.21.15.123:0/3853655015 shutdown_connections 2024-03-20T13:36:59.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.750+0000 7fa99597e980 1 -- 172.21.15.123:0/3853655015 wait complete. 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa99597e980 1 Processor -- start 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa99597e980 1 -- start start 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa99597e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa99597e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ea8f1620 con 0x5595ea9df3c0 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa993499640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa993499640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9e1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54376/0 (socket says 172.21.15.123:54376) 2024-03-20T13:36:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa993499640 1 -- 172.21.15.123:0/4264573021 learned_addr learned my addr 172.21.15.123:0/4264573021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa993499640 1 -- 172.21.15.123:0/4264573021 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984005d30 con 0x5595ea9df3c0 2024-03-20T13:36:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa993499640 1 --2- 172.21.15.123:0/4264573021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9e1be0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa984018eb0 tx=0x7fa984003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9973e6b4aac7d42 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.762+0000 7fa88160a640 1 -- 172.21.15.123:0/4264573021 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9840ab810 con 0x5595ea9df3c0 2024-03-20T13:36:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa88160a640 1 -- 172.21.15.123:0/4264573021 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840ab970 con 0x5595ea9df3c0 2024-03-20T13:36:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa88160a640 1 -- 172.21.15.123:0/4264573021 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9840abc30 con 0x5595ea9df3c0 2024-03-20T13:36:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/4264573021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 msgr2=0x5595ea9e1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 --2- 172.21.15.123:0/4264573021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9e1be0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa984018eb0 tx=0x7fa984003030 comp rx=0 tx=0).stop 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/4264573021 shutdown_connections 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 --2- 172.21.15.123:0/4264573021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595ea9e1be0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/4264573021 >> 172.21.15.123:0/4264573021 conn(0x5595ea9dae50 msgr2=0x5595eaac6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/4264573021 shutdown_connections 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/4264573021 wait complete. 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 Processor -- start 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- start start 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595eaad3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ea8ece00 con 0x5595ea9df3c0 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa993499640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595eaad3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa993499640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595eaad3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54380/0 (socket says 172.21.15.123:54380) 2024-03-20T13:36:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa993499640 1 -- 172.21.15.123:0/1147894256 learned_addr learned my addr 172.21.15.123:0/1147894256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa993499640 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595ea9e8cc0 con 0x5595ea9df3c0 2024-03-20T13:36:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa993499640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595eaad3c10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa98401bb20 tx=0x7fa984018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa87fe07640 1 -- 172.21.15.123:0/1147894256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9840c3070 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595eaad4150 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa87fe07640 1 -- 172.21.15.123:0/1147894256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840a3e40 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa87fe07640 1 -- 172.21.15.123:0/1147894256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9840bee30 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.766+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595eaad4580 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa87fe07640 1 -- 172.21.15.123:0/1147894256 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa9840b2070 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa87fe07640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa878034260 0x7fa878036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa87fe07640 1 -- 172.21.15.123:0/1147894256 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa9840e39a0 con 0x5595ea9df3c0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa992c98640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa878034260 0x7fa878036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595ea9dfce0 0x5595eaada7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eaadad30 con 0x5595ea9dfce0 2024-03-20T13:36:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa993c9a640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595ea9dfce0 0x5595eaada7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa992c98640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa878034260 0x7fa878036720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa988000f70 tx=0x7fa9880010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa993c9a640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595ea9dfce0 0x5595eaada7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa993c9a640 1 -- 172.21.15.123:0/1147894256 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595ea9dfce0 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eaadb5a0 0x5595eaadd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eaade0b0 con 0x5595eaadb5a0 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa993499640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eaadb5a0 0x5595eaadd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa993499640 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eaadb5a0 0x5595eaadd990 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa993499640 1 -- 172.21.15.123:0/1147894256 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa9840aacf0 con 0x5595eaadb5a0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.770+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eaadf910 con 0x5595eaadb5a0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993499640 1 -- 172.21.15.123:0/1147894256 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa9840d7040 con 0x5595eaadb5a0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eaadeb10 con 0x5595eaadb5a0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993499640 1 -- 172.21.15.123:0/1147894256 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa9840d7040 con 0x5595eaadb5a0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eaadef20 con 0x5595ea9dfce0 2024-03-20T13:36:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993c9a640 1 -- 172.21.15.123:0/1147894256 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595ea9dfce0 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 Processor -- start 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 -- start start 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 0x5595eaaee430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ea885e30 con 0x5595eaaee010 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 0x5595eaaee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 0x5595eaaee430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54396/0 (socket says 172.21.15.123:54396) 2024-03-20T13:36:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993c9a640 1 -- 172.21.15.123:0/1801844896 learned_addr learned my addr 172.21.15.123:0/1801844896 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993c9a640 1 -- 172.21.15.123:0/1801844896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595eaaee970 con 0x5595eaaee010 2024-03-20T13:36:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa993c9a640 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 0x5595eaaee430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa98c016cf0 tx=0x7fa98c00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa87d602640 1 -- 172.21.15.123:0/1801844896 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa98c017660 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa87d602640 1 -- 172.21.15.123:0/1801844896 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c0177c0 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595eaaeebc0 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa87d602640 1 -- 172.21.15.123:0/1801844896 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa98c017a60 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.774+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595eaaef710 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa87d602640 1 -- 172.21.15.123:0/1801844896 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa98c01d020 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa87d602640 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa86c0342b0 0x7fa86c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa87d602640 1 -- 172.21.15.123:0/1801844896 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa98c04b1b0 con 0x5595eaaee010 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993499640 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa86c0342b0 0x7fa86c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 Processor -- start 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- start start 2024-03-20T13:36:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993499640 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa86c0342b0 0x7fa86c036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5595eaade610 tx=0x7fa9840e1db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eaafb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ea879790 con 0x5595eaafaf90 2024-03-20T13:36:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eaafb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eaafb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54408/0 (socket says 172.21.15.123:54408) 2024-03-20T13:36:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 -- 172.21.15.123:0/1880975763 learned_addr learned my addr 172.21.15.123:0/1880975763 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 -- 172.21.15.123:0/1880975763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595eaafb980 con 0x5595eaafaf90 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 --2- 172.21.15.123:0/1880975763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eaafb3b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0495a0 tx=0x7fa98c014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc92a0eecaf38e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa876ffd640 1 -- 172.21.15.123:0/1880975763 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa98c03b070 con 0x5595eaafaf90 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa876ffd640 1 -- 172.21.15.123:0/1880975763 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c0481d0 con 0x5595eaafaf90 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa876ffd640 1 -- 172.21.15.123:0/1880975763 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa98c03b300 con 0x5595eaafaf90 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- 172.21.15.123:0/1880975763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 msgr2=0x5595eaafb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 --2- 172.21.15.123:0/1880975763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eaafb3b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0495a0 tx=0x7fa98c014740 comp rx=0 tx=0).stop 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- 172.21.15.123:0/1880975763 shutdown_connections 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 --2- 172.21.15.123:0/1880975763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eaafb3b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- 172.21.15.123:0/1880975763 >> 172.21.15.123:0/1880975763 conn(0x5595eaaf72d0 msgr2=0x5595eaaf5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- 172.21.15.123:0/1880975763 shutdown_connections 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- 172.21.15.123:0/1880975763 wait complete. 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 Processor -- start 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- start start 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eab01e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa99597e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595eab02360 con 0x5595eaafaf90 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eab01e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eab01e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54416/0 (socket says 172.21.15.123:54416) 2024-03-20T13:36:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.778+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 learned_addr learned my addr 172.21.15.123:0/4099613990 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595eaaef710 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa993c9a640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eab01e20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa98c03a040 tx=0x7fa98c049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa8757fa640 1 -- 172.21.15.123:0/4099613990 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa98c01fac0 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595eab02560 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa8757fa640 1 -- 172.21.15.123:0/4099613990 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c01fc20 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa8757fa640 1 -- 172.21.15.123:0/4099613990 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa98c0113d0 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595eab029f0 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa8757fa640 1 -- 172.21.15.123:0/4099613990 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa98c011530 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa8757fa640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa85c0342b0 0x7fa85c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa8757fa640 1 -- 172.21.15.123:0/4099613990 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa98c04c530 con 0x5595eaafaf90 2024-03-20T13:36:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa993499640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa85c0342b0 0x7fa85c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595eab0d550 0x5595eab0f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab10130 con 0x5595eab0d550 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa992c98640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595eab0d550 0x5595eab0f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa993499640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa85c0342b0 0x7fa85c036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9840b55d0 tx=0x7fa9840df000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa992c98640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595eab0d550 0x5595eab0f9e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 realm 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab0cac0 con 0x5595eab0d550 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab10bb0 con 0x5595eab0d550 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eab11770 0x5595eab13c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab143a0 con 0x5595eab11770 2024-03-20T13:36:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.782+0000 7fa993c9a640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eab11770 0x5595eab13c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993c9a640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eab11770 0x5595eab13c30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab14bf0 con 0x5595eab11770 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 20 searching for the correct realm 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595eab16910 0x5595eab18d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993499640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595eab16910 0x5595eab18d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993499640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595eab16910 0x5595eab18d00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840d7040 con 0x5595eab16910 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993c9a640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa98c034070 0x7fa98c038170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x7fa98c034070 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.786+0000 7fa992c98640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa98c034070 0x7fa98c038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa98c034070 0x7fa98c038170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x7fa98c034070 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x7fa98c034070 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.790+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x7fa98c034070 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.794+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x7fa98c034070 2024-03-20T13:36:59.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x7fa98c034070 2024-03-20T13:36:59.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab16910 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab19290 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.798+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab15520 con 0x5595eab0d550 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab15960 con 0x5595eab11770 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab15d40 con 0x5595eab0d550 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa98800e640 con 0x5595eab0d550 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 zone default found 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 4 Realm: () 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 zonegroup default 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab196d0 con 0x7fa98c034070 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa98800e640 con 0x7fa98c034070 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1b8b0 con 0x5595eab16910 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1bc10 con 0x5595eab16910 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 started sync module instance, tier type = 2024-03-20T13:36:59.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.802+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1ae80 con 0x5595eab11770 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94102376002096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1ae80 con 0x5595eab11770 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1c5c0 con 0x5595eab0d550 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94102376005856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1ce40 con 0x5595eab0d550 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1d840 con 0x5595eab11770 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94102376002096] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94102376005856] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94102376010560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1c9a0 con 0x5595eab11770 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.806+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1e0c0 con 0x7fa98c034070 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x7fa98c034070 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94102376012832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1c9a0 con 0x7fa98c034070 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1eb30 con 0x5595eab11770 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94102376010560] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94102376012832] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x7fa98c034070 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94102376013888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1e650 con 0x5595eab11770 2024-03-20T13:36:59.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1f380 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94102376017632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1e650 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.810+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab200a0 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94102376020864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab208f0 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab213c0 con 0x7fa98c034070 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94102376013888] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94102376017632] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x7fa98c034070 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94102376020864] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94102376019680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab21380 con 0x7fa98c034070 2024-03-20T13:36:59.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=0 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=1 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=2 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=3 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=4 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=5 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=6 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94102376019680] v32'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x7fa98c034070 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 20 add_watcher() i=7 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab20ed0 con 0x5595eab0d550 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.814+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94102376023120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab20ed0 con 0x5595eab0d550 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94102376023120] v32'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa84a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 5 note: GC not initialized 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa8497e2640 20 reqs_thread_entry: start 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 20 Filter name: none 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa8427fc640 20 reqs_thread_entry: start 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab45940 con 0x5595eab0d550 2024-03-20T13:36:59.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:59.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab45940 con 0x7fa98c034070 2024-03-20T13:36:59.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fa988043040 con 0x7fa98c034070 2024-03-20T13:36:59.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa84a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.818+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94102376023120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab45e40 con 0x5595eab0d550 2024-03-20T13:36:59.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.822+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94102376023120] v32'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.822+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94102376002096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab20450 con 0x5595eab11770 2024-03-20T13:36:59.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.822+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94102376002096] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.822+0000 7fa99597e980 20 remove_watcher() i=0 2024-03-20T13:36:59.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.822+0000 7fa99597e980 2 removed watcher, disabling cache 2024-03-20T13:36:59.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.822+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94102376005856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1b230 con 0x5595eab0d550 2024-03-20T13:36:59.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94102376005856] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x5595eab0d550 2024-03-20T13:36:59.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa99597e980 20 remove_watcher() i=1 2024-03-20T13:36:59.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94102376010560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1b230 con 0x5595eab11770 2024-03-20T13:36:59.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94102376010560] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa99597e980 20 remove_watcher() i=2 2024-03-20T13:36:59.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94102376012832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1b230 con 0x7fa98c034070 2024-03-20T13:36:59.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94102376012832] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa988043040 con 0x7fa98c034070 2024-03-20T13:36:59.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa99597e980 20 remove_watcher() i=3 2024-03-20T13:36:59.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.826+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94102376013888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1dc20 con 0x5595eab11770 2024-03-20T13:36:59.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa993c9a640 1 -- 172.21.15.123:0/4099613990 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94102376013888] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98c00a4d0 con 0x5595eab11770 2024-03-20T13:36:59.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa99597e980 20 remove_watcher() i=4 2024-03-20T13:36:59.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94102376017632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1d340 con 0x5595eab16910 2024-03-20T13:36:59.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94102376017632] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa99597e980 20 remove_watcher() i=5 2024-03-20T13:36:59.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94102376020864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1d340 con 0x5595eab16910 2024-03-20T13:36:59.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa993499640 1 -- 172.21.15.123:0/4099613990 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94102376020864] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9840f8040 con 0x5595eab16910 2024-03-20T13:36:59.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa99597e980 20 remove_watcher() i=6 2024-03-20T13:36:59.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.830+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94102376019680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595eab1d340 con 0x7fa98c034070 2024-03-20T13:36:59.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94102376019680] v32'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa98804d040 con 0x7fa98c034070 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 20 remove_watcher() i=7 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eab11770 msgr2=0x5595eab13c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eab11770 0x5595eab13c30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595eab0d550 msgr2=0x5595eab0f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595eab0d550 0x5595eab0f9e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa98c034070 msgr2=0x7fa98c038170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa98c034070 0x7fa98c038170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595eab16910 msgr2=0x5595eab18d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595eab16910 0x5595eab18d00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa85c0342b0 msgr2=0x7fa85c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa85c0342b0 0x7fa85c036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9840b55d0 tx=0x7fa9840df000 comp rx=0 tx=0).stop 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa992c98640 1 -- 172.21.15.123:0/4099613990 reap_dead start 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 msgr2=0x5595eab01e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eab01e20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa98c03a040 tx=0x7fa98c049530 comp rx=0 tx=0).stop 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 shutdown_connections 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/4099613990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaafaf90 0x5595eab01e20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 >> 172.21.15.123:0/4099613990 conn(0x5595eaaf72d0 msgr2=0x5595eaaf4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 shutdown_connections 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/4099613990 wait complete. 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa86c0342b0 msgr2=0x7fa86c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa86c0342b0 0x7fa86c036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5595eaade610 tx=0x7fa9840e1db0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 msgr2=0x5595eaaee430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 0x5595eaaee430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa98c016cf0 tx=0x7fa98c00d790 comp rx=0 tx=0).stop 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 shutdown_connections 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa86c0342b0 0x7fa86c036770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1801844896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595eaaee010 0x5595eaaee430 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 >> 172.21.15.123:0/1801844896 conn(0x5595eaae2e20 msgr2=0x5595eaae3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 shutdown_connections 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1801844896 wait complete. 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eaadb5a0 msgr2=0x5595eaadd990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eaadb5a0 0x5595eaadd990 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595ea9dfce0 msgr2=0x5595eaada7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595ea9dfce0 0x5595eaada7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa878034260 msgr2=0x7fa878036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa878034260 0x7fa878036720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa988000f70 tx=0x7fa9880010b0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 msgr2=0x5595eaad3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595eaad3c10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa98401bb20 tx=0x7fa984018020 comp rx=0 tx=0).stop 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 shutdown_connections 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595eaadb5a0 0x5595eaadd990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595ea9dfce0 0x5595eaada7f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa878034260 0x7fa878036720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 --2- 172.21.15.123:0/1147894256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595ea9df3c0 0x5595eaad3c10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 >> 172.21.15.123:0/1147894256 conn(0x5595ea9dae50 msgr2=0x5595eaac5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 shutdown_connections 2024-03-20T13:36:59.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.834+0000 7fa99597e980 1 -- 172.21.15.123:0/1147894256 wait complete. 2024-03-20T13:36:59.849 INFO:teuthology.orchestra.run.smithi123.stdout:["myfoo"] 2024-03-20T13:36:59.849 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-03-20T13:36:59.853 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:59.853 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-03-20T13:36:59.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-03-20T13:36:59.853 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-03-20T13:36:59.914 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:59.914 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:59.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9499919980 1 Processor -- start 2024-03-20T13:36:59.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9499919980 1 -- start start 2024-03-20T13:36:59.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9499919980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e85ea0a620 0x55e85ea0ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9499919980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e85e950510 con 0x55e85ea06120 2024-03-20T13:36:59.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9499919980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e85e9170f0 con 0x55e85ea0a620 2024-03-20T13:36:59.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9496c33640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e85ea0a620 0x55e85ea0ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9496c33640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e85ea0a620 0x55e85ea0ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54428/0 (socket says 172.21.15.123:54428) 2024-03-20T13:36:59.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9497434640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55e85ea06120 0x55e85ea06500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59108/0 (socket says 172.21.15.123:59108) 2024-03-20T13:36:59.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9496c33640 1 -- 172.21.15.123:0/3042496155 learned_addr learned my addr 172.21.15.123:0/3042496155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9496c33640 1 -- 172.21.15.123:0/3042496155 >> v1:172.21.15.89:6789/0 conn(0x55e85ea06120 legacy=0x55e85ea06500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9496c33640 1 -- 172.21.15.123:0/3042496155 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85ea0df60 con 0x55e85ea0a620 2024-03-20T13:36:59.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.910+0000 7f9496c33640 1 --2- 172.21.15.123:0/3042496155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea0a620 0x55e85ea0ca10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f948c00a5c0 tx=0x7f948c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06a8c7ae4b3033d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9496432640 1 -- 172.21.15.123:0/3042496155 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948c0aa470 con 0x55e85ea0a620 2024-03-20T13:36:59.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9496432640 1 -- 172.21.15.123:0/3042496155 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c0aa5d0 con 0x55e85ea0a620 2024-03-20T13:36:59.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9496432640 1 -- 172.21.15.123:0/3042496155 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948c0aa890 con 0x55e85ea0a620 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 -- 172.21.15.123:0/3042496155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea0a620 msgr2=0x55e85ea0ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 --2- 172.21.15.123:0/3042496155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea0a620 0x55e85ea0ca10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f948c00a5c0 tx=0x7f948c01b340 comp rx=0 tx=0).stop 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 -- 172.21.15.123:0/3042496155 shutdown_connections 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 --2- 172.21.15.123:0/3042496155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea0a620 0x55e85ea0ca10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 -- 172.21.15.123:0/3042496155 >> 172.21.15.123:0/3042496155 conn(0x55e85e979840 msgr2=0x55e85e979c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 -- 172.21.15.123:0/3042496155 shutdown_connections 2024-03-20T13:36:59.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.914+0000 7f9499919980 1 -- 172.21.15.123:0/3042496155 wait complete. 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 Processor -- start 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- start start 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaeffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e85e914620 con 0x55e85ea06120 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9497434640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaeffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9497434640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaeffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54438/0 (socket says 172.21.15.123:54438) 2024-03-20T13:36:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9497434640 1 -- 172.21.15.123:0/400908363 learned_addr learned my addr 172.21.15.123:0/400908363 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9497434640 1 -- 172.21.15.123:0/400908363 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c005df0 con 0x55e85ea06120 2024-03-20T13:36:59.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9497434640 1 --2- 172.21.15.123:0/400908363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaeffd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9490006fb0 tx=0x7f9490001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0f1539723c66f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f938560a640 1 -- 172.21.15.123:0/400908363 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9490013420 con 0x55e85ea06120 2024-03-20T13:36:59.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f938560a640 1 -- 172.21.15.123:0/400908363 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490013580 con 0x55e85ea06120 2024-03-20T13:36:59.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f938560a640 1 -- 172.21.15.123:0/400908363 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9490013860 con 0x55e85ea06120 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- 172.21.15.123:0/400908363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 msgr2=0x55e85eaeffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 --2- 172.21.15.123:0/400908363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaeffd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9490006fb0 tx=0x7f9490001940 comp rx=0 tx=0).stop 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- 172.21.15.123:0/400908363 shutdown_connections 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 --2- 172.21.15.123:0/400908363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaeffd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- 172.21.15.123:0/400908363 >> 172.21.15.123:0/400908363 conn(0x55e85e979840 msgr2=0x55e85eaebb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- 172.21.15.123:0/400908363 shutdown_connections 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.926+0000 7f9499919980 1 -- 172.21.15.123:0/400908363 wait complete. 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 Processor -- start 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 -- start start 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaf6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e85e90fe00 con 0x55e85ea06120 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497434640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaf6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497434640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaf6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54448/0 (socket says 172.21.15.123:54448) 2024-03-20T13:36:59.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497434640 1 -- 172.21.15.123:0/4235759358 learned_addr learned my addr 172.21.15.123:0/4235759358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497434640 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85e950510 con 0x55e85ea06120 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497434640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaf6e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55e85eaf0e60 tx=0x7f9490000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9383e07640 1 -- 172.21.15.123:0/4235759358 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94900037a0 con 0x55e85ea06120 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9383e07640 1 -- 172.21.15.123:0/4235759358 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490003900 con 0x55e85ea06120 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e85eaf7360 con 0x55e85ea06120 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9383e07640 1 -- 172.21.15.123:0/4235759358 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9490003ba0 con 0x55e85ea06120 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e85eaf7790 con 0x55e85ea06120 2024-03-20T13:36:59.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9383e07640 1 -- 172.21.15.123:0/4235759358 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9490028460 con 0x55e85ea06120 2024-03-20T13:36:59.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9383e07640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f937c0342b0 0x7f937c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9383e07640 1 -- 172.21.15.123:0/4235759358 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9490049550 con 0x55e85ea06120 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9496c33640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f937c0342b0 0x7f937c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85ea0a620 0x55e85eafdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eafdfe0 con 0x55e85ea0a620 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497c35640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85ea0a620 0x55e85eafdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9496c33640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f937c0342b0 0x7f937c036770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f948c0ae000 tx=0x7f948c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.930+0000 7f9497c35640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85ea0a620 0x55e85eafdaa0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9497c35640 1 -- 172.21.15.123:0/4235759358 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94880083f0 con 0x55e85ea0a620 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eafe850 0x55e85eb00c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb013b0 con 0x55e85eafe850 2024-03-20T13:36:59.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9497434640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eafe850 0x55e85eb00c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9497434640 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eafe850 0x55e85eb00c40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9497434640 1 -- 172.21.15.123:0/4235759358 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9490024020 con 0x55e85eafe850 2024-03-20T13:36:59.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb02c10 con 0x55e85eafe850 2024-03-20T13:36:59.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9497434640 1 -- 172.21.15.123:0/4235759358 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9490024020 con 0x55e85eafe850 2024-03-20T13:36:59.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb01e10 con 0x55e85eafe850 2024-03-20T13:36:59.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9497434640 1 -- 172.21.15.123:0/4235759358 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9490024020 con 0x55e85eafe850 2024-03-20T13:36:59.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.934+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb02220 con 0x55e85ea0a620 2024-03-20T13:36:59.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497c35640 1 -- 172.21.15.123:0/4235759358 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f94880083f0 con 0x55e85ea0a620 2024-03-20T13:36:59.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9499919980 1 Processor -- start 2024-03-20T13:36:59.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9499919980 1 -- start start 2024-03-20T13:36:59.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9499919980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 0x55e85eb116e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9499919980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e85e8a8e30 con 0x55e85eb112c0 2024-03-20T13:36:59.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497c35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 0x55e85eb116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497c35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 0x55e85eb116e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54452/0 (socket says 172.21.15.123:54452) 2024-03-20T13:36:59.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497c35640 1 -- 172.21.15.123:0/2379706660 learned_addr learned my addr 172.21.15.123:0/2379706660 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497c35640 1 -- 172.21.15.123:0/2379706660 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85eb11c20 con 0x55e85eb112c0 2024-03-20T13:36:59.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497c35640 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 0x55e85eb116e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f948800aae0 tx=0x7f9488008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9381602640 1 -- 172.21.15.123:0/2379706660 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948801d070 con 0x55e85eb112c0 2024-03-20T13:36:59.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e85eb11e70 con 0x55e85eb112c0 2024-03-20T13:36:59.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9381602640 1 -- 172.21.15.123:0/2379706660 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488010040 con 0x55e85eb112c0 2024-03-20T13:36:59.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9381602640 1 -- 172.21.15.123:0/2379706660 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488007e70 con 0x55e85eb112c0 2024-03-20T13:36:59.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e85eb129c0 con 0x55e85eb112c0 2024-03-20T13:36:59.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9381602640 1 -- 172.21.15.123:0/2379706660 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9488018430 con 0x55e85eb112c0 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9381602640 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93700342b0 0x7f9370036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9381602640 1 -- 172.21.15.123:0/2379706660 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f948804a680 con 0x55e85eb112c0 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.938+0000 7f9497434640 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93700342b0 0x7f9370036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 Processor -- start 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- start start 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497434640 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93700342b0 0x7f9370036770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55e85eb01910 tx=0x7f94900134c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb1e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e85e89c790 con 0x55e85eb1e210 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb1e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb1e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54458/0 (socket says 172.21.15.123:54458) 2024-03-20T13:36:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 -- 172.21.15.123:0/2379479956 learned_addr learned my addr 172.21.15.123:0/2379479956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 -- 172.21.15.123:0/2379479956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85eb1ec00 con 0x55e85eb1e210 2024-03-20T13:36:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 --2- 172.21.15.123:0/2379479956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb1e630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f94880489f0 tx=0x7f9488020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ec88bc2259680f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f937affd640 1 -- 172.21.15.123:0/2379479956 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488047070 con 0x55e85eb1e210 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f937affd640 1 -- 172.21.15.123:0/2379479956 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488021790 con 0x55e85eb1e210 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f937affd640 1 -- 172.21.15.123:0/2379479956 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488022560 con 0x55e85eb1e210 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- 172.21.15.123:0/2379479956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 msgr2=0x55e85eb1e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 --2- 172.21.15.123:0/2379479956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb1e630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f94880489f0 tx=0x7f9488020f00 comp rx=0 tx=0).stop 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- 172.21.15.123:0/2379479956 shutdown_connections 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 --2- 172.21.15.123:0/2379479956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb1e630 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- 172.21.15.123:0/2379479956 >> 172.21.15.123:0/2379479956 conn(0x55e85eb1a5a0 msgr2=0x55e85eb18600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- 172.21.15.123:0/2379479956 shutdown_connections 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- 172.21.15.123:0/2379479956 wait complete. 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 Processor -- start 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- start start 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb250a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e85eb255e0 con 0x55e85eb1e210 2024-03-20T13:36:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb250a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb250a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54464/0 (socket says 172.21.15.123:54464) 2024-03-20T13:36:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 learned_addr learned my addr 172.21.15.123:0/3838803553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:36:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e85eb129c0 con 0x55e85eb1e210 2024-03-20T13:36:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9497c35640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb250a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94880077a0 tx=0x7f9488048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f93797fa640 1 -- 172.21.15.123:0/3838803553 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488018940 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e85eb257e0 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f93797fa640 1 -- 172.21.15.123:0/3838803553 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488018aa0 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.942+0000 7f93797fa640 1 -- 172.21.15.123:0/3838803553 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948803a920 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e85eb25c70 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f93797fa640 1 -- 172.21.15.123:0/3838803553 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f948803ab50 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f93797fa640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93600342b0 0x7f9360036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f93797fa640 1 -- 172.21.15.123:0/3838803553 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9488036cb0 con 0x55e85eb1e210 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85eb307e0 0x55e85eb32c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9497434640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93600342b0 0x7f9360036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb333d0 con 0x55e85eb307e0 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9496c33640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85eb307e0 0x55e85eb32c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9497434640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93600342b0 0x7f9360036770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9490049880 tx=0x7f9490037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9496c33640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85eb307e0 0x55e85eb32c80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 realm 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb337c0 con 0x55e85eb307e0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb34010 con 0x55e85eb307e0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eb349f0 0x55e85eb36e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb37590 con 0x55e85eb349f0 2024-03-20T13:36:59.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9497c35640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eb349f0 0x55e85eb36e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.946+0000 7f9497c35640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eb349f0 0x55e85eb36e20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb37de0 con 0x55e85eb349f0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 20 searching for the correct realm 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e85eb39b00 0x55e85eb3bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497434640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e85eb39b00 0x55e85eb3bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497434640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e85eb39b00 0x55e85eb3bef0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497c35640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9488035070 0x7f9488017710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x7f9488035070 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9496c33640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9488035070 0x7f9488017710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9496c33640 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9488035070 0x7f9488017710 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x7f9488035070 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.950+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x7f9488035070 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x7f9488035070 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x7f9488035070 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f948c0b0020 con 0x7f9488035070 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.954+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0b0020 con 0x55e85eb307e0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x7f9488035070 2024-03-20T13:36:59.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb307e0 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x7f9488035070 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x7f9488035070 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.958+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb39b00 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c480 con 0x55e85eb349f0 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:59.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb386e0 con 0x55e85eb307e0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.962+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb38ac0 con 0x55e85eb349f0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb38ee0 con 0x55e85eb307e0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 zone default found 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 4 Realm: () 2024-03-20T13:36:59.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 zonegroup default 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3c9b0 con 0x55e85eb39b00 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados->read ofs=0 len=0 2024-03-20T13:36:59.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3f020 con 0x55e85eb39b00 2024-03-20T13:36:59.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:59.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 started sync module instance, tier type = 2024-03-20T13:36:59.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:36:59.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3e510 con 0x55e85eb349f0 2024-03-20T13:36:59.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94456509622464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3e510 con 0x55e85eb349f0 2024-03-20T13:36:59.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.966+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3fa50 con 0x55e85eb307e0 2024-03-20T13:36:59.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94456509625776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3f9d0 con 0x55e85eb307e0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb40930 con 0x55e85eb349f0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94456509625776] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94456509622464] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94456509620336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb408f0 con 0x55e85eb349f0 2024-03-20T13:36:59.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb41180 con 0x7f9488035070 2024-03-20T13:36:59.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94456509631712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb408f0 con 0x7f9488035070 2024-03-20T13:36:59.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.970+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb41cd0 con 0x55e85eb349f0 2024-03-20T13:36:59.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94456509631712] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94456509620336] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94456509629456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb41cd0 con 0x55e85eb349f0 2024-03-20T13:36:59.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb42080 con 0x55e85eb39b00 2024-03-20T13:36:59.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94456509632768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb42880 con 0x55e85eb39b00 2024-03-20T13:36:59.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb43320 con 0x55e85eb39b00 2024-03-20T13:36:59.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94456509629456] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94456509632768] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94456509637600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb417f0 con 0x55e85eb39b00 2024-03-20T13:36:59.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.974+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb43ce0 con 0x7f9488035070 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94456509637600] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94456509640192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb43ce0 con 0x7f9488035070 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=0 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=1 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=2 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=3 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=4 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=5 2024-03-20T13:36:59.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=6 2024-03-20T13:36:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94456509640192] v32'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x7f9488035070 2024-03-20T13:36:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 20 add_watcher() i=7 2024-03-20T13:36:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:59.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb47050 con 0x55e85eb307e0 2024-03-20T13:36:59.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.978+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94456509655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb43e50 con 0x55e85eb307e0 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94456509655632] v32'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f934dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9499919980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9499919980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9499919980 5 note: GC not initialized 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f934cfe1640 20 reqs_thread_entry: start 2024-03-20T13:36:59.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9499919980 20 init_complete bucket index max shards: 11 2024-03-20T13:36:59.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9499919980 20 Filter name: none 2024-03-20T13:36:59.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f92c67fc640 20 reqs_thread_entry: start 2024-03-20T13:36:59.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb68780 con 0x55e85eb39b00 2024-03-20T13:36:59.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb42880 con 0x55e85eb349f0 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb38ac0 con 0x55e85eb307e0 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0d5060 con 0x55e85eb307e0 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:36:59.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb349f0 2024-03-20T13:36:59.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.982+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:36:59.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb349f0 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(71 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:36:59.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:36:59.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb349f0 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.986+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb349f0 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:36:59.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb307e0 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:37:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb349f0 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x55e85eb39b00 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.990+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3cd60 con 0x7f9488035070 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f9499919980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f9499919980 20 RGWRados::pool_iterate: got myfoo 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f934dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94456509655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb38ac0 con 0x55e85eb307e0 2024-03-20T13:37:00.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94456509655632] v32'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:37:00.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.994+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94456509622464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb38ac0 con 0x55e85eb349f0 2024-03-20T13:37:00.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94456509622464] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:37:00.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 20 remove_watcher() i=0 2024-03-20T13:37:00.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 2 removed watcher, disabling cache 2024-03-20T13:37:00.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94456509625776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3e8c0 con 0x55e85eb307e0 2024-03-20T13:37:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94456509625776] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0dd040 con 0x55e85eb307e0 2024-03-20T13:37:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 20 remove_watcher() i=1 2024-03-20T13:37:00.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94456509620336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3e8c0 con 0x55e85eb349f0 2024-03-20T13:37:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94456509620336] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:37:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 20 remove_watcher() i=2 2024-03-20T13:37:00.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:36:59.998+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94456509631712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3e070 con 0x7f9488035070 2024-03-20T13:37:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94456509631712] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:37:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9499919980 20 remove_watcher() i=3 2024-03-20T13:37:00.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94456509629456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb3e8c0 con 0x55e85eb349f0 2024-03-20T13:37:00.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9497c35640 1 -- 172.21.15.123:0/3838803553 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94456509629456] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9488041040 con 0x55e85eb349f0 2024-03-20T13:37:00.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9499919980 20 remove_watcher() i=4 2024-03-20T13:37:00.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94456509632768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb40ce0 con 0x55e85eb39b00 2024-03-20T13:37:00.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94456509632768] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:37:00.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9499919980 20 remove_watcher() i=5 2024-03-20T13:37:00.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.002+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94456509637600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb40410 con 0x55e85eb39b00 2024-03-20T13:37:00.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9497434640 1 -- 172.21.15.123:0/3838803553 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94456509637600] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9490024020 con 0x55e85eb39b00 2024-03-20T13:37:00.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 20 remove_watcher() i=6 2024-03-20T13:37:00.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94456509640192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e85eb40410 con 0x7f9488035070 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94456509640192] v32'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f948c0dd040 con 0x7f9488035070 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 20 remove_watcher() i=7 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eb349f0 msgr2=0x55e85eb36e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eb349f0 0x55e85eb36e20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85eb307e0 msgr2=0x55e85eb32c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85eb307e0 0x55e85eb32c80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9488035070 msgr2=0x7f9488017710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9488035070 0x7f9488017710 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e85eb39b00 msgr2=0x55e85eb3bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55e85eb39b00 0x55e85eb3bef0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93600342b0 msgr2=0x7f9360036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93600342b0 0x7f9360036770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9490049880 tx=0x7f9490037000 comp rx=0 tx=0).stop 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9496c33640 1 -- 172.21.15.123:0/3838803553 reap_dead start 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 msgr2=0x55e85eb250a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb250a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94880077a0 tx=0x7f9488048980 comp rx=0 tx=0).stop 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 shutdown_connections 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/3838803553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb1e210 0x55e85eb250a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 >> 172.21.15.123:0/3838803553 conn(0x55e85eb1a5a0 msgr2=0x55e85eb17c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 shutdown_connections 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/3838803553 wait complete. 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93700342b0 msgr2=0x7f9370036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93700342b0 0x7f9370036770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55e85eb01910 tx=0x7f94900134c0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 msgr2=0x55e85eb116e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 0x55e85eb116e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f948800aae0 tx=0x7f9488008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:00.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 shutdown_connections 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93700342b0 0x7f9370036770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/2379706660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85eb112c0 0x55e85eb116e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 >> 172.21.15.123:0/2379706660 conn(0x55e85eb06100 msgr2=0x55e85eb06c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 shutdown_connections 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/2379706660 wait complete. 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eafe850 msgr2=0x55e85eb00c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eafe850 0x55e85eb00c40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85ea0a620 msgr2=0x55e85eafdaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85ea0a620 0x55e85eafdaa0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f937c0342b0 msgr2=0x7f937c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f937c0342b0 0x7f937c036770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f948c0ae000 tx=0x7f948c0a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 msgr2=0x55e85eaf6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaf6e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55e85eaf0e60 tx=0x7f9490000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:00.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 shutdown_connections 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55e85eafe850 0x55e85eb00c40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55e85ea0a620 0x55e85eafdaa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f937c0342b0 0x7f937c036770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 --2- 172.21.15.123:0/4235759358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e85ea06120 0x55e85eaf6e20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 >> 172.21.15.123:0/4235759358 conn(0x55e85e979840 msgr2=0x55e85eaea670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 shutdown_connections 2024-03-20T13:37:00.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.006+0000 7f9499919980 1 -- 172.21.15.123:0/4235759358 wait complete. 2024-03-20T13:37:00.023 INFO:teuthology.orchestra.run.smithi123.stdout:["myfoo"] 2024-03-20T13:37:00.023 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-03-20T13:37:00.037 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.054 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.071 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.118 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-03-20T13:37:00.173 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.234 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.294 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:37:00.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:37:00.295 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-03-20T13:37:00.327 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:00.327 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:00.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa2c1f980 1 Processor -- start 2024-03-20T13:37:00.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa2c1f980 1 -- start start 2024-03-20T13:37:00.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa2c1f980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d4c7d82f40 0x55d4c7d83320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa2c1f980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d4c7ccf520 con 0x55d4c7d83860 2024-03-20T13:37:00.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa2c1f980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d4c7c960f0 con 0x55d4c7d82f40 2024-03-20T13:37:00.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7f9ff39640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55d4c7d83860 0x55d4c7d84220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59112/0 (socket says 172.21.15.123:59112) 2024-03-20T13:37:00.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7f9ff39640 1 -- 172.21.15.123:0/1750632097 learned_addr learned my addr 172.21.15.123:0/1750632097 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:00.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa073a640 1 --2- 172.21.15.123:0/1750632097 >> v2:172.21.15.89:3300/0 conn(0x55d4c7d82f40 0x55d4c7d83320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7f9f738640 1 -- 172.21.15.123:0/1750632097 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201208081 0 0) 0x55d4c7ccf520 con 0x55d4c7d83860 2024-03-20T13:37:00.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7f9f738640 1 -- 172.21.15.123:0/1750632097 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f88001e20 con 0x55d4c7d83860 2024-03-20T13:37:00.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa073a640 1 -- 172.21.15.123:0/1750632097 >> v1:172.21.15.89:6789/0 conn(0x55d4c7d83860 legacy=0x55d4c7d84220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.322+0000 7f7fa073a640 1 -- 172.21.15.123:0/1750632097 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c7d84a50 con 0x55d4c7d82f40 2024-03-20T13:37:00.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa073a640 1 --2- 172.21.15.123:0/1750632097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7d83320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400a480 tx=0x7f7f9401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8b5c5d1ca96fd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7f9f738640 1 -- 172.21.15.123:0/1750632097 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f940ab540 con 0x55d4c7d82f40 2024-03-20T13:37:00.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7f9f738640 1 -- 172.21.15.123:0/1750632097 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f940ab6a0 con 0x55d4c7d82f40 2024-03-20T13:37:00.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7f9f738640 1 -- 172.21.15.123:0/1750632097 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f940ab940 con 0x55d4c7d82f40 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/1750632097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 msgr2=0x55d4c7d83320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/1750632097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7d83320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400a480 tx=0x7f7f9401b280 comp rx=0 tx=0).stop 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/1750632097 shutdown_connections 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/1750632097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7d83320 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/1750632097 >> 172.21.15.123:0/1750632097 conn(0x55d4c7d7e810 msgr2=0x55d4c7d80c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/1750632097 shutdown_connections 2024-03-20T13:37:00.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.326+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/1750632097 wait complete. 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa2c1f980 1 Processor -- start 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa2c1f980 1 -- start start 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa2c1f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e6d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa2c1f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c7c93620 con 0x55d4c7d82f40 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa073a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e6d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa073a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e6d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54480/0 (socket says 172.21.15.123:54480) 2024-03-20T13:37:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa073a640 1 -- 172.21.15.123:0/354377177 learned_addr learned my addr 172.21.15.123:0/354377177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa073a640 1 -- 172.21.15.123:0/354377177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94005d30 con 0x55d4c7d82f40 2024-03-20T13:37:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.346+0000 7f7fa073a640 1 --2- 172.21.15.123:0/354377177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e6d220 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f94018eb0 tx=0x7f7f94003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67889671d27943c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7e8e60c640 1 -- 172.21.15.123:0/354377177 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f940ab810 con 0x55d4c7d82f40 2024-03-20T13:37:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7e8e60c640 1 -- 172.21.15.123:0/354377177 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f940ab970 con 0x55d4c7d82f40 2024-03-20T13:37:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7e8e60c640 1 -- 172.21.15.123:0/354377177 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f940abc30 con 0x55d4c7d82f40 2024-03-20T13:37:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/354377177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 msgr2=0x55d4c7e6d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/354377177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e6d220 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f94018eb0 tx=0x7f7f94003030 comp rx=0 tx=0).stop 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/354377177 shutdown_connections 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/354377177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e6d220 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/354377177 >> 172.21.15.123:0/354377177 conn(0x55d4c7d7e810 msgr2=0x55d4c7e68db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/354377177 shutdown_connections 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/354377177 wait complete. 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 Processor -- start 2024-03-20T13:37:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- start start 2024-03-20T13:37:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e73f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c7c8ee00 con 0x55d4c7d82f40 2024-03-20T13:37:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa073a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e73f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa073a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e73f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54492/0 (socket says 172.21.15.123:54492) 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa073a640 1 -- 172.21.15.123:0/3859689922 learned_addr learned my addr 172.21.15.123:0/3859689922 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa073a640 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c7d84a50 con 0x55d4c7d82f40 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e73f50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7f9401bb20 tx=0x7f7f94018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7e8ce09640 1 -- 172.21.15.123:0/3859689922 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f940c3070 con 0x55d4c7d82f40 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4c7e74490 con 0x55d4c7d82f40 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7e8ce09640 1 -- 172.21.15.123:0/3859689922 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f940be9c0 con 0x55d4c7d82f40 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7e8ce09640 1 -- 172.21.15.123:0/3859689922 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f940beca0 con 0x55d4c7d82f40 2024-03-20T13:37:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.350+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4c7e748c0 con 0x55d4c7d82f40 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7e8ce09640 1 -- 172.21.15.123:0/3859689922 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7f940b2070 con 0x55d4c7d82f40 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7e8ce09640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e880342b0 0x7f7e88036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7e8ce09640 1 -- 172.21.15.123:0/3859689922 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7f940e3770 con 0x55d4c7d82f40 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7f9ff39640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e880342b0 0x7f7e88036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7d83860 0x55d4c7e7ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7e7b070 con 0x55d4c7d83860 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7d83860 0x55d4c7e7ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7f9ff39640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e880342b0 0x7f7e88036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f900012f0 tx=0x7f7f90001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7d83860 0x55d4c7e7ab30 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3859689922 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f980083f0 con 0x55d4c7d83860 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7e7b8e0 0x55d4c7e7dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7e7e3b0 con 0x55d4c7e7b8e0 2024-03-20T13:37:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7e7b8e0 0x55d4c7e7dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7e7b8e0 0x55d4c7e7dcd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa073a640 1 -- 172.21.15.123:0/3859689922 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f940aa9f0 con 0x55d4c7e7b8e0 2024-03-20T13:37:00.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7e7fc10 con 0x55d4c7e7b8e0 2024-03-20T13:37:00.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa073a640 1 -- 172.21.15.123:0/3859689922 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7f940d7040 con 0x55d4c7e7b8e0 2024-03-20T13:37:00.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.354+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7e7ee10 con 0x55d4c7e7b8e0 2024-03-20T13:37:00.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa073a640 1 -- 172.21.15.123:0/3859689922 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f940d7040 con 0x55d4c7e7b8e0 2024-03-20T13:37:00.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7e7f220 con 0x55d4c7d83860 2024-03-20T13:37:00.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3859689922 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7f980083f0 con 0x55d4c7d83860 2024-03-20T13:37:00.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 Processor -- start 2024-03-20T13:37:00.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 -- start start 2024-03-20T13:37:00.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 0x55d4c7e8e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c7c27e30 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa0f3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 0x55d4c7e8e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa0f3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 0x55d4c7e8e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54502/0 (socket says 172.21.15.123:54502) 2024-03-20T13:37:00.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3906093878 learned_addr learned my addr 172.21.15.123:0/3906093878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3906093878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c7e8ed00 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 0x55d4c7e8e7c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800aae0 tx=0x7f7f98008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7e85ffb640 1 -- 172.21.15.123:0/3906093878 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f9801d070 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7e85ffb640 1 -- 172.21.15.123:0/3906093878 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98010040 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4c7e8ef50 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7e85ffb640 1 -- 172.21.15.123:0/3906093878 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f98007e70 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4c7e8faa0 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.358+0000 7f7e85ffb640 1 -- 172.21.15.123:0/3906093878 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7f98018430 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7e85ffb640 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e780342b0 0x7f7e78036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7e85ffb640 1 -- 172.21.15.123:0/3906093878 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7f9804a600 con 0x55d4c7e8e3a0 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e780342b0 0x7f7e78036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 Processor -- start 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- start start 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e780342b0 0x7f7e78036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55d4c7e7e850 tx=0x7f7f940b55f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7e9b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c7c1b790 con 0x55d4c7e9b340 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7e9b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7e9b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54518/0 (socket says 172.21.15.123:54518) 2024-03-20T13:37:00.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/2454515713 learned_addr learned my addr 172.21.15.123:0/2454515713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/2454515713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c7e9bd30 con 0x55d4c7e9b340 2024-03-20T13:37:00.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/2454515713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7e9b760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f980489f0 tx=0x7f7f98048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89273c86395268f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7e7f7fe640 1 -- 172.21.15.123:0/2454515713 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f98047070 con 0x55d4c7e9b340 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7e7f7fe640 1 -- 172.21.15.123:0/2454515713 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98022410 con 0x55d4c7e9b340 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7e7f7fe640 1 -- 172.21.15.123:0/2454515713 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f98016330 con 0x55d4c7e9b340 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/2454515713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 msgr2=0x55d4c7e9b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/2454515713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7e9b760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f980489f0 tx=0x7f7f98048f00 comp rx=0 tx=0).stop 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/2454515713 shutdown_connections 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/2454515713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7e9b760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/2454515713 >> 172.21.15.123:0/2454515713 conn(0x55d4c7e97680 msgr2=0x55d4c7e956e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/2454515713 shutdown_connections 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/2454515713 wait complete. 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 Processor -- start 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- start start 2024-03-20T13:37:00.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7ea2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa2c1f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4c7ea26d0 con 0x55d4c7e9b340 2024-03-20T13:37:00.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7ea2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7ea2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54532/0 (socket says 172.21.15.123:54532) 2024-03-20T13:37:00.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 learned_addr learned my addr 172.21.15.123:0/3480007516 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4c7e8faa0 con 0x55d4c7e9b340 2024-03-20T13:37:00.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.362+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7ea2190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f98020890 tx=0x7f7f98048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7e7dffb640 1 -- 172.21.15.123:0/3480007516 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f98022580 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4c7ea28d0 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7e7dffb640 1 -- 172.21.15.123:0/3480007516 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9804a960 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7e7dffb640 1 -- 172.21.15.123:0/3480007516 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f9804ac00 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4c7ea2d60 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7e7dffb640 1 -- 172.21.15.123:0/3480007516 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7f98018730 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7e7dffb640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e70034260 0x7f7e70036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7e7dffb640 1 -- 172.21.15.123:0/3480007516 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7f98037c60 con 0x55d4c7e9b340 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e70034260 0x7f7e70036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7ead8a0 0x55d4c7eafd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb04b0 con 0x55d4c7ead8a0 2024-03-20T13:37:00.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7f9ff39640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7ead8a0 0x55d4c7eafd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e70034260 0x7f7e70036720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f940c6fd0 tx=0x7f7f940bef30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7f9ff39640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7ead8a0 0x55d4c7eafd60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f900060d0 con 0x55d4c7ead8a0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 realm 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eacd80 con 0x55d4c7ead8a0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb0f30 con 0x55d4c7ead8a0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7eb1aa0 0x55d4c7eb3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb46d0 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.366+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7eb1aa0 0x55d4c7eb3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7eb1aa0 0x55d4c7eb3f60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb4f20 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 20 searching for the correct realm 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d4c7eb6c40 0x55d4c7eb9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d4c7eb6c40 0x55d4c7eb9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa073a640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d4c7eb6c40 0x55d4c7eb9030 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa0f3b640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7f98036020 0x7f7f980146b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x7f7f98036020 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7f9ff39640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7f98036020 0x7f7f980146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7f9ff39640 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7f98036020 0x7f7f980146b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.370+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x7f7f98036020 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x7f7f98036020 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.374+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x7f7f98036020 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7ead8a0 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x7f7f98036020 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x7f7f98036020 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.378+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb6c40 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9610 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb5820 con 0x55d4c7ead8a0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb5c30 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb6010 con 0x55d4c7ead8a0 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 zone default found 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 4 Realm: () 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 zonegroup default 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9ef0 con 0x7f7f98036020 2024-03-20T13:37:00.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eb9b40 con 0x55d4c7eb6c40 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.382+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebc1c0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 20 started sync module instance, tier type = 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:00.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebb6a0 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94372375542352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebb6a0 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebcc30 con 0x55d4c7ead8a0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94372375545680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebd480 con 0x55d4c7ead8a0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.386+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebdea0 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94372375542352] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94372375545680] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94372375550336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebcfe0 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebe6f0 con 0x7f7f98036020 2024-03-20T13:37:00.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94372375552592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebcfe0 con 0x7f7f98036020 2024-03-20T13:37:00.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebf160 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.390+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94372375550336] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94372375552592] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94372375553648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebec80 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebf9e0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94372375557440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebec80 con 0x55d4c7eb6c40 2024-03-20T13:37:00.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ec07f0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94372375553648] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94372375540224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ec07f0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.394+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ec1160 con 0x7f7f98036020 2024-03-20T13:37:00.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94372375557440] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94372375540224] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94372375561040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ec0770 con 0x7f7f98036020 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=0 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=1 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=2 2024-03-20T13:37:00.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=3 2024-03-20T13:37:00.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=4 2024-03-20T13:37:00.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=5 2024-03-20T13:37:00.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=6 2024-03-20T13:37:00.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94372375561040] v32'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 20 add_watcher() i=7 2024-03-20T13:37:00.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:00.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ec4190 con 0x55d4c7ead8a0 2024-03-20T13:37:00.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.398+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94372375563456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ec1650 con 0x55d4c7ead8a0 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94372375563456] v32'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7e567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 5 note: GC not initialized 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7e557e2640 20 reqs_thread_entry: start 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 Filter name: none 2024-03-20T13:37:00.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7dc6ffd640 20 reqs_thread_entry: start 2024-03-20T13:37:00.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ee6090 con 0x7f7f98036020 2024-03-20T13:37:00.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:00.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ee6630 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(63 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ee5710 con 0x7f7f98036020 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:00.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.402+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ee7ab0 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 4.26 4:648b71d5:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ee7560 con 0x55d4c7ead8a0 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 4.17 4:ea60608e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eec4c0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 4.14 4:2b6b807a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eeeec0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 4.f 4:f12bebf7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ef1760 con 0x55d4c7ead8a0 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 4.6 4:63dad39e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eeeec0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 4.3a 4:5c9c4310:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ef6780 con 0x55d4c7eb6c40 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ef93a0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 4.35 4:ad3fb945:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ef93a0 con 0x55d4c7ead8a0 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(66 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 4.7 4:e13968f4:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ee6fe0 con 0x55d4c7ead8a0 2024-03-20T13:37:00.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(67 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 4.19 4:98befe71:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7efebf0 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 4.34 4:2d65569c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eeb090 con 0x7f7f98036020 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(68 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(70 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(73 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(74 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 6.11 6:8f1457b9:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7eeb090 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7e567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.406+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94372375563456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7ead8a0 2024-03-20T13:37:00.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94372375563456] v32'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94372375542352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94372375542352] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7fa2c1f980 20 remove_watcher() i=0 2024-03-20T13:37:00.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7fa2c1f980 2 removed watcher, disabling cache 2024-03-20T13:37:00.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94372375545680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7ead8a0 2024-03-20T13:37:00.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.410+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94372375545680] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x55d4c7ead8a0 2024-03-20T13:37:00.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa2c1f980 20 remove_watcher() i=1 2024-03-20T13:37:00.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94372375550336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94372375550336] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa2c1f980 20 remove_watcher() i=2 2024-03-20T13:37:00.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94372375552592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebd980 con 0x7f7f98036020 2024-03-20T13:37:00.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94372375552592] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa2c1f980 20 remove_watcher() i=3 2024-03-20T13:37:00.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.414+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94372375553648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa0f3b640 1 -- 172.21.15.123:0/3480007516 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94372375553648] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f98033070 con 0x55d4c7eb1aa0 2024-03-20T13:37:00.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa2c1f980 20 remove_watcher() i=4 2024-03-20T13:37:00.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94372375557440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7eb6c40 2024-03-20T13:37:00.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94372375557440] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa2c1f980 20 remove_watcher() i=5 2024-03-20T13:37:00.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94372375540224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ed7d90 con 0x55d4c7eb6c40 2024-03-20T13:37:00.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa073a640 1 -- 172.21.15.123:0/3480007516 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94372375540224] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f940eb040 con 0x55d4c7eb6c40 2024-03-20T13:37:00.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa2c1f980 20 remove_watcher() i=6 2024-03-20T13:37:00.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.418+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94372375561040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4c7ebb200 con 0x7f7f98036020 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94372375561040] v32'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f90004530 con 0x7f7f98036020 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 20 remove_watcher() i=7 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7eb1aa0 msgr2=0x55d4c7eb3f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7eb1aa0 0x55d4c7eb3f60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7ead8a0 msgr2=0x55d4c7eafd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7ead8a0 0x55d4c7eafd60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7f98036020 msgr2=0x7f7f980146b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7f98036020 0x7f7f980146b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d4c7eb6c40 msgr2=0x55d4c7eb9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d4c7eb6c40 0x55d4c7eb9030 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e70034260 msgr2=0x7f7e70036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e70034260 0x7f7e70036720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f940c6fd0 tx=0x7f7f940bef30 comp rx=0 tx=0).stop 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7f9ff39640 1 -- 172.21.15.123:0/3480007516 reap_dead start 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 msgr2=0x55d4c7ea2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7ea2190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f98020890 tx=0x7f7f98048980 comp rx=0 tx=0).stop 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 shutdown_connections 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3480007516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e9b340 0x55d4c7ea2190 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 >> 172.21.15.123:0/3480007516 conn(0x55d4c7e97680 msgr2=0x55d4c7e94ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 shutdown_connections 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3480007516 wait complete. 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e780342b0 msgr2=0x7f7e78036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e780342b0 0x7f7e78036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55d4c7e7e850 tx=0x7f7f940b55f0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 msgr2=0x55d4c7e8e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 0x55d4c7e8e7c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800aae0 tx=0x7f7f98008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 shutdown_connections 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e780342b0 0x7f7e78036770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3906093878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7e8e3a0 0x55d4c7e8e7c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 >> 172.21.15.123:0/3906093878 conn(0x55d4c7e831b0 msgr2=0x55d4c7e83cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 shutdown_connections 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3906093878 wait complete. 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7e7b8e0 msgr2=0x55d4c7e7dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7e7b8e0 0x55d4c7e7dcd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7d83860 msgr2=0x55d4c7e7ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7d83860 0x55d4c7e7ab30 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e880342b0 msgr2=0x7f7e88036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e880342b0 0x7f7e88036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f900012f0 tx=0x7f7f90001430 comp rx=0 tx=0).stop 2024-03-20T13:37:00.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 msgr2=0x55d4c7e73f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e73f50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7f9401bb20 tx=0x7f7f94018020 comp rx=0 tx=0).stop 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 shutdown_connections 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d4c7e7b8e0 0x55d4c7e7dcd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d4c7d83860 0x55d4c7e7ab30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7e880342b0 0x7f7e88036770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 --2- 172.21.15.123:0/3859689922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4c7d82f40 0x55d4c7e73f50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 >> 172.21.15.123:0/3859689922 conn(0x55d4c7d7e810 msgr2=0x55d4c7e678c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 shutdown_connections 2024-03-20T13:37:00.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.422+0000 7f7fa2c1f980 1 -- 172.21.15.123:0/3859689922 wait complete. 2024-03-20T13:37:00.437 INFO:teuthology.orchestra.run.smithi123.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8ee97edf-01dc-402c-a19d-759426cef768","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","marker":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:36:59.688380Z","creation_time":"2024-03-20T13:36:59.684227Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-03-20T13:37:00.437 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8ee97edf-01dc-402c-a19d-759426cef768', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'marker': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:36:59.688380Z', 'creation_time': '2024-03-20T13:36:59.684227Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-03-20T13:37:00.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:37:00.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:37:00.437 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-03-20T13:37:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530d11e980 1 Processor -- start 2024-03-20T13:37:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530d11e980 1 -- start start 2024-03-20T13:37:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530d11e980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5635a61eb8b0 0x5635a627c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530d11e980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5635a61c3520 con 0x5635a627c570 2024-03-20T13:37:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530d11e980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5635a618a0f0 con 0x5635a61eb8b0 2024-03-20T13:37:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530ac39640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5635a61eb8b0 0x5635a627c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530a438640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5635a627c570 0x5635a627e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59126/0 (socket says 172.21.15.123:59126) 2024-03-20T13:37:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530a438640 1 -- 172.21.15.123:0/60132761 learned_addr learned my addr 172.21.15.123:0/60132761 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530ac39640 1 -- 172.21.15.123:0/60132761 >> v1:172.21.15.89:6789/0 conn(0x5635a627c570 legacy=0x5635a627e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530ac39640 1 -- 172.21.15.123:0/60132761 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a6277a50 con 0x5635a61eb8b0 2024-03-20T13:37:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.502+0000 7f530ac39640 1 --2- 172.21.15.123:0/60132761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a627c030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00a480 tx=0x7f52fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c407a07091514b96 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f5309c37640 1 -- 172.21.15.123:0/60132761 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52fc0ab540 con 0x5635a61eb8b0 2024-03-20T13:37:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f5309c37640 1 -- 172.21.15.123:0/60132761 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0ab6a0 con 0x5635a61eb8b0 2024-03-20T13:37:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f5309c37640 1 -- 172.21.15.123:0/60132761 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52fc0ab960 con 0x5635a61eb8b0 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 -- 172.21.15.123:0/60132761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 msgr2=0x5635a627c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 --2- 172.21.15.123:0/60132761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a627c030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00a480 tx=0x7f52fc01b280 comp rx=0 tx=0).stop 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 -- 172.21.15.123:0/60132761 shutdown_connections 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 --2- 172.21.15.123:0/60132761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a627c030 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 -- 172.21.15.123:0/60132761 >> 172.21.15.123:0/60132761 conn(0x5635a6271710 msgr2=0x5635a6273b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 -- 172.21.15.123:0/60132761 shutdown_connections 2024-03-20T13:37:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.506+0000 7f530d11e980 1 -- 172.21.15.123:0/60132761 wait complete. 2024-03-20T13:37:00.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530d11e980 1 Processor -- start 2024-03-20T13:37:00.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530d11e980 1 -- start start 2024-03-20T13:37:00.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530d11e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6363110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530d11e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a6187620 con 0x5635a61eb8b0 2024-03-20T13:37:00.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530ac39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6363110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530ac39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6363110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54544/0 (socket says 172.21.15.123:54544) 2024-03-20T13:37:00.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530ac39640 1 -- 172.21.15.123:0/3685618810 learned_addr learned my addr 172.21.15.123:0/3685618810 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530ac39640 1 -- 172.21.15.123:0/3685618810 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc005d30 con 0x5635a61eb8b0 2024-03-20T13:37:00.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f530ac39640 1 --2- 172.21.15.123:0/3685618810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6363110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f52fc018eb0 tx=0x7f52fc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c46954d6acf8836 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f51f8e09640 1 -- 172.21.15.123:0/3685618810 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52fc0ab810 con 0x5635a61eb8b0 2024-03-20T13:37:00.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f51f8e09640 1 -- 172.21.15.123:0/3685618810 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0ab970 con 0x5635a61eb8b0 2024-03-20T13:37:00.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.518+0000 7f51f8e09640 1 -- 172.21.15.123:0/3685618810 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52fc0abc30 con 0x5635a61eb8b0 2024-03-20T13:37:00.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/3685618810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 msgr2=0x5635a6363110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 --2- 172.21.15.123:0/3685618810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6363110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f52fc018eb0 tx=0x7f52fc003030 comp rx=0 tx=0).stop 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/3685618810 shutdown_connections 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 --2- 172.21.15.123:0/3685618810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6363110 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/3685618810 >> 172.21.15.123:0/3685618810 conn(0x5635a6271710 msgr2=0x5635a635eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/3685618810 shutdown_connections 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/3685618810 wait complete. 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 Processor -- start 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- start start 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6369e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a6182e00 con 0x5635a61eb8b0 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530ac39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6369e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530ac39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6369e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54560/0 (socket says 172.21.15.123:54560) 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530ac39640 1 -- 172.21.15.123:0/228634880 learned_addr learned my addr 172.21.15.123:0/228634880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530ac39640 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a6277a50 con 0x5635a61eb8b0 2024-03-20T13:37:00.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530ac39640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6369e00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f52fc01b2c0 tx=0x7f52fc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f51f7606640 1 -- 172.21.15.123:0/228634880 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52fc0c3070 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635a636a340 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f51f7606640 1 -- 172.21.15.123:0/228634880 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0b5540 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f51f7606640 1 -- 172.21.15.123:0/228634880 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52fc0b57e0 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635a636a710 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f51f7606640 1 -- 172.21.15.123:0/228634880 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f52fc0b2070 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f51f7606640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f00342b0 0x7f51f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f51f7606640 1 -- 172.21.15.123:0/228634880 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f52fc0e3f60 con 0x5635a61eb8b0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530a438640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f00342b0 0x7f51f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a627c570 0x5635a6370a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a6370f70 con 0x5635a627c570 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.522+0000 7f530b43a640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a627c570 0x5635a6370a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530a438640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f00342b0 0x7f51f0036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5300001da0 tx=0x7f5300001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530b43a640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a627c570 0x5635a6370a30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530b43a640 1 -- 172.21.15.123:0/228634880 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530400a4d0 con 0x5635a627c570 2024-03-20T13:37:00.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63717e0 0x5635a6373bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a6374230 con 0x5635a63717e0 2024-03-20T13:37:00.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530ac39640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63717e0 0x5635a6373bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530ac39640 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63717e0 0x5635a6373bd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530ac39640 1 -- 172.21.15.123:0/228634880 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63717e0 2024-03-20T13:37:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a6375a70 con 0x5635a63717e0 2024-03-20T13:37:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530ac39640 1 -- 172.21.15.123:0/228634880 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63717e0 2024-03-20T13:37:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a6374b50 con 0x5635a63717e0 2024-03-20T13:37:00.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530ac39640 1 -- 172.21.15.123:0/228634880 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63717e0 2024-03-20T13:37:00.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a6374f60 con 0x5635a627c570 2024-03-20T13:37:00.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.526+0000 7f530b43a640 1 -- 172.21.15.123:0/228634880 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f530400a4d0 con 0x5635a627c570 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 Processor -- start 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 -- start start 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 0x5635a6384510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a611be30 con 0x5635a63840f0 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530b43a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 0x5635a6384510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530b43a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 0x5635a6384510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54568/0 (socket says 172.21.15.123:54568) 2024-03-20T13:37:00.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530b43a640 1 -- 172.21.15.123:0/2887406820 learned_addr learned my addr 172.21.15.123:0/2887406820 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530b43a640 1 -- 172.21.15.123:0/2887406820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a6384a50 con 0x5635a63840f0 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530b43a640 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 0x5635a6384510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5304016cf0 tx=0x7f530400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f51f4e01640 1 -- 172.21.15.123:0/2887406820 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5304017660 con 0x5635a63840f0 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635a6384ca0 con 0x5635a63840f0 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f51f4e01640 1 -- 172.21.15.123:0/2887406820 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040177c0 con 0x5635a63840f0 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f51f4e01640 1 -- 172.21.15.123:0/2887406820 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5304017a60 con 0x5635a63840f0 2024-03-20T13:37:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635a63857f0 con 0x5635a63840f0 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f51f4e01640 1 -- 172.21.15.123:0/2887406820 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f530401d020 con 0x5635a63840f0 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f51f4e01640 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e40342b0 0x7f51e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f51f4e01640 1 -- 172.21.15.123:0/2887406820 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f530404b1b0 con 0x5635a63840f0 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530ac39640 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e40342b0 0x7f51e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 Processor -- start 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 -- start start 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530ac39640 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e40342b0 0x7f51e4036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5635a6374650 tx=0x7f52fc0aa6b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6391490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.530+0000 7f530d11e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a610f790 con 0x5635a6391070 2024-03-20T13:37:00.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6391490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6391490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54580/0 (socket says 172.21.15.123:54580) 2024-03-20T13:37:00.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 -- 172.21.15.123:0/3102149994 learned_addr learned my addr 172.21.15.123:0/3102149994 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 -- 172.21.15.123:0/3102149994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a6391a60 con 0x5635a6391070 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 --2- 172.21.15.123:0/3102149994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6391490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f53040495a0 tx=0x7f53040147d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a03113d96ee7cf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f51ee7fc640 1 -- 172.21.15.123:0/3102149994 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f530403b070 con 0x5635a6391070 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f51ee7fc640 1 -- 172.21.15.123:0/3102149994 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040481d0 con 0x5635a6391070 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f51ee7fc640 1 -- 172.21.15.123:0/3102149994 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5304028350 con 0x5635a6391070 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/3102149994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 msgr2=0x5635a6391490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 --2- 172.21.15.123:0/3102149994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6391490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f53040495a0 tx=0x7f53040147d0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/3102149994 shutdown_connections 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 --2- 172.21.15.123:0/3102149994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6391490 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/3102149994 >> 172.21.15.123:0/3102149994 conn(0x5635a638d3b0 msgr2=0x5635a638b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/3102149994 shutdown_connections 2024-03-20T13:37:00.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/3102149994 wait complete. 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 Processor -- start 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- start start 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6397f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a6398460 con 0x5635a6391070 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6397f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6397f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54584/0 (socket says 172.21.15.123:54584) 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 learned_addr learned my addr 172.21.15.123:0/1033192432 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a63857f0 con 0x5635a6391070 2024-03-20T13:37:00.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530b43a640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6397f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5304016ff0 tx=0x7f5304049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f51ecff9640 1 -- 172.21.15.123:0/1033192432 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5304028650 con 0x5635a6391070 2024-03-20T13:37:00.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635a6398660 con 0x5635a6391070 2024-03-20T13:37:00.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f51ecff9640 1 -- 172.21.15.123:0/1033192432 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530401fdf0 con 0x5635a6391070 2024-03-20T13:37:00.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635a6398a90 con 0x5635a6391070 2024-03-20T13:37:00.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.534+0000 7f51ecff9640 1 -- 172.21.15.123:0/1033192432 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5304011500 con 0x5635a6391070 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f51ecff9640 1 -- 172.21.15.123:0/1033192432 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5304011660 con 0x5635a6391070 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f51ecff9640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d40342b0 0x7f51d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f51ecff9640 1 -- 172.21.15.123:0/1033192432 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f5304021400 con 0x5635a6391070 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530ac39640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d40342b0 0x7f51d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a63a35c0 0x5635a63a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63a61b0 con 0x5635a63a35c0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530a438640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a63a35c0 0x5635a63a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530ac39640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d40342b0 0x7f51d4036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0aa780 tx=0x7f52fc0df000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530a438640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a63a35c0 0x5635a63a5a60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 realm 2024-03-20T13:37:00.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63a2ae0 con 0x5635a63a35c0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63a6c30 con 0x5635a63a35c0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63a77a0 0x5635a63a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63aa3d0 con 0x5635a63a77a0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530b43a640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63a77a0 0x5635a63a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530b43a640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63a77a0 0x5635a63a9c60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.538+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63aac20 con 0x5635a63a77a0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530d11e980 20 searching for the correct realm 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5635a63ac940 0x5635a63aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530ac39640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5635a63ac940 0x5635a63aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530ac39640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5635a63ac940 0x5635a63aed30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530b43a640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5304049c00 0x7f530402a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x7f5304049c00 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5304049c00 0x7f530402a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5304049c00 0x7f530402a480 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.542+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x7f5304049c00 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x7f5304049c00 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.546+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x7f5304049c00 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a35c0 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x7f5304049c00 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x7f5304049c00 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.550+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63ac940 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af2c0 con 0x5635a63a77a0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63ab520 con 0x5635a63a35c0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63ab930 con 0x5635a63a77a0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63ab930 con 0x5635a63a35c0 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f530000e640 con 0x5635a63a35c0 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 zone default found 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 4 Realm: () 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 zonegroup default 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63af6e0 con 0x7f5304049c00 2024-03-20T13:37:00.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f530000e640 con 0x7f5304049c00 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b18c0 con 0x5635a63ac940 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b1c20 con 0x5635a63ac940 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 started sync module instance, tier type = 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:00.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.554+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b0e90 con 0x5635a63a77a0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788422144576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b0e90 con 0x5635a63a77a0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b25d0 con 0x5635a63a35c0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788422148336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b2e50 con 0x5635a63a35c0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b3870 con 0x5635a63a77a0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.558+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94788422144576] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94788422148336] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788422153040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b29b0 con 0x5635a63a77a0 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b40c0 con 0x7f5304049c00 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788422155296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b29b0 con 0x7f5304049c00 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b4b70 con 0x5635a63a77a0 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94788422153040] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.562+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94788422155296] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788422156352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b4b30 con 0x5635a63a77a0 2024-03-20T13:37:00.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b4f20 con 0x5635a63ac940 2024-03-20T13:37:00.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788422142448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b5720 con 0x5635a63ac940 2024-03-20T13:37:00.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b6180 con 0x5635a63ac940 2024-03-20T13:37:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94788422156352] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788422157904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b6180 con 0x5635a63ac940 2024-03-20T13:37:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b6be0 con 0x7f5304049c00 2024-03-20T13:37:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.566+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94788422142448] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788422161024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b6be0 con 0x7f5304049c00 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=0 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=1 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=2 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=3 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=4 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=5 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94788422157904] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=6 2024-03-20T13:37:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94788422161024] v32'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 20 add_watcher() i=7 2024-03-20T13:37:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b5c70 con 0x5635a63a35c0 2024-03-20T13:37:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788422166224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b5c70 con 0x5635a63a35c0 2024-03-20T13:37:00.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.570+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94788422166224] v32'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f51c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:00.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:00.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 5 note: GC not initialized 2024-03-20T13:37:00.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f513bfff640 20 reqs_thread_entry: start 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 Filter name: none 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f5139ffb640 20 reqs_thread_entry: start 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63db6e0 con 0x5635a63a35c0 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63db6e0 con 0x7f5304049c00 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63da600 con 0x7f5304049c00 2024-03-20T13:37:00.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:00.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63daaa0 con 0x5635a63a77a0 2024-03-20T13:37:00.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 4.26 4:648b71d5:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63de170 con 0x5635a63a35c0 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 4.17 4:ea60608e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e0cc0 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 4.14 4:2b6b807a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e3880 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 4.f 4:f12bebf7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e6520 con 0x5635a63a35c0 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 4.6 4:63dad39e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e0cc0 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 4.3a 4:5c9c4310:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63eb200 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63edb60 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 4.35 4:ad3fb945:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63f0580 con 0x5635a63a35c0 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 4.7 4:e13968f4:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63f33f0 con 0x5635a63a35c0 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(68 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 4.19 4:98befe71:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e3260 con 0x5635a63ac940 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 4.34 4:2d65569c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e19b0 con 0x7f5304049c00 2024-03-20T13:37:00.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(66 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(69 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(73 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(67 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(74 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.574+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530d11e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 6.11 6:8f1457b9:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e19b0 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530d11e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f51c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788422166224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63cd920 con 0x5635a63a35c0 2024-03-20T13:37:00.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94788422166224] v32'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.578+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788422144576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63cd920 con 0x5635a63a77a0 2024-03-20T13:37:00.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94788422144576] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530d11e980 20 remove_watcher() i=0 2024-03-20T13:37:00.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530d11e980 2 removed watcher, disabling cache 2024-03-20T13:37:00.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788422148336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63cd920 con 0x5635a63a35c0 2024-03-20T13:37:00.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94788422148336] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x5635a63a35c0 2024-03-20T13:37:00.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530d11e980 20 remove_watcher() i=1 2024-03-20T13:37:00.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.582+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788422153040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63cd920 con 0x5635a63a77a0 2024-03-20T13:37:00.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94788422153040] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530d11e980 20 remove_watcher() i=2 2024-03-20T13:37:00.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788422155296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63cd920 con 0x7f5304049c00 2024-03-20T13:37:00.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94788422155296] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530d11e980 20 remove_watcher() i=3 2024-03-20T13:37:00.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788422156352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63b3c20 con 0x5635a63a77a0 2024-03-20T13:37:00.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.586+0000 7f530b43a640 1 -- 172.21.15.123:0/1033192432 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94788422156352] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5304030020 con 0x5635a63a77a0 2024-03-20T13:37:00.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 20 remove_watcher() i=4 2024-03-20T13:37:00.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788422142448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63cd920 con 0x5635a63ac940 2024-03-20T13:37:00.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94788422142448] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 20 remove_watcher() i=5 2024-03-20T13:37:00.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788422157904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e0d20 con 0x5635a63ac940 2024-03-20T13:37:00.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530ac39640 1 -- 172.21.15.123:0/1033192432 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94788422157904] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52fc0cd070 con 0x5635a63ac940 2024-03-20T13:37:00.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 20 remove_watcher() i=6 2024-03-20T13:37:00.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788422161024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5635a63e0d20 con 0x7f5304049c00 2024-03-20T13:37:00.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94788422161024] v32'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5300043040 con 0x7f5304049c00 2024-03-20T13:37:00.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 20 remove_watcher() i=7 2024-03-20T13:37:00.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63a77a0 msgr2=0x5635a63a9c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63a77a0 0x5635a63a9c60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a63a35c0 msgr2=0x5635a63a5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a63a35c0 0x5635a63a5a60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5304049c00 msgr2=0x7f530402a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5304049c00 0x7f530402a480 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5635a63ac940 msgr2=0x5635a63aed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5635a63ac940 0x5635a63aed30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d40342b0 msgr2=0x7f51d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51d40342b0 0x7f51d4036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0aa780 tx=0x7f52fc0df000 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 msgr2=0x5635a6397f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530a438640 1 -- 172.21.15.123:0/1033192432 reap_dead start 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6397f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5304016ff0 tx=0x7f5304049530 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 shutdown_connections 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/1033192432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a6391070 0x5635a6397f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 >> 172.21.15.123:0/1033192432 conn(0x5635a638d3b0 msgr2=0x5635a638aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 shutdown_connections 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/1033192432 wait complete. 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e40342b0 msgr2=0x7f51e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e40342b0 0x7f51e4036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5635a6374650 tx=0x7f52fc0aa6b0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 msgr2=0x5635a6384510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 0x5635a6384510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5304016cf0 tx=0x7f530400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 shutdown_connections 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51e40342b0 0x7f51e4036770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 --2- 172.21.15.123:0/2887406820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a63840f0 0x5635a6384510 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.590+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 >> 172.21.15.123:0/2887406820 conn(0x5635a6378f00 msgr2=0x5635a6379a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 shutdown_connections 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/2887406820 wait complete. 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63717e0 msgr2=0x5635a6373bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63717e0 0x5635a6373bd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a627c570 msgr2=0x5635a6370a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a627c570 0x5635a6370a30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f00342b0 msgr2=0x7f51f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f00342b0 0x7f51f0036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5300001da0 tx=0x7f5300001300 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 msgr2=0x5635a6369e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6369e00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f52fc01b2c0 tx=0x7f52fc018020 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 shutdown_connections 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5635a63717e0 0x5635a6373bd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5635a627c570 0x5635a6370a30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f51f00342b0 0x7f51f0036770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 --2- 172.21.15.123:0/228634880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635a61eb8b0 0x5635a6369e00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 >> 172.21.15.123:0/228634880 conn(0x5635a6271710 msgr2=0x5635a635d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 shutdown_connections 2024-03-20T13:37:00.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.594+0000 7f530d11e980 1 -- 172.21.15.123:0/228634880 wait complete. 2024-03-20T13:37:00.607 INFO:teuthology.orchestra.run.smithi123.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8ee97edf-01dc-402c-a19d-759426cef768","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","marker":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:36:59.688380Z","creation_time":"2024-03-20T13:36:59.684227Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-03-20T13:37:00.607 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8ee97edf-01dc-402c-a19d-759426cef768', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'marker': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:36:59.688380Z', 'creation_time': '2024-03-20T13:36:59.684227Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-03-20T13:37:00.616 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:37:00.616 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:37:00.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:37:00.616 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-03-20T13:37:00.675 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:00.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451feda980 1 Processor -- start 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451feda980 1 -- start start 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451feda980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5567b9bfdf80 0x5567b9bfe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451feda980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5567b9b4a520 con 0x5567b9bfe8a0 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451feda980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5567b9b110f0 con 0x5567b9bfdf80 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451d9f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5567b9bfdf80 0x5567b9bfe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451d1f4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5567b9bfe8a0 0x5567b9bff210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59130/0 (socket says 172.21.15.123:59130) 2024-03-20T13:37:00.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451d1f4640 1 -- 172.21.15.123:0/1526911224 learned_addr learned my addr 172.21.15.123:0/1526911224 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451c9f3640 1 -- 172.21.15.123:0/1526911224 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245611192 0 0) 0x5567b9b4a520 con 0x5567b9bfe8a0 2024-03-20T13:37:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451c9f3640 1 -- 172.21.15.123:0/1526911224 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4508001e20 con 0x5567b9bfe8a0 2024-03-20T13:37:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451d9f5640 1 -- 172.21.15.123:0/1526911224 >> v1:172.21.15.89:6789/0 conn(0x5567b9bfe8a0 legacy=0x5567b9bff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.670+0000 7f451d9f5640 1 -- 172.21.15.123:0/1526911224 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b9bffa40 con 0x5567b9bfdf80 2024-03-20T13:37:00.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451d9f5640 1 --2- 172.21.15.123:0/1526911224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9bfe360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f451000a480 tx=0x7f451001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ca963ac16ff716 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451c9f3640 1 -- 172.21.15.123:0/1526911224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45100ab540 con 0x5567b9bfdf80 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451c9f3640 1 -- 172.21.15.123:0/1526911224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100ab6a0 con 0x5567b9bfdf80 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451c9f3640 1 -- 172.21.15.123:0/1526911224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45100ab940 con 0x5567b9bfdf80 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 -- 172.21.15.123:0/1526911224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 msgr2=0x5567b9bfe360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 --2- 172.21.15.123:0/1526911224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9bfe360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f451000a480 tx=0x7f451001b280 comp rx=0 tx=0).stop 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 -- 172.21.15.123:0/1526911224 shutdown_connections 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 --2- 172.21.15.123:0/1526911224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9bfe360 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 -- 172.21.15.123:0/1526911224 >> 172.21.15.123:0/1526911224 conn(0x5567b9bf9850 msgr2=0x5567b9bfbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 -- 172.21.15.123:0/1526911224 shutdown_connections 2024-03-20T13:37:00.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.674+0000 7f451feda980 1 -- 172.21.15.123:0/1526911224 wait complete. 2024-03-20T13:37:00.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.686+0000 7f451feda980 1 Processor -- start 2024-03-20T13:37:00.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.686+0000 7f451feda980 1 -- start start 2024-03-20T13:37:00.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.686+0000 7f451feda980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ce8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.686+0000 7f451feda980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b9b0e620 con 0x5567b9bfdf80 2024-03-20T13:37:00.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ce8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ce8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54606/0 (socket says 172.21.15.123:54606) 2024-03-20T13:37:00.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 -- 172.21.15.123:0/1707803645 learned_addr learned my addr 172.21.15.123:0/1707803645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 -- 172.21.15.123:0/1707803645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510005d30 con 0x5567b9bfdf80 2024-03-20T13:37:00.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 --2- 172.21.15.123:0/1707803645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ce8180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4510017e90 tx=0x7f4510003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfb8ba9ef322156 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f440be07640 1 -- 172.21.15.123:0/1707803645 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45100ab940 con 0x5567b9bfdf80 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f440be07640 1 -- 172.21.15.123:0/1707803645 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100abaa0 con 0x5567b9bfdf80 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f440be07640 1 -- 172.21.15.123:0/1707803645 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45100abd80 con 0x5567b9bfdf80 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- 172.21.15.123:0/1707803645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 msgr2=0x5567b9ce8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 --2- 172.21.15.123:0/1707803645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ce8180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4510017e90 tx=0x7f4510003030 comp rx=0 tx=0).stop 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- 172.21.15.123:0/1707803645 shutdown_connections 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 --2- 172.21.15.123:0/1707803645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ce8180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- 172.21.15.123:0/1707803645 >> 172.21.15.123:0/1707803645 conn(0x5567b9bf9850 msgr2=0x5567b9ce3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- 172.21.15.123:0/1707803645 shutdown_connections 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- 172.21.15.123:0/1707803645 wait complete. 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 Processor -- start 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- start start 2024-03-20T13:37:00.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ceeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451feda980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b9b09e00 con 0x5567b9bfdf80 2024-03-20T13:37:00.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ceeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ceeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54610/0 (socket says 172.21.15.123:54610) 2024-03-20T13:37:00.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 -- 172.21.15.123:0/2441345082 learned_addr learned my addr 172.21.15.123:0/2441345082 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b9bffa40 con 0x5567b9bfdf80 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f451d9f5640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ceeeb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4510000c10 tx=0x7f4510018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.690+0000 7f440a604640 1 -- 172.21.15.123:0/2441345082 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45100c4070 con 0x5567b9bfdf80 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567b9cef3f0 con 0x5567b9bfdf80 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f440a604640 1 -- 172.21.15.123:0/2441345082 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100bf620 con 0x5567b9bfdf80 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f440a604640 1 -- 172.21.15.123:0/2441345082 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45100bf8c0 con 0x5567b9bfdf80 2024-03-20T13:37:00.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567b9cef820 con 0x5567b9bfdf80 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f440a604640 1 -- 172.21.15.123:0/2441345082 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f45100b2070 con 0x5567b9bfdf80 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f440a604640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44040342b0 0x7f4404036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f440a604640 1 -- 172.21.15.123:0/2441345082 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f45100e37e0 con 0x5567b9bfdf80 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451d1f4640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44040342b0 0x7f4404036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9bfe8a0 0x5567b9cf5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9cf5fd0 con 0x5567b9bfe8a0 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451e1f6640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9bfe8a0 0x5567b9cf5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451d1f4640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44040342b0 0x7f4404036770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4514001dc0 tx=0x7f4514001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451e1f6640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9bfe8a0 0x5567b9cf5a90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451e1f6640 1 -- 172.21.15.123:0/2441345082 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9bfe8a0 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9cf6840 0x5567b9cf8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9cf9350 con 0x5567b9cf6840 2024-03-20T13:37:00.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451d9f5640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9cf6840 0x5567b9cf8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.694+0000 7f451d9f5640 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9cf6840 0x5567b9cf8c30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451d9f5640 1 -- 172.21.15.123:0/2441345082 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9cf6840 2024-03-20T13:37:00.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9cfabb0 con 0x5567b9cf6840 2024-03-20T13:37:00.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451d9f5640 1 -- 172.21.15.123:0/2441345082 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9cf6840 2024-03-20T13:37:00.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9cf9db0 con 0x5567b9cf6840 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451d9f5640 1 -- 172.21.15.123:0/2441345082 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9cf6840 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9cfa1c0 con 0x5567b9bfe8a0 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451e1f6640 1 -- 172.21.15.123:0/2441345082 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9bfe8a0 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 Processor -- start 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- start start 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 0x5567b9d096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b9aa2e30 con 0x5567b9d092b0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451e1f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 0x5567b9d096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451e1f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 0x5567b9d096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54626/0 (socket says 172.21.15.123:54626) 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451e1f6640 1 -- 172.21.15.123:0/4261965969 learned_addr learned my addr 172.21.15.123:0/4261965969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451e1f6640 1 -- 172.21.15.123:0/4261965969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b9d09c10 con 0x5567b9d092b0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451e1f6640 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 0x5567b9d096d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4518016cf0 tx=0x7f451800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f44037fe640 1 -- 172.21.15.123:0/4261965969 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4518017660 con 0x5567b9d092b0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567b9d09e60 con 0x5567b9d092b0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f44037fe640 1 -- 172.21.15.123:0/4261965969 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45180177c0 con 0x5567b9d092b0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567b9d0a9b0 con 0x5567b9d092b0 2024-03-20T13:37:00.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.698+0000 7f44037fe640 1 -- 172.21.15.123:0/4261965969 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4518017a60 con 0x5567b9d092b0 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f44037fe640 1 -- 172.21.15.123:0/4261965969 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f451801d020 con 0x5567b9d092b0 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f44037fe640 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43f80342b0 0x7f43f8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f44037fe640 1 -- 172.21.15.123:0/4261965969 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f451804b1f0 con 0x5567b9d092b0 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451d9f5640 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43f80342b0 0x7f43f8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 Processor -- start 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- start start 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451d9f5640 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43f80342b0 0x7f43f8036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5567b9cf98b0 tx=0x7f45100de040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9b749d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b9a96790 con 0x5567b9b745b0 2024-03-20T13:37:00.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451e1f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9b749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451e1f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9b749d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54628/0 (socket says 172.21.15.123:54628) 2024-03-20T13:37:00.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451e1f6640 1 -- 172.21.15.123:0/360972057 learned_addr learned my addr 172.21.15.123:0/360972057 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451e1f6640 1 -- 172.21.15.123:0/360972057 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b9b72e00 con 0x5567b9b745b0 2024-03-20T13:37:00.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451e1f6640 1 --2- 172.21.15.123:0/360972057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9b749d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4518005a40 tx=0x7f4518011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d962219010da8a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f44017fa640 1 -- 172.21.15.123:0/360972057 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f451803b2a0 con 0x5567b9b745b0 2024-03-20T13:37:00.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f44017fa640 1 -- 172.21.15.123:0/360972057 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518011cd0 con 0x5567b9b745b0 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f44017fa640 1 -- 172.21.15.123:0/360972057 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4518020510 con 0x5567b9b745b0 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- 172.21.15.123:0/360972057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 msgr2=0x5567b9b749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 --2- 172.21.15.123:0/360972057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9b749d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4518005a40 tx=0x7f4518011ad0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- 172.21.15.123:0/360972057 shutdown_connections 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 --2- 172.21.15.123:0/360972057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9b749d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- 172.21.15.123:0/360972057 >> 172.21.15.123:0/360972057 conn(0x5567b9d12570 msgr2=0x5567b9d105d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- 172.21.15.123:0/360972057 shutdown_connections 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- 172.21.15.123:0/360972057 wait complete. 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 Processor -- start 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 -- start start 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.702+0000 7f451feda980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9d1f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b9d1f820 con 0x5567b9b745b0 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451e1f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9d1f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451e1f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9d1f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54642/0 (socket says 172.21.15.123:54642) 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 learned_addr learned my addr 172.21.15.123:0/1834840934 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b9d0a9b0 con 0x5567b9b745b0 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451e1f6640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9d1f2e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4518045040 tx=0x7f4518049570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f43ef7fe640 1 -- 172.21.15.123:0/1834840934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4518011e40 con 0x5567b9b745b0 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567b9d1fa20 con 0x5567b9b745b0 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f43ef7fe640 1 -- 172.21.15.123:0/1834840934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518020510 con 0x5567b9b745b0 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f43ef7fe640 1 -- 172.21.15.123:0/1834840934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45180113d0 con 0x5567b9b745b0 2024-03-20T13:37:00.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567b9d1feb0 con 0x5567b9b745b0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f43ef7fe640 1 -- 172.21.15.123:0/1834840934 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4518011600 con 0x5567b9b745b0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f43ef7fe640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43e80342b0 0x7f43e8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f43ef7fe640 1 -- 172.21.15.123:0/1834840934 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f451802bce0 con 0x5567b9b745b0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d9f5640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43e80342b0 0x7f43e8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9d2a9d0 0x5567b9d2ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d2d5e0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d1f4640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9d2a9d0 0x5567b9d2ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d9f5640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43e80342b0 0x7f43e8036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45100e4010 tx=0x7f45100eb000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d1f4640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9d2a9d0 0x5567b9d2ce90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 realm 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d29eb0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d2e060 con 0x5567b9d2a9d0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.706+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9d2eba0 0x5567b9d31060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d317d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9d2eba0 0x5567b9d31060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9d2eba0 0x5567b9d31060 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d32020 con 0x5567b9d2eba0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 20 searching for the correct realm 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5567b9d33d40 0x5567b9d36130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451d9f5640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5567b9d33d40 0x5567b9d36130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451d9f5640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5567b9d33d40 0x5567b9d36130 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4518028c00 0x7f45180498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x7f4518028c00 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.710+0000 7f451d1f4640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4518028c00 0x7f45180498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4518028c00 0x7f45180498c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x7f4518028c00 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x7f4518028c00 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.714+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x7f4518028c00 2024-03-20T13:37:00.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x7f4518028c00 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.718+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x7f4518028c00 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d33d40 2024-03-20T13:37:00.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d366c0 con 0x5567b9d2eba0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d32950 con 0x5567b9d2a9d0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.722+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d32d90 con 0x5567b9d2eba0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d33170 con 0x5567b9d2a9d0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f451400e660 con 0x5567b9d2a9d0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 zone default found 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 4 Realm: () 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 zonegroup default 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d36b50 con 0x7f4518028c00 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f451400e660 con 0x7f4518028c00 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d38d30 con 0x5567b9d33d40 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d39090 con 0x5567b9d33d40 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 started sync module instance, tier type = 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d38300 con 0x5567b9d2eba0 2024-03-20T13:37:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93903987639984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d38300 con 0x5567b9d2eba0 2024-03-20T13:37:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.726+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d39a80 con 0x5567b9d2a9d0 2024-03-20T13:37:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.730+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.730+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93903987643744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3a2d0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.730+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3acf0 con 0x5567b9d2eba0 2024-03-20T13:37:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.730+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93903987639984] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.730+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93903987643744] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.734+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.734+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93903987648464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d39e30 con 0x5567b9d2eba0 2024-03-20T13:37:00.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.734+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3b540 con 0x7f4518028c00 2024-03-20T13:37:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.738+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.738+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93903987650720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d39e30 con 0x7f4518028c00 2024-03-20T13:37:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.738+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3bfd0 con 0x5567b9d2eba0 2024-03-20T13:37:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.738+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93903987648464] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.742+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93903987650720] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.742+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.742+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93903987651776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3bf90 con 0x5567b9d2eba0 2024-03-20T13:37:00.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.742+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3c3b0 con 0x5567b9d33d40 2024-03-20T13:37:00.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.746+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.746+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93903987637856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3cc00 con 0x5567b9d33d40 2024-03-20T13:37:00.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.746+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3d5b0 con 0x5567b9d33d40 2024-03-20T13:37:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.746+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.746+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93903987658960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3de30 con 0x5567b9d33d40 2024-03-20T13:37:00.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.746+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3e8d0 con 0x7f4518028c00 2024-03-20T13:37:00.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93903987637856] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93903987651776] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93903987658960] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93903987653328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3c760 con 0x7f4518028c00 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=0 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=1 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=2 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=3 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=4 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=5 2024-03-20T13:37:00.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.750+0000 7f451feda980 20 add_watcher() i=6 2024-03-20T13:37:00.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93903987653328] v32'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 20 add_watcher() i=7 2024-03-20T13:37:00.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:00.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3d990 con 0x5567b9d2a9d0 2024-03-20T13:37:00.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93903987663792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d3dda0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93903987663792] v32'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f43cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 5 note: GC not initialized 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f43ce7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 20 Filter name: none 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f433ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.754+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d63240 con 0x7f4518028c00 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d63790 con 0x5567b9d2eba0 2024-03-20T13:37:00.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(63 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:00.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:00.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d62880 con 0x7f4518028c00 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d64c50 con 0x5567b9d2eba0 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 4.26 4:648b71d5:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d64730 con 0x5567b9d2a9d0 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 4.17 4:ea60608e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d69660 con 0x5567b9d33d40 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 4.14 4:2b6b807a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d6bf20 con 0x5567b9d33d40 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 4.f 4:f12bebf7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d6e740 con 0x5567b9d2a9d0 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 4.6 4:63dad39e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d70f60 con 0x5567b9d33d40 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 4.3a 4:5c9c4310:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d73c70 con 0x5567b9d33d40 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d76510 con 0x5567b9d33d40 2024-03-20T13:37:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 4.35 4:ad3fb945:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d76510 con 0x5567b9d2a9d0 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 4.7 4:e13968f4:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d7b6e0 con 0x5567b9d2a9d0 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 4.19 4:98befe71:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d7e520 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 4.34 4:2d65569c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d7b720 con 0x7f4518028c00 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(67 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(68 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(70 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(66 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(74 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(73 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 6.11 6:8f1457b9:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d62e20 con 0x5567b9d33d40 2024-03-20T13:37:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.758+0000 7f451feda980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.762+0000 7f43cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.762+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93903987663792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d2a9d0 2024-03-20T13:37:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.762+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93903987663792] v32'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.762+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93903987639984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d2eba0 2024-03-20T13:37:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93903987639984] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451feda980 20 remove_watcher() i=0 2024-03-20T13:37:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451feda980 2 removed watcher, disabling cache 2024-03-20T13:37:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93903987643744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d2a9d0 2024-03-20T13:37:00.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93903987643744] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x5567b9d2a9d0 2024-03-20T13:37:00.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451feda980 20 remove_watcher() i=1 2024-03-20T13:37:00.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.766+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93903987648464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d2eba0 2024-03-20T13:37:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.770+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93903987648464] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.770+0000 7f451feda980 20 remove_watcher() i=2 2024-03-20T13:37:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.770+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93903987650720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x7f4518028c00 2024-03-20T13:37:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.770+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93903987650720] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.770+0000 7f451feda980 20 remove_watcher() i=3 2024-03-20T13:37:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.770+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93903987651776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d2eba0 2024-03-20T13:37:00.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.774+0000 7f451e1f6640 1 -- 172.21.15.123:0/1834840934 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93903987651776] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f451800a4d0 con 0x5567b9d2eba0 2024-03-20T13:37:00.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.774+0000 7f451feda980 20 remove_watcher() i=4 2024-03-20T13:37:00.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.774+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93903987637856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d33d40 2024-03-20T13:37:00.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.774+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93903987637856] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.774+0000 7f451feda980 20 remove_watcher() i=5 2024-03-20T13:37:00.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.774+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93903987658960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x5567b9d33d40 2024-03-20T13:37:00.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451d9f5640 1 -- 172.21.15.123:0/1834840934 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93903987658960] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45100bd820 con 0x5567b9d33d40 2024-03-20T13:37:00.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 20 remove_watcher() i=6 2024-03-20T13:37:00.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93903987653328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5567b9d54f50 con 0x7f4518028c00 2024-03-20T13:37:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93903987653328] v32'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4514043040 con 0x7f4518028c00 2024-03-20T13:37:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 20 remove_watcher() i=7 2024-03-20T13:37:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9d2eba0 msgr2=0x5567b9d31060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9d2eba0 0x5567b9d31060 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9d2a9d0 msgr2=0x5567b9d2ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9d2a9d0 0x5567b9d2ce90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4518028c00 msgr2=0x7f45180498c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4518028c00 0x7f45180498c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5567b9d33d40 msgr2=0x5567b9d36130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5567b9d33d40 0x5567b9d36130 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43e80342b0 msgr2=0x7f43e8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43e80342b0 0x7f43e8036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45100e4010 tx=0x7f45100eb000 comp rx=0 tx=0).stop 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 msgr2=0x5567b9d1f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9d1f2e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4518045040 tx=0x7f4518049570 comp rx=0 tx=0).stop 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451d1f4640 1 -- 172.21.15.123:0/1834840934 reap_dead start 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 shutdown_connections 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/1834840934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9b745b0 0x5567b9d1f2e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 >> 172.21.15.123:0/1834840934 conn(0x5567b9d12570 msgr2=0x5567b9d0fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 shutdown_connections 2024-03-20T13:37:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/1834840934 wait complete. 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43f80342b0 msgr2=0x7f43f8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43f80342b0 0x7f43f8036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5567b9cf98b0 tx=0x7f45100de040 comp rx=0 tx=0).stop 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 msgr2=0x5567b9d096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 0x5567b9d096d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4518016cf0 tx=0x7f451800d790 comp rx=0 tx=0).stop 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 shutdown_connections 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f43f80342b0 0x7f43f8036770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/4261965969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9d092b0 0x5567b9d096d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 >> 172.21.15.123:0/4261965969 conn(0x5567b9cfe0c0 msgr2=0x5567b9cfebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 shutdown_connections 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/4261965969 wait complete. 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9cf6840 msgr2=0x5567b9cf8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9cf6840 0x5567b9cf8c30 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9bfe8a0 msgr2=0x5567b9cf5a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9bfe8a0 0x5567b9cf5a90 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44040342b0 msgr2=0x7f4404036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44040342b0 0x7f4404036770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4514001dc0 tx=0x7f4514001360 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 msgr2=0x5567b9ceeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ceeeb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4510000c10 tx=0x7f4510018020 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 shutdown_connections 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5567b9cf6840 0x5567b9cf8c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5567b9bfe8a0 0x5567b9cf5a90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f44040342b0 0x7f4404036770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 --2- 172.21.15.123:0/2441345082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567b9bfdf80 0x5567b9ceeeb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 >> 172.21.15.123:0/2441345082 conn(0x5567b9bf9850 msgr2=0x5567b9ce2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 shutdown_connections 2024-03-20T13:37:00.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.778+0000 7f451feda980 1 -- 172.21.15.123:0/2441345082 wait complete. 2024-03-20T13:37:00.793 INFO:teuthology.orchestra.run.smithi123.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8ee97edf-01dc-402c-a19d-759426cef768","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","marker":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:36:59.688380Z","creation_time":"2024-03-20T13:36:59.684227Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-03-20T13:37:00.793 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8ee97edf-01dc-402c-a19d-759426cef768', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'marker': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:36:59.688380Z', 'creation_time': '2024-03-20T13:36:59.684227Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-03-20T13:37:00.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-03-20T13:37:00.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-03-20T13:37:00.794 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-03-20T13:37:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad8371980 1 Processor -- start 2024-03-20T13:37:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad8371980 1 -- start start 2024-03-20T13:37:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad8371980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563d97c206e0 0x563d97c22ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad8371980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563d97b664c0 con 0x563d97b8e0c0 2024-03-20T13:37:00.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad8371980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x563d97b2d0f0 con 0x563d97c206e0 2024-03-20T13:37:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad568b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563d97c206e0 0x563d97c22ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad5e8c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x563d97b8e0c0 0x563d97c1efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59146/0 (socket says 172.21.15.123:59146) 2024-03-20T13:37:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/1644363131 learned_addr learned my addr 172.21.15.123:0/1644363131 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad568b640 1 -- 172.21.15.123:0/1644363131 >> v1:172.21.15.89:6789/0 conn(0x563d97b8e0c0 legacy=0x563d97c1efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.858+0000 7f8ad568b640 1 -- 172.21.15.123:0/1644363131 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d97c24020 con 0x563d97c206e0 2024-03-20T13:37:00.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad568b640 1 --2- 172.21.15.123:0/1644363131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97c206e0 0x563d97c22ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00a480 tx=0x7f8acc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e296a038138ab2bf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad4e8a640 1 -- 172.21.15.123:0/1644363131 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8acc0ab540 con 0x563d97c206e0 2024-03-20T13:37:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad4e8a640 1 -- 172.21.15.123:0/1644363131 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0ab6a0 con 0x563d97c206e0 2024-03-20T13:37:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad4e8a640 1 -- 172.21.15.123:0/1644363131 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8acc0ab960 con 0x563d97c206e0 2024-03-20T13:37:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 -- 172.21.15.123:0/1644363131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97c206e0 msgr2=0x563d97c22ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 --2- 172.21.15.123:0/1644363131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97c206e0 0x563d97c22ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00a480 tx=0x7f8acc01b280 comp rx=0 tx=0).stop 2024-03-20T13:37:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 -- 172.21.15.123:0/1644363131 shutdown_connections 2024-03-20T13:37:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 --2- 172.21.15.123:0/1644363131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97c206e0 0x563d97c22ad0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 -- 172.21.15.123:0/1644363131 >> 172.21.15.123:0/1644363131 conn(0x563d97c146e0 msgr2=0x563d97c16b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 -- 172.21.15.123:0/1644363131 shutdown_connections 2024-03-20T13:37:00.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.862+0000 7f8ad8371980 1 -- 172.21.15.123:0/1644363131 wait complete. 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.874+0000 7f8ad8371980 1 Processor -- start 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.874+0000 7f8ad8371980 1 -- start start 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.874+0000 7f8ad8371980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d06120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.874+0000 7f8ad8371980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d97b2a620 con 0x563d97b8e0c0 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d06120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d06120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54662/0 (socket says 172.21.15.123:54662) 2024-03-20T13:37:00.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/296508789 learned_addr learned my addr 172.21.15.123:0/296508789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/296508789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc005d30 con 0x563d97b8e0c0 2024-03-20T13:37:00.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/296508789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d06120 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006fb0 tx=0x7f8ac8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72aecefe1a758d4d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f89c3e07640 1 -- 172.21.15.123:0/296508789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8004530 con 0x563d97b8e0c0 2024-03-20T13:37:00.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f89c3e07640 1 -- 172.21.15.123:0/296508789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8004690 con 0x563d97b8e0c0 2024-03-20T13:37:00.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f89c3e07640 1 -- 172.21.15.123:0/296508789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ac80049b0 con 0x563d97b8e0c0 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- 172.21.15.123:0/296508789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 msgr2=0x563d97d06120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 --2- 172.21.15.123:0/296508789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d06120 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006fb0 tx=0x7f8ac8001940 comp rx=0 tx=0).stop 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- 172.21.15.123:0/296508789 shutdown_connections 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 --2- 172.21.15.123:0/296508789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d06120 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- 172.21.15.123:0/296508789 >> 172.21.15.123:0/296508789 conn(0x563d97c146e0 msgr2=0x563d97d01cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- 172.21.15.123:0/296508789 shutdown_connections 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- 172.21.15.123:0/296508789 wait complete. 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 Processor -- start 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- start start 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d0cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d97b25e00 con 0x563d97b8e0c0 2024-03-20T13:37:00.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d0cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d0cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54668/0 (socket says 172.21.15.123:54668) 2024-03-20T13:37:00.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3295943906 learned_addr learned my addr 172.21.15.123:0/3295943906 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d97b664c0 con 0x563d97b8e0c0 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d0cf70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x563d97d06fb0 tx=0x7f8ac8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f89c2604640 1 -- 172.21.15.123:0/3295943906 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8013760 con 0x563d97b8e0c0 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.878+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d97d0d4b0 con 0x563d97b8e0c0 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f89c2604640 1 -- 172.21.15.123:0/3295943906 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80138c0 con 0x563d97b8e0c0 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d97d0d8e0 con 0x563d97b8e0c0 2024-03-20T13:37:00.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f89c2604640 1 -- 172.21.15.123:0/3295943906 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8013b60 con 0x563d97b8e0c0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f89c2604640 1 -- 172.21.15.123:0/3295943906 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8ac8013cc0 con 0x563d97b8e0c0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f89c2604640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89bc0342b0 0x7f89bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f89c2604640 1 -- 172.21.15.123:0/3295943906 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8ac8049600 con 0x563d97b8e0c0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad568b640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89bc0342b0 0x7f89bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97c206e0 0x563d97d13bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d14130 con 0x563d97c206e0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97c206e0 0x563d97d13bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad568b640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89bc0342b0 0x7f89bc036770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0ad000 tx=0x7f8acc0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97c206e0 0x563d97d13bf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad668d640 1 -- 172.21.15.123:0/3295943906 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ad00083f0 con 0x563d97c206e0 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d149a0 0x563d97d16d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d17450 con 0x563d97d149a0 2024-03-20T13:37:00.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d149a0 0x563d97d16d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.882+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d149a0 0x563d97d16d90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3295943906 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ac8024020 con 0x563d97d149a0 2024-03-20T13:37:00.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d18c90 con 0x563d97d149a0 2024-03-20T13:37:00.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3295943906 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f8ac8024020 con 0x563d97d149a0 2024-03-20T13:37:00.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d17e90 con 0x563d97d149a0 2024-03-20T13:37:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3295943906 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ac8024020 con 0x563d97d149a0 2024-03-20T13:37:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d182a0 con 0x563d97c206e0 2024-03-20T13:37:00.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad668d640 1 -- 172.21.15.123:0/3295943906 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8ad00083f0 con 0x563d97c206e0 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 Processor -- start 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 -- start start 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 0x563d97d27790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad8371980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d97abee30 con 0x563d97d27370 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad668d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 0x563d97d27790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad668d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 0x563d97d27790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54680/0 (socket says 172.21.15.123:54680) 2024-03-20T13:37:00.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad668d640 1 -- 172.21.15.123:0/3738015380 learned_addr learned my addr 172.21.15.123:0/3738015380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.886+0000 7f8ad668d640 1 -- 172.21.15.123:0/3738015380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d97d27cd0 con 0x563d97d27370 2024-03-20T13:37:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 0x563d97d27790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000aae0 tx=0x7f8ad0008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89bb7fe640 1 -- 172.21.15.123:0/3738015380 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad001d070 con 0x563d97d27370 2024-03-20T13:37:00.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d97d27f20 con 0x563d97d27370 2024-03-20T13:37:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89bb7fe640 1 -- 172.21.15.123:0/3738015380 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0010040 con 0x563d97d27370 2024-03-20T13:37:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89bb7fe640 1 -- 172.21.15.123:0/3738015380 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0007e70 con 0x563d97d27370 2024-03-20T13:37:00.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d97d28a70 con 0x563d97d27370 2024-03-20T13:37:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89bb7fe640 1 -- 172.21.15.123:0/3738015380 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8ad0018430 con 0x563d97d27370 2024-03-20T13:37:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89bb7fe640 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89b00342b0 0x7f89b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89bb7fe640 1 -- 172.21.15.123:0/3738015380 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8ad004a600 con 0x563d97d27370 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89b00342b0 0x7f89b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad8371980 1 Processor -- start 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad8371980 1 -- start start 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89b00342b0 0x7f89b0036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x563d97d17990 tx=0x7f8ac8028ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad8371980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad8371980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d97ab2790 con 0x563d97d342c0 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad668d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad668d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54686/0 (socket says 172.21.15.123:54686) 2024-03-20T13:37:00.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad668d640 1 -- 172.21.15.123:0/661583020 learned_addr learned my addr 172.21.15.123:0/661583020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad668d640 1 -- 172.21.15.123:0/661583020 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d97d34cb0 con 0x563d97d342c0 2024-03-20T13:37:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f8ad668d640 1 --2- 172.21.15.123:0/661583020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d346e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00489f0 tx=0x7f8ad0048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0357815ac2521c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89b97fa640 1 -- 172.21.15.123:0/661583020 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0047070 con 0x563d97d342c0 2024-03-20T13:37:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89b97fa640 1 -- 172.21.15.123:0/661583020 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0022410 con 0x563d97d342c0 2024-03-20T13:37:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.890+0000 7f89b97fa640 1 -- 172.21.15.123:0/661583020 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0016330 con 0x563d97d342c0 2024-03-20T13:37:00.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/661583020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 msgr2=0x563d97d346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 --2- 172.21.15.123:0/661583020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d346e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00489f0 tx=0x7f8ad0048f00 comp rx=0 tx=0).stop 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/661583020 shutdown_connections 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 --2- 172.21.15.123:0/661583020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d346e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/661583020 >> 172.21.15.123:0/661583020 conn(0x563d97d30650 msgr2=0x563d97d2e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/661583020 shutdown_connections 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/661583020 wait complete. 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 Processor -- start 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- start start 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d3b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d97d3b690 con 0x563d97d342c0 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad668d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d3b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad668d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d3b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54698/0 (socket says 172.21.15.123:54698) 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 learned_addr learned my addr 172.21.15.123:0/3070493371 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:00.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d97d28a70 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d3b150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0020890 tx=0x7f8ad0048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f89a77fe640 1 -- 172.21.15.123:0/3070493371 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0022580 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d97d3b890 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f89a77fe640 1 -- 172.21.15.123:0/3070493371 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0018730 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f89a77fe640 1 -- 172.21.15.123:0/3070493371 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00189d0 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d97d3bd20 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f89a77fe640 1 -- 172.21.15.123:0/3070493371 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8ad003a920 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f89a77fe640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89a00342b0 0x7f89a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f89a77fe640 1 -- 172.21.15.123:0/3070493371 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8ad0037c60 con 0x563d97d342c0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89a00342b0 0x7f89a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97d46860 0x563d97d48d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d49470 con 0x563d97d46860 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad568b640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97d46860 0x563d97d48d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.894+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89a00342b0 0x7f89a0036770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8001980 tx=0x7f8ac803f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad568b640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97d46860 0x563d97d48d20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8acc0abb90 con 0x563d97d46860 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 realm 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d49860 con 0x563d97d46860 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8acc0abb90 con 0x563d97d46860 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d4a0b0 con 0x563d97d46860 2024-03-20T13:37:00.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8acc0abb90 con 0x563d97d46860 2024-03-20T13:37:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d4aa90 0x563d97d4cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d4d630 con 0x563d97d4aa90 2024-03-20T13:37:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d4aa90 0x563d97d4cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d4aa90 0x563d97d4cec0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ad0033070 con 0x563d97d4aa90 2024-03-20T13:37:00.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d4de80 con 0x563d97d4aa90 2024-03-20T13:37:00.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8ad0033070 con 0x563d97d4aa90 2024-03-20T13:37:00.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 20 searching for the correct realm 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563d97d4fba0 0x563d97d51f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.898+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563d97d4fba0 0x563d97d51f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad5e8c640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563d97d4fba0 0x563d97d51f90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8024020 con 0x563d97d4fba0 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad0033070 con 0x563d97d4aa90 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad668d640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8ad0036020 0x7f8ad00166c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x7f8ad0036020 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8ad0036020 0x7f8ad00166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8ad0036020 0x7f8ad00166c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0abb90 con 0x7f8ad0036020 2024-03-20T13:37:00.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8024020 con 0x563d97d4fba0 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad0033070 con 0x563d97d4aa90 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.902+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad0033070 con 0x563d97d4aa90 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x7f8ad0036020 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x7f8ad0036020 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x7f8ad0036020 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8acc0c8040 con 0x7f8ad0036020 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8024020 con 0x563d97d4fba0 2024-03-20T13:37:00.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0c8040 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.906+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x7f8ad0036020 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x7f8ad0036020 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x7f8ad0036020 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4fba0 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.910+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52520 con 0x563d97d4aa90 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:00.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d4e7b0 con 0x563d97d46860 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d4eb90 con 0x563d97d4aa90 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d4ef70 con 0x563d97d46860 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 zone default found 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 4 Realm: () 2024-03-20T13:37:00.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 zonegroup default 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d52960 con 0x7f8ad0036020 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d54b40 con 0x563d97d4fba0 2024-03-20T13:37:00.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d54ea0 con 0x563d97d4fba0 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 started sync module instance, tier type = 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:00.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.914+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d54110 con 0x563d97d4aa90 2024-03-20T13:37:00.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822540330176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d54110 con 0x563d97d4aa90 2024-03-20T13:37:00.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d55810 con 0x563d97d46860 2024-03-20T13:37:00.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822540333936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d557d0 con 0x563d97d46860 2024-03-20T13:37:00.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d56760 con 0x563d97d4aa90 2024-03-20T13:37:00.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822540330176] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.918+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822540333936] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822540336064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d56760 con 0x563d97d4aa90 2024-03-20T13:37:00.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d56b70 con 0x7f8ad0036020 2024-03-20T13:37:00.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822540337744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d56b30 con 0x7f8ad0036020 2024-03-20T13:37:00.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d579f0 con 0x563d97d4aa90 2024-03-20T13:37:00.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822540337744] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.922+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822540336064] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822540328048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d579f0 con 0x563d97d4aa90 2024-03-20T13:37:00.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d57da0 con 0x563d97d4fba0 2024-03-20T13:37:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822540341024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d585f0 con 0x563d97d4fba0 2024-03-20T13:37:00.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d58fc0 con 0x563d97d4fba0 2024-03-20T13:37:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822540341024] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822540328048] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822540348096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d58150 con 0x563d97d4fba0 2024-03-20T13:37:00.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59980 con 0x7f8ad0036020 2024-03-20T13:37:00.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822540350688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59da0 con 0x7f8ad0036020 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=0 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=1 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=2 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=3 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822540348096] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=4 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=5 2024-03-20T13:37:00.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.926+0000 7f8ad8371980 20 add_watcher() i=6 2024-03-20T13:37:00.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822540350688] v32'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 add_watcher() i=7 2024-03-20T13:37:00.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:00.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59da0 con 0x563d97d46860 2024-03-20T13:37:00.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822540351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59d20 con 0x563d97d46860 2024-03-20T13:37:00.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822540351744] v32'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f89877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 5 note: GC not initialized 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f89867fc640 20 reqs_thread_entry: start 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 Filter name: none 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f88f7fff640 20 reqs_thread_entry: start 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d7e7b0 con 0x563d97d46860 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.930+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d7e7b0 con 0x7f8ad0036020 2024-03-20T13:37:00.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d7db30 con 0x563d97d4aa90 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 4.26 4:648b71d5:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d81170 con 0x563d97d46860 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:66 4.17 4:ea60608e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d83dd0 con 0x563d97d4fba0 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 4.14 4:2b6b807a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d86a10 con 0x563d97d4fba0 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 4.f 4:f12bebf7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d83dd0 con 0x563d97d46860 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 4.6 4:63dad39e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d8b770 con 0x563d97d4fba0 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 4.3a 4:5c9c4310:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d8e450 con 0x563d97d4fba0 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d8b7b0 con 0x563d97d4fba0 2024-03-20T13:37:00.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 4.35 4:ad3fb945:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d932d0 con 0x563d97d46860 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 4.7 4:e13968f4:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d932d0 con 0x563d97d46860 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:74 4.19 4:98befe71:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d984c0 con 0x563d97d4fba0 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:75 4.34 4:2d65569c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d9ae60 con 0x7f8ad0036020 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(65 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(66 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(68 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(69 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(72 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(70 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(73 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(75 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(74 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d984c0 con 0x7f8ad0036020 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.934+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d984c0 con 0x7f8ad0036020 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad8371980 20 rados->read ofs=0 len=0 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d984c0 con 0x563d97d46860 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(78 foo [stat out=16b,read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+373 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad8371980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d984c0 con 0x7f8ad0036020 2024-03-20T13:37:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f89877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822540351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d709a0 con 0x563d97d46860 2024-03-20T13:37:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94822540351744] v32'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.938+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822540330176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59900 con 0x563d97d4aa90 2024-03-20T13:37:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94822540330176] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad8371980 20 remove_watcher() i=0 2024-03-20T13:37:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad8371980 2 removed watcher, disabling cache 2024-03-20T13:37:00.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822540333936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59900 con 0x563d97d46860 2024-03-20T13:37:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94822540333936] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x563d97d46860 2024-03-20T13:37:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad8371980 20 remove_watcher() i=1 2024-03-20T13:37:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.942+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822540336064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d59900 con 0x563d97d4aa90 2024-03-20T13:37:00.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.946+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94822540336064] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.946+0000 7f8ad8371980 20 remove_watcher() i=2 2024-03-20T13:37:00.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.946+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822540337744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d55bc0 con 0x7f8ad0036020 2024-03-20T13:37:00.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.946+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94822540337744] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.946+0000 7f8ad8371980 20 remove_watcher() i=3 2024-03-20T13:37:00.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.946+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822540328048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d56250 con 0x563d97d4aa90 2024-03-20T13:37:00.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad668d640 1 -- 172.21.15.123:0/3070493371 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94822540328048] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ad005d040 con 0x563d97d4aa90 2024-03-20T13:37:00.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 20 remove_watcher() i=4 2024-03-20T13:37:00.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822540341024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d55bc0 con 0x563d97d4fba0 2024-03-20T13:37:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94822540341024] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 20 remove_watcher() i=5 2024-03-20T13:37:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822540348096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d53c70 con 0x563d97d4fba0 2024-03-20T13:37:00.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad5e8c640 1 -- 172.21.15.123:0/3070493371 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94822540348096] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ac8061040 con 0x563d97d4fba0 2024-03-20T13:37:00.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 20 remove_watcher() i=6 2024-03-20T13:37:00.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822540350688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563d97d56250 con 0x7f8ad0036020 2024-03-20T13:37:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94822540350688] v32'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8acc0d5060 con 0x7f8ad0036020 2024-03-20T13:37:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.950+0000 7f8ad8371980 20 remove_watcher() i=7 2024-03-20T13:37:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d4aa90 msgr2=0x563d97d4cec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d4aa90 0x563d97d4cec0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97d46860 msgr2=0x563d97d48d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97d46860 0x563d97d48d20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8ad0036020 msgr2=0x7f8ad00166c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8ad0036020 0x7f8ad00166c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563d97d4fba0 msgr2=0x563d97d51f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563d97d4fba0 0x563d97d51f90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89a00342b0 msgr2=0x7f89a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89a00342b0 0x7f89a0036770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8001980 tx=0x7f8ac803f000 comp rx=0 tx=0).stop 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 msgr2=0x563d97d3b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad568b640 1 -- 172.21.15.123:0/3070493371 reap_dead start 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d3b150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0020890 tx=0x7f8ad0048980 comp rx=0 tx=0).stop 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 shutdown_connections 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3070493371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d342c0 0x563d97d3b150 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 >> 172.21.15.123:0/3070493371 conn(0x563d97d30650 msgr2=0x563d97d2dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 shutdown_connections 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3070493371 wait complete. 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89b00342b0 msgr2=0x7f89b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89b00342b0 0x7f89b0036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x563d97d17990 tx=0x7f8ac8028ea0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 msgr2=0x563d97d27790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 0x563d97d27790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000aae0 tx=0x7f8ad0008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 shutdown_connections 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89b00342b0 0x7f89b0036770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3738015380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97d27370 0x563d97d27790 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 >> 172.21.15.123:0/3738015380 conn(0x563d97d1c180 msgr2=0x563d97d1cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 shutdown_connections 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3738015380 wait complete. 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d149a0 msgr2=0x563d97d16d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d149a0 0x563d97d16d90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97c206e0 msgr2=0x563d97d13bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97c206e0 0x563d97d13bf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89bc0342b0 msgr2=0x7f89bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89bc0342b0 0x7f89bc036770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0ad000 tx=0x7f8acc0a5040 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 msgr2=0x563d97d0cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d0cf70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x563d97d06fb0 tx=0x7f8ac8000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 shutdown_connections 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563d97d149a0 0x563d97d16d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563d97c206e0 0x563d97d13bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f89bc0342b0 0x7f89bc036770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 --2- 172.21.15.123:0/3295943906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d97b8e0c0 0x563d97d0cf70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 >> 172.21.15.123:0/3295943906 conn(0x563d97c146e0 msgr2=0x563d97d007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 shutdown_connections 2024-03-20T13:37:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:00.954+0000 7f8ad8371980 1 -- 172.21.15.123:0/3295943906 wait complete. 2024-03-20T13:37:00.968 INFO:teuthology.orchestra.run.smithi123.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-03-20T13:37:00.941661Z","last_stats_update":"2024-03-20T13:37:00.940544Z"} 2024-03-20T13:37:00.968 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-03-20T13:37:00.941661Z', 'last_stats_update': '2024-03-20T13:37:00.940544Z'} 2024-03-20T13:37:00.977 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:00.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-03-20T13:37:00.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-03-20T13:37:00.977 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-03-20T13:37:01.039 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:01.039 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f059a82d980 1 Processor -- start 2024-03-20T13:37:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f059a82d980 1 -- start start 2024-03-20T13:37:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f059a82d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556071ea5640 0x556071ea7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f059a82d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556071deb4c0 con 0x556071ea1140 2024-03-20T13:37:01.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f059a82d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x556071db20f0 con 0x556071ea5640 2024-03-20T13:37:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0598348640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x556071ea1140 0x556071ea1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59152/0 (socket says 172.21.15.123:59152) 2024-03-20T13:37:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0598348640 1 -- 172.21.15.123:0/3787978038 learned_addr learned my addr 172.21.15.123:0/3787978038 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0597b47640 1 --2- 172.21.15.123:0/3787978038 >> v2:172.21.15.89:3300/0 conn(0x556071ea5640 0x556071ea7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0597346640 1 -- 172.21.15.123:0/3787978038 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163189620 0 0) 0x556071deb4c0 con 0x556071ea1140 2024-03-20T13:37:01.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0597346640 1 -- 172.21.15.123:0/3787978038 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0584001e20 con 0x556071ea1140 2024-03-20T13:37:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0597b47640 1 -- 172.21.15.123:0/3787978038 >> v1:172.21.15.89:6789/0 conn(0x556071ea1140 legacy=0x556071ea1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.034+0000 7f0597b47640 1 -- 172.21.15.123:0/3787978038 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556071ea8f80 con 0x556071ea5640 2024-03-20T13:37:01.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f0597b47640 1 --2- 172.21.15.123:0/3787978038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea5640 0x556071ea7a30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f058800a420 tx=0x7f058801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77be8edb20311f60 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f0597346640 1 -- 172.21.15.123:0/3787978038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05880aa530 con 0x556071ea5640 2024-03-20T13:37:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f0597346640 1 -- 172.21.15.123:0/3787978038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05880a6050 con 0x556071ea5640 2024-03-20T13:37:01.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f0597346640 1 -- 172.21.15.123:0/3787978038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05880aa800 con 0x556071ea5640 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 -- 172.21.15.123:0/3787978038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea5640 msgr2=0x556071ea7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 --2- 172.21.15.123:0/3787978038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea5640 0x556071ea7a30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f058800a420 tx=0x7f058801afd0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 -- 172.21.15.123:0/3787978038 shutdown_connections 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 --2- 172.21.15.123:0/3787978038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea5640 0x556071ea7a30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 -- 172.21.15.123:0/3787978038 >> 172.21.15.123:0/3787978038 conn(0x556071e14860 msgr2=0x556071e14c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 -- 172.21.15.123:0/3787978038 shutdown_connections 2024-03-20T13:37:01.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.038+0000 7f059a82d980 1 -- 172.21.15.123:0/3787978038 wait complete. 2024-03-20T13:37:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f059a82d980 1 Processor -- start 2024-03-20T13:37:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f059a82d980 1 -- start start 2024-03-20T13:37:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f059a82d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f8af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f059a82d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556071daf620 con 0x556071ea1140 2024-03-20T13:37:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f0598348640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f8af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f0598348640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f8af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54722/0 (socket says 172.21.15.123:54722) 2024-03-20T13:37:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f0598348640 1 -- 172.21.15.123:0/3348015647 learned_addr learned my addr 172.21.15.123:0/3348015647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.050+0000 7f0598348640 1 -- 172.21.15.123:0/3348015647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058800a100 con 0x556071ea1140 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0598348640 1 --2- 172.21.15.123:0/3348015647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f8af70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0580001c30 tx=0x7f058000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e8443f7e12fb82 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f048660c640 1 -- 172.21.15.123:0/3348015647 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f058000e690 con 0x556071ea1140 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f048660c640 1 -- 172.21.15.123:0/3348015647 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000e7f0 con 0x556071ea1140 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f048660c640 1 -- 172.21.15.123:0/3348015647 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f058000eb50 con 0x556071ea1140 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3348015647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 msgr2=0x556071f8af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 --2- 172.21.15.123:0/3348015647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f8af70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0580001c30 tx=0x7f058000b6d0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3348015647 shutdown_connections 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 --2- 172.21.15.123:0/3348015647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f8af70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3348015647 >> 172.21.15.123:0/3348015647 conn(0x556071e14860 msgr2=0x556071f86a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3348015647 shutdown_connections 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3348015647 wait complete. 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 Processor -- start 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- start start 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f91e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556071daae00 con 0x556071ea1140 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0598348640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f91e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0598348640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f91e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54728/0 (socket says 172.21.15.123:54728) 2024-03-20T13:37:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0598348640 1 -- 172.21.15.123:0/3480222863 learned_addr learned my addr 172.21.15.123:0/3480222863 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0598348640 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584001e20 con 0x556071ea1140 2024-03-20T13:37:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0598348640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f91e20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f058000b710 tx=0x7f0580000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0484e09640 1 -- 172.21.15.123:0/3480222863 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f058001f070 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556071f92360 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0484e09640 1 -- 172.21.15.123:0/3480222863 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058001a2e0 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f0484e09640 1 -- 172.21.15.123:0/3480222863 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f058001a820 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.054+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556071f92790 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0484e09640 1 -- 172.21.15.123:0/3480222863 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f058000a040 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0484e09640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04800342b0 0x7f0480036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0484e09640 1 -- 172.21.15.123:0/3480222863 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0580049920 con 0x556071ea1140 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0597b47640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04800342b0 0x7f0480036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071f96a40 0x556071f98e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071f99370 con 0x556071f96a40 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598b49640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071f96a40 0x556071f98e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598b49640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071f96a40 0x556071f98e30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0597b47640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04800342b0 0x7f0480036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05880ac000 tx=0x7f05880a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598b49640 1 -- 172.21.15.123:0/3480222863 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05900083f0 con 0x556071f96a40 2024-03-20T13:37:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071f99be0 0x556071f9bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071f9c740 con 0x556071f99be0 2024-03-20T13:37:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598348640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071f99be0 0x556071f9bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598348640 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071f99be0 0x556071f9bfd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598348640 1 -- 172.21.15.123:0/3480222863 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0580014070 con 0x556071f99be0 2024-03-20T13:37:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071f9dfa0 con 0x556071f99be0 2024-03-20T13:37:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f0598348640 1 -- 172.21.15.123:0/3480222863 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0580014070 con 0x556071f99be0 2024-03-20T13:37:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.058+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071f9d1a0 con 0x556071f99be0 2024-03-20T13:37:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598348640 1 -- 172.21.15.123:0/3480222863 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0580014070 con 0x556071f99be0 2024-03-20T13:37:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071f9d5b0 con 0x556071f96a40 2024-03-20T13:37:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598b49640 1 -- 172.21.15.123:0/3480222863 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f05900083f0 con 0x556071f96a40 2024-03-20T13:37:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 Processor -- start 2024-03-20T13:37:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 -- start start 2024-03-20T13:37:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 0x556071facac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556071d43e30 con 0x556071fac6a0 2024-03-20T13:37:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 0x556071facac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 0x556071facac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54740/0 (socket says 172.21.15.123:54740) 2024-03-20T13:37:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598b49640 1 -- 172.21.15.123:0/277372153 learned_addr learned my addr 172.21.15.123:0/277372153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598b49640 1 -- 172.21.15.123:0/277372153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556071fad000 con 0x556071fac6a0 2024-03-20T13:37:01.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f0598b49640 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 0x556071facac0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f059000aae0 tx=0x7f0590008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f047dffb640 1 -- 172.21.15.123:0/277372153 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059001d070 con 0x556071fac6a0 2024-03-20T13:37:01.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556071fad250 con 0x556071fac6a0 2024-03-20T13:37:01.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f047dffb640 1 -- 172.21.15.123:0/277372153 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590010040 con 0x556071fac6a0 2024-03-20T13:37:01.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f047dffb640 1 -- 172.21.15.123:0/277372153 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0590007e50 con 0x556071fac6a0 2024-03-20T13:37:01.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.062+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556071fadda0 con 0x556071fac6a0 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f047dffb640 1 -- 172.21.15.123:0/277372153 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0590018430 con 0x556071fac6a0 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f047dffb640 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04700342b0 0x7f0470036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f047dffb640 1 -- 172.21.15.123:0/277372153 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f059004a710 con 0x556071fac6a0 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598348640 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04700342b0 0x7f0470036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 Processor -- start 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- start start 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598348640 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04700342b0 0x7f0470036770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556071f9cca0 tx=0x7f0580047c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fb9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556071d37790 con 0x556071fb95f0 2024-03-20T13:37:01.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fb9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fb9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54746/0 (socket says 172.21.15.123:54746) 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 -- 172.21.15.123:0/2700392921 learned_addr learned my addr 172.21.15.123:0/2700392921 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 -- 172.21.15.123:0/2700392921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556071fb9fe0 con 0x556071fb95f0 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 --2- 172.21.15.123:0/2700392921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fb9a10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0590020480 tx=0x7f05900218e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5477869394afb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f04777fe640 1 -- 172.21.15.123:0/2700392921 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0590047070 con 0x556071fb95f0 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f04777fe640 1 -- 172.21.15.123:0/2700392921 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590022590 con 0x556071fb95f0 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f04777fe640 1 -- 172.21.15.123:0/2700392921 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0590016460 con 0x556071fb95f0 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- 172.21.15.123:0/2700392921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 msgr2=0x556071fb9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 --2- 172.21.15.123:0/2700392921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fb9a10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0590020480 tx=0x7f05900218e0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- 172.21.15.123:0/2700392921 shutdown_connections 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 --2- 172.21.15.123:0/2700392921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fb9a10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- 172.21.15.123:0/2700392921 >> 172.21.15.123:0/2700392921 conn(0x556071fb5980 msgr2=0x556071fb39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- 172.21.15.123:0/2700392921 shutdown_connections 2024-03-20T13:37:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- 172.21.15.123:0/2700392921 wait complete. 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 Processor -- start 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- start start 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fc03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f059a82d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556071fc0920 con 0x556071fb95f0 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fc03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fc03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54748/0 (socket says 172.21.15.123:54748) 2024-03-20T13:37:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.066+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 learned_addr learned my addr 172.21.15.123:0/1795628450 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556071fadda0 con 0x556071fb95f0 2024-03-20T13:37:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0598b49640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fc03e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0590022720 tx=0x7f05900489d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0475ffb640 1 -- 172.21.15.123:0/1795628450 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0590021b60 con 0x556071fb95f0 2024-03-20T13:37:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0475ffb640 1 -- 172.21.15.123:0/1795628450 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590021cc0 con 0x556071fb95f0 2024-03-20T13:37:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556071fc0b20 con 0x556071fb95f0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0475ffb640 1 -- 172.21.15.123:0/1795628450 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059004a0d0 con 0x556071fb95f0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556071fc0fb0 con 0x556071fb95f0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0475ffb640 1 -- 172.21.15.123:0/1795628450 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f059004a230 con 0x556071fb95f0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0475ffb640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04680342b0 0x7f0468036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0475ffb640 1 -- 172.21.15.123:0/1795628450 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0590036c60 con 0x556071fb95f0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0598348640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04680342b0 0x7f0468036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071fcbb60 0x556071fce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fce770 con 0x556071fcbb60 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0597b47640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071fcbb60 0x556071fce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0598348640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04680342b0 0x7f0468036770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0580001130 tx=0x7f0580039000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0597b47640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071fcbb60 0x556071fce020 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05880b1040 con 0x556071fcbb60 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 realm 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fceb60 con 0x556071fcbb60 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05880b1040 con 0x556071fcbb60 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fcf3e0 con 0x556071fcbb60 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071fcfdc0 0x556071fd21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd2960 con 0x556071fcfdc0 2024-03-20T13:37:01.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.070+0000 7f0598b49640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071fcfdc0 0x556071fd21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598b49640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071fcfdc0 0x556071fd21f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0590032070 con 0x556071fcfdc0 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd3160 con 0x556071fcfdc0 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0590032070 con 0x556071fcfdc0 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 20 searching for the correct realm 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556071fd5160 0x556071fd7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598348640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556071fd5160 0x556071fd7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598348640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556071fd5160 0x556071fd7620 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0590032070 con 0x556071fcfdc0 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598b49640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0590035020 0x7f05900259e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x7f0590035020 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.074+0000 7f0597b47640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0590035020 0x7f05900259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0590035020 0x7f05900259e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0590032070 con 0x556071fcfdc0 2024-03-20T13:37:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0590032070 con 0x556071fcfdc0 2024-03-20T13:37:01.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x7f0590035020 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x7f0590035020 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.078+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x7f0590035020 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcbb60 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x7f0590035020 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x7f0590035020 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.082+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fd5160 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd7cf0 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:01.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd46f0 con 0x556071fcbb60 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.086+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd3670 con 0x556071fcfdc0 2024-03-20T13:37:01.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd3680 con 0x556071fcbb60 2024-03-20T13:37:01.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 zone default found 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 4 Realm: () 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 zonegroup default 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd41b0 con 0x7f0590035020 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fda1c0 con 0x556071fd5160 2024-03-20T13:37:01.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fda610 con 0x556071fd5160 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 started sync module instance, tier type = 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd94e0 con 0x556071fcfdc0 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93872717664320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fd9890 con 0x556071fcfdc0 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.090+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdb370 con 0x556071fcbb60 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93872717672144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdbb70 con 0x556071fcbb60 2024-03-20T13:37:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdc600 con 0x556071fcfdc0 2024-03-20T13:37:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93872717664320] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93872717672144] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93872717674192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdc120 con 0x556071fcfdc0 2024-03-20T13:37:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdce80 con 0x7f0590035020 2024-03-20T13:37:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93872717679072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdce00 con 0x7f0590035020 2024-03-20T13:37:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.094+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fddd40 con 0x556071fcfdc0 2024-03-20T13:37:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93872717674192] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93872717679072] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93872717681200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fddd00 con 0x556071fcfdc0 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fde110 con 0x556071fd5160 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93872717670960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fde960 con 0x556071fd5160 2024-03-20T13:37:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdf310 con 0x556071fd5160 2024-03-20T13:37:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.098+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93872717681200] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93872717670960] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93872717685952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdee30 con 0x556071fd5160 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdfb60 con 0x7f0590035020 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93872717690560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdfb60 con 0x7f0590035020 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=0 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=1 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=2 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=3 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=4 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=5 2024-03-20T13:37:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93872717685952] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=6 2024-03-20T13:37:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93872717690560] v32'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 20 add_watcher() i=7 2024-03-20T13:37:01.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:01.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdd840 con 0x556071fcbb60 2024-03-20T13:37:01.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.102+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93872717692480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdd840 con 0x556071fcbb60 2024-03-20T13:37:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93872717692480] v32'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f044e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 5 note: GC not initialized 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f044d7e2640 20 reqs_thread_entry: start 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 Filter name: none 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f03beffd640 20 reqs_thread_entry: start 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556072004fb0 con 0x556071fcbb60 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556072006b10 con 0x7f0590035020 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556072008280 con 0x556071fcfdc0 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:01.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:01.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:01.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-03-20T13:37:01.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.106+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55607200b770 con 0x7f0590035020 2024-03-20T13:37:01.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-03-20T13:37:01.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55607200a760 con 0x7f0590035020 2024-03-20T13:37:01.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55607200f180 con 0x7f0590035020 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93872717868064 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55607200c790 con 0x556071fd5160 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 93872717685952 notify 137438953473 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7f058003c040 con 0x556071fd5160 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f04777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 93872717685952 notifier 4479 bl.length()=338 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f04777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f04777fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(68 notify.6 [notify cookie 93872717868064 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f04777fe640 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f045c003ea0 con 0x556071fd5160 2024-03-20T13:37:01.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== watch-notify(notify_complete (2) cookie 93872717868064 notify 137438953473 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556071f92790 con 0x556071fd5160 2024-03-20T13:37:01.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f044e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.110+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93872717692480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071ff70d0 con 0x556071fcbb60 2024-03-20T13:37:01.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93872717692480] v32'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93872717664320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdfe40 con 0x556071fcfdc0 2024-03-20T13:37:01.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93872717664320] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f059a82d980 20 remove_watcher() i=0 2024-03-20T13:37:01.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f059a82d980 2 removed watcher, disabling cache 2024-03-20T13:37:01.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93872717672144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdfe40 con 0x556071fcbb60 2024-03-20T13:37:01.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93872717672144] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x556071fcbb60 2024-03-20T13:37:01.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.114+0000 7f059a82d980 20 remove_watcher() i=1 2024-03-20T13:37:01.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93872717674192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdaed0 con 0x556071fcfdc0 2024-03-20T13:37:01.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93872717674192] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f059a82d980 20 remove_watcher() i=2 2024-03-20T13:37:01.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93872717679072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdfe40 con 0x7f0590035020 2024-03-20T13:37:01.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93872717679072] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f059a82d980 20 remove_watcher() i=3 2024-03-20T13:37:01.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.118+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93872717681200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdb6d0 con 0x556071fcfdc0 2024-03-20T13:37:01.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f0598b49640 1 -- 172.21.15.123:0/1795628450 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93872717681200] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f059005d040 con 0x556071fcfdc0 2024-03-20T13:37:01.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f059a82d980 20 remove_watcher() i=4 2024-03-20T13:37:01.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93872717670960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdaed0 con 0x556071fd5160 2024-03-20T13:37:01.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93872717670960] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f059a82d980 20 remove_watcher() i=5 2024-03-20T13:37:01.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93872717685952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdc9e0 con 0x556071fd5160 2024-03-20T13:37:01.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f0598348640 1 -- 172.21.15.123:0/1795628450 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93872717685952] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0580014070 con 0x556071fd5160 2024-03-20T13:37:01.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f059a82d980 20 remove_watcher() i=6 2024-03-20T13:37:01.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.122+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93872717690560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556071fdfe40 con 0x7f0590035020 2024-03-20T13:37:01.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93872717690560] v32'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05880bf040 con 0x7f0590035020 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 20 remove_watcher() i=7 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071fcfdc0 msgr2=0x556071fd21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071fcfdc0 0x556071fd21f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071fcbb60 msgr2=0x556071fce020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071fcbb60 0x556071fce020 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0590035020 msgr2=0x7f05900259e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0590035020 0x7f05900259e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556071fd5160 msgr2=0x556071fd7620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556071fd5160 0x556071fd7620 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04680342b0 msgr2=0x7f0468036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04680342b0 0x7f0468036770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0580001130 tx=0x7f0580039000 comp rx=0 tx=0).stop 2024-03-20T13:37:01.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 msgr2=0x556071fc03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fc03e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0590022720 tx=0x7f05900489d0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f0597b47640 1 -- 172.21.15.123:0/1795628450 reap_dead start 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 shutdown_connections 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/1795628450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fb95f0 0x556071fc03e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 >> 172.21.15.123:0/1795628450 conn(0x556071fb5980 msgr2=0x556071fb2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 shutdown_connections 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/1795628450 wait complete. 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04700342b0 msgr2=0x7f0470036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04700342b0 0x7f0470036770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556071f9cca0 tx=0x7f0580047c20 comp rx=0 tx=0).stop 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 msgr2=0x556071facac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 0x556071facac0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f059000aae0 tx=0x7f0590008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 shutdown_connections 2024-03-20T13:37:01.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04700342b0 0x7f0470036770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/277372153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071fac6a0 0x556071facac0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 >> 172.21.15.123:0/277372153 conn(0x556071fa14b0 msgr2=0x556071fa1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 shutdown_connections 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/277372153 wait complete. 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071f99be0 msgr2=0x556071f9bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071f99be0 0x556071f9bfd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071f96a40 msgr2=0x556071f98e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071f96a40 0x556071f98e30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04800342b0 msgr2=0x7f0480036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04800342b0 0x7f0480036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05880ac000 tx=0x7f05880a5000 comp rx=0 tx=0).stop 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 msgr2=0x556071f91e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f91e20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f058000b710 tx=0x7f0580000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 shutdown_connections 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556071f99be0 0x556071f9bfd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556071f96a40 0x556071f98e30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f04800342b0 0x7f0480036770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 --2- 172.21.15.123:0/3480222863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556071ea1140 0x556071f91e20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 >> 172.21.15.123:0/3480222863 conn(0x556071e14860 msgr2=0x556071f85570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 shutdown_connections 2024-03-20T13:37:01.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.126+0000 7f059a82d980 1 -- 172.21.15.123:0/3480222863 wait complete. 2024-03-20T13:37:01.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:37:01.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:37:01.141 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-03-20T13:37:01.217 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:01.217 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:01.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6beba60980 1 Processor -- start 2024-03-20T13:37:01.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6beba60980 1 -- start start 2024-03-20T13:37:01.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6beba60980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558687958790 0x55868795ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6beba60980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55868789e4c0 con 0x5586878c68f0 2024-03-20T13:37:01.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6beba60980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5586878650f0 con 0x558687958790 2024-03-20T13:37:01.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be8d7a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558687958790 0x55868795ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be8d7a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558687958790 0x55868795ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54752/0 (socket says 172.21.15.123:54752) 2024-03-20T13:37:01.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be8d7a640 1 -- 172.21.15.123:0/3543889514 learned_addr learned my addr 172.21.15.123:0/3543889514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be957b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5586878c68f0 0x558687957070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59164/0 (socket says 172.21.15.123:59164) 2024-03-20T13:37:01.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be8d7a640 1 -- 172.21.15.123:0/3543889514 >> v1:172.21.15.89:6789/0 conn(0x5586878c68f0 legacy=0x558687957070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be8d7a640 1 -- 172.21.15.123:0/3543889514 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558687952a90 con 0x558687958790 2024-03-20T13:37:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/3543889514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687958790 0x55868795ab80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6be000a5c0 tx=0x7f6be001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b1e66bb85855c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6bdbfff640 1 -- 172.21.15.123:0/3543889514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be00aa470 con 0x558687958790 2024-03-20T13:37:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6bdbfff640 1 -- 172.21.15.123:0/3543889514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be00aa5d0 con 0x558687958790 2024-03-20T13:37:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.214+0000 7f6bdbfff640 1 -- 172.21.15.123:0/3543889514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be00aa890 con 0x558687958790 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 -- 172.21.15.123:0/3543889514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687958790 msgr2=0x55868795ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 --2- 172.21.15.123:0/3543889514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687958790 0x55868795ab80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6be000a5c0 tx=0x7f6be001b340 comp rx=0 tx=0).stop 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 -- 172.21.15.123:0/3543889514 shutdown_connections 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 --2- 172.21.15.123:0/3543889514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687958790 0x55868795ab80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 -- 172.21.15.123:0/3543889514 >> 172.21.15.123:0/3543889514 conn(0x55868794c750 msgr2=0x55868794eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 -- 172.21.15.123:0/3543889514 shutdown_connections 2024-03-20T13:37:01.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.218+0000 7f6beba60980 1 -- 172.21.15.123:0/3543889514 wait complete. 2024-03-20T13:37:01.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6beba60980 1 Processor -- start 2024-03-20T13:37:01.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6beba60980 1 -- start start 2024-03-20T13:37:01.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6beba60980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a3e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6beba60980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558687862620 con 0x5586878c68f0 2024-03-20T13:37:01.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6be957b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a3e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6be957b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a3e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54764/0 (socket says 172.21.15.123:54764) 2024-03-20T13:37:01.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6be957b640 1 -- 172.21.15.123:0/1008100312 learned_addr learned my addr 172.21.15.123:0/1008100312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6be957b640 1 -- 172.21.15.123:0/1008100312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0005df0 con 0x5586878c68f0 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6be957b640 1 --2- 172.21.15.123:0/1008100312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a3e180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc001cc0 tx=0x7f6bdc00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94937b14ea9fb704 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6ad7606640 1 -- 172.21.15.123:0/1008100312 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc014070 con 0x5586878c68f0 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6ad7606640 1 -- 172.21.15.123:0/1008100312 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc00f590 con 0x5586878c68f0 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.230+0000 7f6ad7606640 1 -- 172.21.15.123:0/1008100312 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc007040 con 0x5586878c68f0 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/1008100312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 msgr2=0x558687a3e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 --2- 172.21.15.123:0/1008100312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a3e180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc001cc0 tx=0x7f6bdc00b610 comp rx=0 tx=0).stop 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/1008100312 shutdown_connections 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 --2- 172.21.15.123:0/1008100312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a3e180 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/1008100312 >> 172.21.15.123:0/1008100312 conn(0x55868794c750 msgr2=0x558687a39d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/1008100312 shutdown_connections 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/1008100312 wait complete. 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 Processor -- start 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- start start 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a44fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868785de00 con 0x5586878c68f0 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be957b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a44fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be957b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a44fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54770/0 (socket says 172.21.15.123:54770) 2024-03-20T13:37:01.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be957b640 1 -- 172.21.15.123:0/3216115104 learned_addr learned my addr 172.21.15.123:0/3216115104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be957b640 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55868789e4c0 con 0x5586878c68f0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be957b640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a44fd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x558687a3f010 tx=0x7f6bdc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6ad5e03640 1 -- 172.21.15.123:0/3216115104 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc014030 con 0x5586878c68f0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6ad5e03640 1 -- 172.21.15.123:0/3216115104 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc01c840 con 0x5586878c68f0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558687a45510 con 0x5586878c68f0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6ad5e03640 1 -- 172.21.15.123:0/3216115104 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc01cb40 con 0x5586878c68f0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558687a45940 con 0x5586878c68f0 2024-03-20T13:37:01.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6ad5e03640 1 -- 172.21.15.123:0/3216115104 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6bdc01cca0 con 0x5586878c68f0 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6ad5e03640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ad00342b0 0x7f6ad0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6ad5e03640 1 -- 172.21.15.123:0/3216115104 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6bdc006070 con 0x5586878c68f0 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ad00342b0 0x7f6ad0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687958790 0x558687a4bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a4c190 con 0x558687958790 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.234+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687958790 0x558687a4bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ad00342b0 0x7f6ad0036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6be00ae000 tx=0x7f6be00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687958790 0x558687a4bc50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be9d7c640 1 -- 172.21.15.123:0/3216115104 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687958790 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a4ca00 0x558687a4edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a4f4b0 con 0x558687a4ca00 2024-03-20T13:37:01.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be957b640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a4ca00 0x558687a4edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be957b640 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a4ca00 0x558687a4edf0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be957b640 1 -- 172.21.15.123:0/3216115104 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a4ca00 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a50d10 con 0x558687a4ca00 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be957b640 1 -- 172.21.15.123:0/3216115104 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a4ca00 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a4ff10 con 0x558687a4ca00 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be957b640 1 -- 172.21.15.123:0/3216115104 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a4ca00 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a50320 con 0x558687958790 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.238+0000 7f6be9d7c640 1 -- 172.21.15.123:0/3216115104 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687958790 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 Processor -- start 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 -- start start 2024-03-20T13:37:01.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 0x558687a5f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586877f6e30 con 0x558687a5f3f0 2024-03-20T13:37:01.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be9d7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 0x558687a5f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be9d7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 0x558687a5f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54782/0 (socket says 172.21.15.123:54782) 2024-03-20T13:37:01.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1853325968 learned_addr learned my addr 172.21.15.123:0/1853325968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1853325968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558687a5fd50 con 0x558687a5f3f0 2024-03-20T13:37:01.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 0x558687a5f810 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6be4016cf0 tx=0x7f6be400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6aceffd640 1 -- 172.21.15.123:0/1853325968 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be4017660 con 0x558687a5f3f0 2024-03-20T13:37:01.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558687a5ffa0 con 0x558687a5f3f0 2024-03-20T13:37:01.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558687a60af0 con 0x558687a5f3f0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6aceffd640 1 -- 172.21.15.123:0/1853325968 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40177c0 con 0x558687a5f3f0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6aceffd640 1 -- 172.21.15.123:0/1853325968 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be4017a60 con 0x558687a5f3f0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6aceffd640 1 -- 172.21.15.123:0/1853325968 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6be401d020 con 0x558687a5f3f0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6aceffd640 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ac00342b0 0x7f6ac0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6aceffd640 1 -- 172.21.15.123:0/1853325968 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6be404b2c0 con 0x558687a5f3f0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be957b640 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ac00342b0 0x7f6ac0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 Processor -- start 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6beba60980 1 -- start start 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.242+0000 7f6be957b640 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ac00342b0 0x7f6ac0036770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x558687a4fa10 tx=0x7f6bdc018ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a6c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586877ea790 con 0x558687a6c3f0 2024-03-20T13:37:01.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a6c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a6c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54792/0 (socket says 172.21.15.123:54792) 2024-03-20T13:37:01.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 -- 172.21.15.123:0/4018807984 learned_addr learned my addr 172.21.15.123:0/4018807984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 -- 172.21.15.123:0/4018807984 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558687a6cde0 con 0x558687a6c3f0 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/4018807984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a6c810 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6be4049620 tx=0x7f6be4049730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bf5384ef0d8b42 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6accff9640 1 -- 172.21.15.123:0/4018807984 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be4011ad0 con 0x558687a6c3f0 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6accff9640 1 -- 172.21.15.123:0/4018807984 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40481f0 con 0x558687a6c3f0 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6accff9640 1 -- 172.21.15.123:0/4018807984 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be403b2e0 con 0x558687a6c3f0 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/4018807984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 msgr2=0x558687a6c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 --2- 172.21.15.123:0/4018807984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a6c810 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6be4049620 tx=0x7f6be4049730 comp rx=0 tx=0).stop 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/4018807984 shutdown_connections 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 --2- 172.21.15.123:0/4018807984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a6c810 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/4018807984 >> 172.21.15.123:0/4018807984 conn(0x558687a68730 msgr2=0x558687a66790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/4018807984 shutdown_connections 2024-03-20T13:37:01.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/4018807984 wait complete. 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 Processor -- start 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- start start 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a73260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558687a737a0 con 0x558687a6c3f0 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a73260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a73260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54806/0 (socket says 172.21.15.123:54806) 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 learned_addr learned my addr 172.21.15.123:0/1171343585 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558687a60af0 con 0x558687a6c3f0 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a73260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6be4013e30 tx=0x7f6be4049580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6abeffd640 1 -- 172.21.15.123:0/1171343585 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be4011ad0 con 0x558687a6c3f0 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6abeffd640 1 -- 172.21.15.123:0/1171343585 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4020510 con 0x558687a6c3f0 2024-03-20T13:37:01.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558687a739a0 con 0x558687a6c3f0 2024-03-20T13:37:01.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6abeffd640 1 -- 172.21.15.123:0/1171343585 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6be4017bc0 con 0x558687a6c3f0 2024-03-20T13:37:01.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.246+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558687a73dd0 con 0x558687a6c3f0 2024-03-20T13:37:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6abeffd640 1 -- 172.21.15.123:0/1171343585 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6be4049a00 con 0x558687a6c3f0 2024-03-20T13:37:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6abeffd640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ab40342b0 0x7f6ab4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6abeffd640 1 -- 172.21.15.123:0/1171343585 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6be404ce00 con 0x558687a6c3f0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be957b640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ab40342b0 0x7f6ab4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687a7e9c0 0x558687a80e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a815b0 con 0x558687a7e9c0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687a7e9c0 0x558687a80e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be957b640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ab40342b0 0x7f6ab4036770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc018fb0 tx=0x7f6bdc031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687a7e9c0 0x558687a80e60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 realm 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a819a0 con 0x558687a7e9c0 2024-03-20T13:37:01.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a821f0 con 0x558687a7e9c0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a82bd0 0x558687a85020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a85790 con 0x558687a82bd0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a82bd0 0x558687a85020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.250+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a82bd0 0x558687a85020 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a85f90 con 0x558687a82bd0 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 20 searching for the correct realm 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558687a87f90 0x558687a8a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be957b640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558687a87f90 0x558687a8a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be957b640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558687a87f90 0x558687a8a450 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be9d7c640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6be4005040 0x7f6be402a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x7f6be4005040 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6be4005040 0x7f6be402a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6be4005040 0x7f6be402a8a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x7f6be4005040 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.254+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x7f6be4005040 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x7f6be4005040 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x7f6be4005040 2024-03-20T13:37:01.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6be00b0020 con 0x7f6be4005040 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.258+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00b0020 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x7f6be4005040 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x7f6be4005040 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x7f6be4005040 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.262+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a87f90 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ab20 con 0x558687a82bd0 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a87520 con 0x558687a7e9c0 2024-03-20T13:37:01.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a864a0 con 0x558687a82bd0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a864b0 con 0x558687a7e9c0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 zone default found 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 4 Realm: () 2024-03-20T13:37:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 zonegroup default 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a86fe0 con 0x7f6be4005040 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8cff0 con 0x558687a87f90 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8d460 con 0x558687a87f90 2024-03-20T13:37:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 started sync module instance, tier type = 2024-03-20T13:37:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.266+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8c310 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94036289961584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8c6c0 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8e1c0 con 0x558687a7e9c0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94036289969440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8ea40 con 0x558687a7e9c0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8f510 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.270+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94036289969440] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94036289961584] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94036289968256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8f4d0 con 0x558687a82bd0 2024-03-20T13:37:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8fd60 con 0x7f6be4005040 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94036289976512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8f4d0 con 0x7f6be4005040 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.274+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a90810 con 0x558687a82bd0 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94036289976512] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94036289968256] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94036289974256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a90810 con 0x558687a82bd0 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a90c00 con 0x558687a87f90 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94036289977568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a91450 con 0x558687a87f90 2024-03-20T13:37:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a91e20 con 0x558687a87f90 2024-03-20T13:37:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94036289974256] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94036289977568] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94036289982384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a90350 con 0x558687a87f90 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.278+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a92670 con 0x7f6be4005040 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94036289982384] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94036289984800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a92670 con 0x7f6be4005040 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=0 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=1 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=2 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=3 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=4 2024-03-20T13:37:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=5 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=6 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94036289984800] v32'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 20 add_watcher() i=7 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a95b10 con 0x558687a7e9c0 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.282+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94036289987488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a92ff0 con 0x558687a7e9c0 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94036289987488] v32'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6a9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 5 note: GC not initialized 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6a9efe5640 20 reqs_thread_entry: start 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 Filter name: none 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:37:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6a9cfe1640 20 reqs_thread_entry: start 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687ab7b30 con 0x7f6be4005040 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687ab6300 con 0x558687a87f90 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:37:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:37:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:37:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:37:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.286+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687ab66e0 con 0x7f6be4005040 2024-03-20T13:37:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v32'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94036290139536 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687abb090 con 0x558687a87f90 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== watch-notify(notify (1) cookie 94036289977568 notify 137438953474 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f6bdc037040 con 0x558687a87f90 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6accff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94036289977568 notifier 4486 bl.length()=522 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6accff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6accff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6accff9640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6aac003ea0 con 0x558687a87f90 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(65 notify.5 [notify cookie 94036290139536 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== watch-notify(notify_complete (2) cookie 94036290139536 notify 137438953474 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558687a45940 con 0x558687a87f90 2024-03-20T13:37:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687ab7590 con 0x558687a87f90 2024-03-20T13:37:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:37:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:37:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:37:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94036290139536 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687abb020 con 0x558687a82bd0 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94036289968256 notify 137438953495 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f6be4050040 con 0x558687a82bd0 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94036289968256 notifier 4486 bl.length()=177 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6abffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6abffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6abffff640 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6a10003400 con 0x558687a82bd0 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.290+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(68 notify.2 [notify cookie 94036290139536 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.294+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be400a4d0 con 0x558687a82bd0 2024-03-20T13:37:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.294+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94036290139536 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6be4066040 con 0x558687a82bd0 2024-03-20T13:37:01.300 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.294+0000 7f6a9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.294+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94036289987488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687ab6d10 con 0x558687a7e9c0 2024-03-20T13:37:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.294+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94036289987488] v32'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.294+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94036289961584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a92370 con 0x558687a82bd0 2024-03-20T13:37:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94036289961584] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be4068040 con 0x558687a82bd0 2024-03-20T13:37:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6beba60980 20 remove_watcher() i=0 2024-03-20T13:37:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6beba60980 2 removed watcher, disabling cache 2024-03-20T13:37:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94036289969440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8be70 con 0x558687a7e9c0 2024-03-20T13:37:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94036289969440] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x558687a7e9c0 2024-03-20T13:37:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6beba60980 20 remove_watcher() i=1 2024-03-20T13:37:01.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.298+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94036289968256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8be70 con 0x558687a82bd0 2024-03-20T13:37:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.302+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94036289968256] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be4068040 con 0x558687a82bd0 2024-03-20T13:37:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.302+0000 7f6beba60980 20 remove_watcher() i=2 2024-03-20T13:37:01.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.302+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94036289976512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8be70 con 0x7f6be4005040 2024-03-20T13:37:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.302+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94036289976512] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.302+0000 7f6beba60980 20 remove_watcher() i=3 2024-03-20T13:37:01.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.302+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94036289974256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8f8c0 con 0x558687a82bd0 2024-03-20T13:37:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6be9d7c640 1 -- 172.21.15.123:0/1171343585 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94036289974256] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be4068040 con 0x558687a82bd0 2024-03-20T13:37:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 20 remove_watcher() i=4 2024-03-20T13:37:01.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94036289977568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8be70 con 0x558687a87f90 2024-03-20T13:37:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94036289977568] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 20 remove_watcher() i=5 2024-03-20T13:37:01.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94036289982384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8fd60 con 0x558687a87f90 2024-03-20T13:37:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6be957b640 1 -- 172.21.15.123:0/1171343585 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94036289982384] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bdc016070 con 0x558687a87f90 2024-03-20T13:37:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 20 remove_watcher() i=6 2024-03-20T13:37:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94036289984800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558687a8fd30 con 0x7f6be4005040 2024-03-20T13:37:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94036289984800] v32'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6be00d5060 con 0x7f6be4005040 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.306+0000 7f6beba60980 20 remove_watcher() i=7 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a82bd0 msgr2=0x558687a85020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a82bd0 0x558687a85020 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687a7e9c0 msgr2=0x558687a80e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687a7e9c0 0x558687a80e60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6be4005040 msgr2=0x7f6be402a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6be4005040 0x7f6be402a8a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558687a87f90 msgr2=0x558687a8a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558687a87f90 0x558687a8a450 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ab40342b0 msgr2=0x7f6ab4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ab40342b0 0x7f6ab4036770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc018fb0 tx=0x7f6bdc031000 comp rx=0 tx=0).stop 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 msgr2=0x558687a73260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6be8d7a640 1 -- 172.21.15.123:0/1171343585 reap_dead start 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a73260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6be4013e30 tx=0x7f6be4049580 comp rx=0 tx=0).stop 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 shutdown_connections 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1171343585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a6c3f0 0x558687a73260 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 >> 172.21.15.123:0/1171343585 conn(0x558687a68730 msgr2=0x558687a65d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 shutdown_connections 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1171343585 wait complete. 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ac00342b0 msgr2=0x7f6ac0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ac00342b0 0x7f6ac0036770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x558687a4fa10 tx=0x7f6bdc018ca0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 msgr2=0x558687a5f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 0x558687a5f810 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6be4016cf0 tx=0x7f6be400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 shutdown_connections 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ac00342b0 0x7f6ac0036770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/1853325968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558687a5f3f0 0x558687a5f810 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 >> 172.21.15.123:0/1853325968 conn(0x558687a54200 msgr2=0x558687a54d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 shutdown_connections 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/1853325968 wait complete. 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a4ca00 msgr2=0x558687a4edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a4ca00 0x558687a4edf0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687958790 msgr2=0x558687a4bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687958790 0x558687a4bc50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ad00342b0 msgr2=0x7f6ad0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ad00342b0 0x7f6ad0036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6be00ae000 tx=0x7f6be00a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 msgr2=0x558687a44fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a44fd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x558687a3f010 tx=0x7f6bdc000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 shutdown_connections 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558687a4ca00 0x558687a4edf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558687958790 0x558687a4bc50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6ad00342b0 0x7f6ad0036770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 --2- 172.21.15.123:0/3216115104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586878c68f0 0x558687a44fd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 >> 172.21.15.123:0/3216115104 conn(0x55868794c750 msgr2=0x558687a38820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 shutdown_connections 2024-03-20T13:37:01.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.310+0000 7f6beba60980 1 -- 172.21.15.123:0/3216115104 wait complete. 2024-03-20T13:37:01.325 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:01.331 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:37:01.337 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:01.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-03-20T13:37:01.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-03-20T13:37:01.338 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-03-20T13:37:01.400 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:01.400 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:01.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2d026e980 1 Processor -- start 2024-03-20T13:37:01.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2d026e980 1 -- start start 2024-03-20T13:37:01.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2d026e980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55edf9ef8e40 0x55edf9ef9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2d026e980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55edf9e46520 con 0x55edf9ef9760 2024-03-20T13:37:01.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2d026e980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55edf9e0d0f0 con 0x55edf9ef8e40 2024-03-20T13:37:01.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2cdd89640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55edf9ef8e40 0x55edf9ef9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2cd588640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55edf9ef9760 0x55edf9efa120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59166/0 (socket says 172.21.15.123:59166) 2024-03-20T13:37:01.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2cdd89640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55edf9ef8e40 0x55edf9ef9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54814/0 (socket says 172.21.15.123:54814) 2024-03-20T13:37:01.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.394+0000 7fb2cd588640 1 -- 172.21.15.123:0/379129600 learned_addr learned my addr 172.21.15.123:0/379129600 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:01.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2cdd89640 1 -- 172.21.15.123:0/379129600 >> v1:172.21.15.89:6789/0 conn(0x55edf9ef9760 legacy=0x55edf9efa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2cdd89640 1 -- 172.21.15.123:0/379129600 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf9efa950 con 0x55edf9ef8e40 2024-03-20T13:37:01.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/379129600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9ef9220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000a480 tx=0x7fb2c001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b384369e0c2d6900 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2ccd87640 1 -- 172.21.15.123:0/379129600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00ab540 con 0x55edf9ef8e40 2024-03-20T13:37:01.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2ccd87640 1 -- 172.21.15.123:0/379129600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00ab6a0 con 0x55edf9ef8e40 2024-03-20T13:37:01.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2ccd87640 1 -- 172.21.15.123:0/379129600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00ab960 con 0x55edf9ef8e40 2024-03-20T13:37:01.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 -- 172.21.15.123:0/379129600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 msgr2=0x55edf9ef9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 --2- 172.21.15.123:0/379129600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9ef9220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000a480 tx=0x7fb2c001b280 comp rx=0 tx=0).stop 2024-03-20T13:37:01.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 -- 172.21.15.123:0/379129600 shutdown_connections 2024-03-20T13:37:01.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 --2- 172.21.15.123:0/379129600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9ef9220 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 -- 172.21.15.123:0/379129600 >> 172.21.15.123:0/379129600 conn(0x55edf9ef4710 msgr2=0x55edf9ef6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 -- 172.21.15.123:0/379129600 shutdown_connections 2024-03-20T13:37:01.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.398+0000 7fb2d026e980 1 -- 172.21.15.123:0/379129600 wait complete. 2024-03-20T13:37:01.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 Processor -- start 2024-03-20T13:37:01.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- start start 2024-03-20T13:37:01.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fe02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf9e0a620 con 0x55edf9ef8e40 2024-03-20T13:37:01.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2cdd89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fe02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2cdd89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fe02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54826/0 (socket says 172.21.15.123:54826) 2024-03-20T13:37:01.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2cdd89640 1 -- 172.21.15.123:0/4258888624 learned_addr learned my addr 172.21.15.123:0/4258888624 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2cdd89640 1 -- 172.21.15.123:0/4258888624 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0005d30 con 0x55edf9ef8e40 2024-03-20T13:37:01.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/4258888624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fe02c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00ae040 tx=0x7fb2c0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceb2b8a73433752 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb1bbe07640 1 -- 172.21.15.123:0/4258888624 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00ab810 con 0x55edf9ef8e40 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb1bbe07640 1 -- 172.21.15.123:0/4258888624 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00ab970 con 0x55edf9ef8e40 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb1bbe07640 1 -- 172.21.15.123:0/4258888624 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00abc10 con 0x55edf9ef8e40 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- 172.21.15.123:0/4258888624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 msgr2=0x55edf9fe02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 --2- 172.21.15.123:0/4258888624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fe02c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00ae040 tx=0x7fb2c0003030 comp rx=0 tx=0).stop 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- 172.21.15.123:0/4258888624 shutdown_connections 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 --2- 172.21.15.123:0/4258888624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fe02c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- 172.21.15.123:0/4258888624 >> 172.21.15.123:0/4258888624 conn(0x55edf9ef4710 msgr2=0x55edf9e6e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- 172.21.15.123:0/4258888624 shutdown_connections 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- 172.21.15.123:0/4258888624 wait complete. 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 Processor -- start 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- start start 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.414+0000 7fb2d026e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf9e05e00 con 0x55edf9ef8e40 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cdd89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cdd89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54836/0 (socket says 172.21.15.123:54836) 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cdd89640 1 -- 172.21.15.123:0/120888265 learned_addr learned my addr 172.21.15.123:0/120888265 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cdd89640 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf9efa950 con 0x55edf9ef8e40 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fed320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb2c001bb20 tx=0x7fb2c0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb1ba604640 1 -- 172.21.15.123:0/120888265 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00c2070 con 0x55edf9ef8e40 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edf9fed860 con 0x55edf9ef8e40 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edf9fedcf0 con 0x55edf9ef8e40 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb1ba604640 1 -- 172.21.15.123:0/120888265 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00b59d0 con 0x55edf9ef8e40 2024-03-20T13:37:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb1ba604640 1 -- 172.21.15.123:0/120888265 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00b5c70 con 0x55edf9ef8e40 2024-03-20T13:37:01.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb1ba604640 1 -- 172.21.15.123:0/120888265 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb2c00b2070 con 0x55edf9ef8e40 2024-03-20T13:37:01.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb1ba604640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1b40342b0 0x7fb1b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb1ba604640 1 -- 172.21.15.123:0/120888265 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb2c00e3450 con 0x55edf9ef8e40 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cd588640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1b40342b0 0x7fb1b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edf9ef9760 0x55edf9ff3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edf9ff44e0 con 0x55edf9ef9760 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edf9ef9760 0x55edf9ff3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2cd588640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1b40342b0 0x7fb1b4036770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40012f0 tx=0x7fb2c4006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edf9ef9760 0x55edf9ff3fa0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2ce58a640 1 -- 172.21.15.123:0/120888265 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb2c80083f0 con 0x55edf9ef9760 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edf9ff4da0 0x55edf9ff7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.418+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edf9ff78c0 con 0x55edf9ff4da0 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edf9ff4da0 0x55edf9ff7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edf9ff4da0 0x55edf9ff7190 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2cdd89640 1 -- 172.21.15.123:0/120888265 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb2c00bd580 con 0x55edf9ff4da0 2024-03-20T13:37:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edf9ff9100 con 0x55edf9ff4da0 2024-03-20T13:37:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2cdd89640 1 -- 172.21.15.123:0/120888265 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb2c0006390 con 0x55edf9ff4da0 2024-03-20T13:37:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edf9ff8300 con 0x55edf9ff4da0 2024-03-20T13:37:01.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2cdd89640 1 -- 172.21.15.123:0/120888265 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb2c0006390 con 0x55edf9ff4da0 2024-03-20T13:37:01.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edf9ff8710 con 0x55edf9ef9760 2024-03-20T13:37:01.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2ce58a640 1 -- 172.21.15.123:0/120888265 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb2c80083f0 con 0x55edf9ef9760 2024-03-20T13:37:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2d026e980 1 Processor -- start 2024-03-20T13:37:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.422+0000 7fb2d026e980 1 -- start start 2024-03-20T13:37:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 0x55edfa007cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf9d9ee30 con 0x55edfa007890 2024-03-20T13:37:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 0x55edfa007cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 0x55edfa007cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54846/0 (socket says 172.21.15.123:54846) 2024-03-20T13:37:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 -- 172.21.15.123:0/1400004405 learned_addr learned my addr 172.21.15.123:0/1400004405 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 -- 172.21.15.123:0/1400004405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfa0081f0 con 0x55edfa007890 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 0x55edfa007cb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800aae0 tx=0x7fb2c8008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb1b37fe640 1 -- 172.21.15.123:0/1400004405 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c801d070 con 0x55edfa007890 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb1b37fe640 1 -- 172.21.15.123:0/1400004405 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8010040 con 0x55edfa007890 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edfa008440 con 0x55edfa007890 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb1b37fe640 1 -- 172.21.15.123:0/1400004405 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8007e70 con 0x55edfa007890 2024-03-20T13:37:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edfa008f90 con 0x55edfa007890 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb1b37fe640 1 -- 172.21.15.123:0/1400004405 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb2c8018430 con 0x55edfa007890 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb1b37fe640 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1a80342b0 0x7fb1a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb1b37fe640 1 -- 172.21.15.123:0/1400004405 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb2c804a630 con 0x55edfa007890 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1a80342b0 0x7fb1a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 Processor -- start 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 -- start start 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1a80342b0 0x7fb1a8036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55edf9ff7d40 tx=0x7fb2c00e1860 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa014c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2d026e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf9d92790 con 0x55edfa0147e0 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa014c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa014c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54854/0 (socket says 172.21.15.123:54854) 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.426+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2154527706 learned_addr learned my addr 172.21.15.123:0/2154527706 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2154527706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfa0151d0 con 0x55edfa0147e0 2024-03-20T13:37:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/2154527706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa014c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8048a20 tx=0x7fb2c8021970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a255af4acad6c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb1b17fa640 1 -- 172.21.15.123:0/2154527706 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8047070 con 0x55edfa0147e0 2024-03-20T13:37:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb1b17fa640 1 -- 172.21.15.123:0/2154527706 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8022590 con 0x55edfa0147e0 2024-03-20T13:37:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb1b17fa640 1 -- 172.21.15.123:0/2154527706 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8016330 con 0x55edfa0147e0 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2154527706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 msgr2=0x55edfa014c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2154527706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa014c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8048a20 tx=0x7fb2c8021970 comp rx=0 tx=0).stop 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2154527706 shutdown_connections 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2154527706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa014c00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2154527706 >> 172.21.15.123:0/2154527706 conn(0x55edfa010b70 msgr2=0x55edfa00ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2154527706 shutdown_connections 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2154527706 wait complete. 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 Processor -- start 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- start start 2024-03-20T13:37:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa01b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edfa01bc10 con 0x55edfa0147e0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa01b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa01b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54856/0 (socket says 172.21.15.123:54856) 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 learned_addr learned my addr 172.21.15.123:0/2011384503 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edfa008f90 con 0x55edfa0147e0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa01b6d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80077a0 tx=0x7fb2c80489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb19f7fe640 1 -- 172.21.15.123:0/2011384503 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c80167f0 con 0x55edfa0147e0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb19f7fe640 1 -- 172.21.15.123:0/2011384503 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8016970 con 0x55edfa0147e0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edfa01be10 con 0x55edfa0147e0 2024-03-20T13:37:01.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edfa01c2a0 con 0x55edfa0147e0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.430+0000 7fb19f7fe640 1 -- 172.21.15.123:0/2011384503 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8021a30 con 0x55edfa0147e0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb19f7fe640 1 -- 172.21.15.123:0/2011384503 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb2c8021bb0 con 0x55edfa0147e0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb19f7fe640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1980342b0 0x7fb198036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb19f7fe640 1 -- 172.21.15.123:0/2011384503 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb2c8036cb0 con 0x55edfa0147e0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1980342b0 0x7fb198036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edfa026e10 0x55edfa0292b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa029a00 con 0x55edfa026e10 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cd588640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edfa026e10 0x55edfa0292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1980342b0 0x7fb198036770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0007000 tx=0x7fb2c00b4670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cd588640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edfa026e10 0x55edfa0292b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 realm 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa026330 con 0x55edfa026e10 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa02a480 con 0x55edfa026e10 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edfa02aff0 0x55edfa02d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa02dc20 con 0x55edfa02aff0 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edfa02aff0 0x55edfa02d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edfa02aff0 0x55edfa02d4b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.434+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa02e470 con 0x55edfa02aff0 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2d026e980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2d026e980 20 searching for the correct realm 2024-03-20T13:37:01.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55edfa030190 0x55edfa032580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55edfa030190 0x55edfa032580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cdd89640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55edfa030190 0x55edfa032580 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2ce58a640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb2c8035070 0x7fb2c8047070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x7fb2c8035070 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb2c8035070 0x7fb2c8047070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb2c8035070 0x7fb2c8047070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.438+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x7fb2c8035070 2024-03-20T13:37:01.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x7fb2c8035070 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.442+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x7fb2c8035070 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x7fb2c8035070 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x7fb2c8035070 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa030190 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.446+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa032b10 con 0x55edfa02aff0 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:01.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa02eda0 con 0x55edfa026e10 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa02f1e0 con 0x55edfa02aff0 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa02f600 con 0x55edfa026e10 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 zone default found 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 4 Realm: () 2024-03-20T13:37:01.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 zonegroup default 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa033440 con 0x7fb2c8035070 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa035620 con 0x55edfa030190 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa035980 con 0x55edfa030190 2024-03-20T13:37:01.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 started sync module instance, tier type = 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.450+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa034a60 con 0x55edfa02aff0 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94480590128576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0352b0 con 0x55edfa02aff0 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0362f0 con 0x55edfa026e10 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94480590136912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa036f10 con 0x55edfa026e10 2024-03-20T13:37:01.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa037880 con 0x55edfa02aff0 2024-03-20T13:37:01.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.454+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94480590128576] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.458+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94480590136912] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.458+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.462+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94480590137968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa036e90 con 0x55edfa02aff0 2024-03-20T13:37:01.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.462+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa037d20 con 0x7fb2c8035070 2024-03-20T13:37:01.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.462+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.462+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94480590141568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa038140 con 0x7fb2c8035070 2024-03-20T13:37:01.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.462+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa038b30 con 0x55edfa02aff0 2024-03-20T13:37:01.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.466+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94480590141568] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.466+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94480590137968] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.466+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.466+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94480590145040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa037ca0 con 0x55edfa02aff0 2024-03-20T13:37:01.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.466+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa039380 con 0x55edfa030190 2024-03-20T13:37:01.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.470+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.470+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94480590147296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa037ca0 con 0x55edfa030190 2024-03-20T13:37:01.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.470+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03a190 con 0x55edfa030190 2024-03-20T13:37:01.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.470+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94480590145040] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94480590150896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03a110 con 0x55edfa030190 2024-03-20T13:37:01.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03ae80 con 0x7fb2c8035070 2024-03-20T13:37:01.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94480590147296] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94480590150896] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94480590149344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03a9e0 con 0x7fb2c8035070 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=0 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=1 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=2 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=3 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=4 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=5 2024-03-20T13:37:01.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=6 2024-03-20T13:37:01.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94480590149344] v32'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 20 add_watcher() i=7 2024-03-20T13:37:01.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:01.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03a9e0 con 0x55edfa026e10 2024-03-20T13:37:01.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.474+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94480590153024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03b650 con 0x55edfa026e10 2024-03-20T13:37:01.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94480590153024] v32'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb17f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:01.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:01.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 5 note: GC not initialized 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb17e7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 20 Filter name: none 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb0effff640 20 reqs_thread_entry: start 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa05f700 con 0x7fb2c8035070 2024-03-20T13:37:01.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:01.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb17f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.478+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94480590153024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03ffa0 con 0x55edfa026e10 2024-03-20T13:37:01.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.482+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94480590153024] v32'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.482+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94480590128576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa03a540 con 0x55edfa02aff0 2024-03-20T13:37:01.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.482+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94480590128576] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.482+0000 7fb2d026e980 20 remove_watcher() i=0 2024-03-20T13:37:01.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.482+0000 7fb2d026e980 2 removed watcher, disabling cache 2024-03-20T13:37:01.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.482+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94480590136912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0345c0 con 0x55edfa026e10 2024-03-20T13:37:01.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.486+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94480590136912] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x55edfa026e10 2024-03-20T13:37:01.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.486+0000 7fb2d026e980 20 remove_watcher() i=1 2024-03-20T13:37:01.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.486+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94480590137968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0345c0 con 0x55edfa02aff0 2024-03-20T13:37:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.490+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94480590137968] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.490+0000 7fb2d026e980 20 remove_watcher() i=2 2024-03-20T13:37:01.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.490+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94480590141568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0345c0 con 0x7fb2c8035070 2024-03-20T13:37:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.490+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94480590141568] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.490+0000 7fb2d026e980 20 remove_watcher() i=3 2024-03-20T13:37:01.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.490+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94480590145040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0345c0 con 0x55edfa02aff0 2024-03-20T13:37:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2ce58a640 1 -- 172.21.15.123:0/2011384503 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94480590145040] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c8041040 con 0x55edfa02aff0 2024-03-20T13:37:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2d026e980 20 remove_watcher() i=4 2024-03-20T13:37:01.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94480590147296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa038610 con 0x55edfa030190 2024-03-20T13:37:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94480590147296] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2d026e980 20 remove_watcher() i=5 2024-03-20T13:37:01.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94480590150896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa0345c0 con 0x55edfa030190 2024-03-20T13:37:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2cdd89640 1 -- 172.21.15.123:0/2011384503 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94480590150896] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c0006390 con 0x55edfa030190 2024-03-20T13:37:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2d026e980 20 remove_watcher() i=6 2024-03-20T13:37:01.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.494+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94480590149344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55edfa038ee0 con 0x7fb2c8035070 2024-03-20T13:37:01.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94480590149344] v32'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2c4004530 con 0x7fb2c8035070 2024-03-20T13:37:01.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 20 remove_watcher() i=7 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edfa02aff0 msgr2=0x55edfa02d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edfa02aff0 0x55edfa02d4b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edfa026e10 msgr2=0x55edfa0292b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edfa026e10 0x55edfa0292b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb2c8035070 msgr2=0x7fb2c8047070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb2c8035070 0x7fb2c8047070 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55edfa030190 msgr2=0x55edfa032580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55edfa030190 0x55edfa032580 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1980342b0 msgr2=0x7fb198036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1980342b0 0x7fb198036770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0007000 tx=0x7fb2c00b4670 comp rx=0 tx=0).stop 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 msgr2=0x55edfa01b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/2011384503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa0147e0 0x55edfa01b6d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80077a0 tx=0x7fb2c80489b0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 reap_dead start 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2cd588640 1 -- 172.21.15.123:0/2011384503 reap_dead start 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 shutdown_connections 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 >> 172.21.15.123:0/2011384503 conn(0x55edfa010b70 msgr2=0x55edfa00e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 shutdown_connections 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/2011384503 wait complete. 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1a80342b0 msgr2=0x7fb1a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1a80342b0 0x7fb1a8036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55edf9ff7d40 tx=0x7fb2c00e1860 comp rx=0 tx=0).stop 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 msgr2=0x55edfa007cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 0x55edfa007cb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800aae0 tx=0x7fb2c8008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 shutdown_connections 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1a80342b0 0x7fb1a8036770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/1400004405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edfa007890 0x55edfa007cb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 >> 172.21.15.123:0/1400004405 conn(0x55edf9ffc6a0 msgr2=0x55edf9ffd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 shutdown_connections 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/1400004405 wait complete. 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edf9ff4da0 msgr2=0x55edf9ff7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edf9ff4da0 0x55edf9ff7190 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edf9ef9760 msgr2=0x55edf9ff3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edf9ef9760 0x55edf9ff3fa0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1b40342b0 msgr2=0x7fb1b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1b40342b0 0x7fb1b4036770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40012f0 tx=0x7fb2c4006700 comp rx=0 tx=0).stop 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 msgr2=0x55edf9fed320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fed320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb2c001bb20 tx=0x7fb2c0018020 comp rx=0 tx=0).stop 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 shutdown_connections 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55edf9ff4da0 0x55edf9ff7190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55edf9ef9760 0x55edf9ff3fa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb1b40342b0 0x7fb1b4036770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 --2- 172.21.15.123:0/120888265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55edf9ef8e40 0x55edf9fed320 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 >> 172.21.15.123:0/120888265 conn(0x55edf9ef4710 msgr2=0x55edf9fdd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 shutdown_connections 2024-03-20T13:37:01.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.498+0000 7fb2d026e980 1 -- 172.21.15.123:0/120888265 wait complete. 2024-03-20T13:37:01.513 INFO:teuthology.orchestra.run.smithi123.stdout:{"key":"bucket:myfoo","ver":{"tag":"_9A-1M0_bhvC2ZWFDd_Icw3I","ver":2},"mtime":"2024-03-20T13:37:01.114724Z","data":{"bucket":{"name":"myfoo","marker":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","bucket_id":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-03-20T13:36:59.684227Z","linked":false,"has_bucket_info":false}} 2024-03-20T13:37:01.513 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_9A-1M0_bhvC2ZWFDd_Icw3I', 'ver': 2}, 'mtime': '2024-03-20T13:37:01.114724Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'bucket_id': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-03-20T13:36:59.684227Z', 'linked': False, 'has_bucket_info': False}} 2024-03-20T13:37:01.513 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1'] 2024-03-20T13:37:01.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1'] 2024-03-20T13:37:01.514 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:01.591 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:01.591 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:01.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff84b645980 1 Processor -- start 2024-03-20T13:37:01.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff84b645980 1 -- start start 2024-03-20T13:37:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff84b645980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d510bd9de0 0x55d510bda1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff84b645980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d510b274c0 con 0x55d510bda700 2024-03-20T13:37:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff84b645980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d510aee0f0 con 0x55d510bd9de0 2024-03-20T13:37:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff849160640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d510bd9de0 0x55d510bda1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff849160640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d510bd9de0 0x55d510bda1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54872/0 (socket says 172.21.15.123:54872) 2024-03-20T13:37:01.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff849160640 1 -- 172.21.15.123:0/885232875 learned_addr learned my addr 172.21.15.123:0/885232875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff84895f640 1 --1- 172.21.15.123:0/885232875 >> v1:172.21.15.89:6789/0 conn(0x55d510bda700 0x55d510bdb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59176/0 (socket says 172.21.15.123:59176) 2024-03-20T13:37:01.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff849160640 1 -- 172.21.15.123:0/885232875 >> v1:172.21.15.89:6789/0 conn(0x55d510bda700 legacy=0x55d510bdb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.586+0000 7ff849160640 1 -- 172.21.15.123:0/885232875 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d510bdb8f0 con 0x55d510bd9de0 2024-03-20T13:37:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff849160640 1 --2- 172.21.15.123:0/885232875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510bda1c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00a5c0 tx=0x7ff83c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f9ec66a83a8830 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff843fff640 1 -- 172.21.15.123:0/885232875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff83c0aa470 con 0x55d510bd9de0 2024-03-20T13:37:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff843fff640 1 -- 172.21.15.123:0/885232875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0aa5d0 con 0x55d510bd9de0 2024-03-20T13:37:01.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff843fff640 1 -- 172.21.15.123:0/885232875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff83c0aa890 con 0x55d510bd9de0 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 -- 172.21.15.123:0/885232875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 msgr2=0x55d510bda1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 --2- 172.21.15.123:0/885232875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510bda1c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00a5c0 tx=0x7ff83c01b340 comp rx=0 tx=0).stop 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 -- 172.21.15.123:0/885232875 shutdown_connections 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 --2- 172.21.15.123:0/885232875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510bda1c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 -- 172.21.15.123:0/885232875 >> 172.21.15.123:0/885232875 conn(0x55d510bd56b0 msgr2=0x55d510bd7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 -- 172.21.15.123:0/885232875 shutdown_connections 2024-03-20T13:37:01.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.590+0000 7ff84b645980 1 -- 172.21.15.123:0/885232875 wait complete. 2024-03-20T13:37:01.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 Processor -- start 2024-03-20T13:37:01.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- start start 2024-03-20T13:37:01.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510cc5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d510aeb620 con 0x55d510bd9de0 2024-03-20T13:37:01.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510cc5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510cc5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54886/0 (socket says 172.21.15.123:54886) 2024-03-20T13:37:01.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 -- 172.21.15.123:0/2621647893 learned_addr learned my addr 172.21.15.123:0/2621647893 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 -- 172.21.15.123:0/2621647893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c005df0 con 0x55d510bd9de0 2024-03-20T13:37:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 --2- 172.21.15.123:0/2621647893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510cc5470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff83c018f70 tx=0x7ff83c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93afb6951b3b691a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff737606640 1 -- 172.21.15.123:0/2621647893 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff83c0aa9c0 con 0x55d510bd9de0 2024-03-20T13:37:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff737606640 1 -- 172.21.15.123:0/2621647893 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0aab20 con 0x55d510bd9de0 2024-03-20T13:37:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff737606640 1 -- 172.21.15.123:0/2621647893 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff83c0aadc0 con 0x55d510bd9de0 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- 172.21.15.123:0/2621647893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 msgr2=0x55d510cc5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 --2- 172.21.15.123:0/2621647893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510cc5470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff83c018f70 tx=0x7ff83c003030 comp rx=0 tx=0).stop 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- 172.21.15.123:0/2621647893 shutdown_connections 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 --2- 172.21.15.123:0/2621647893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510cc5470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- 172.21.15.123:0/2621647893 >> 172.21.15.123:0/2621647893 conn(0x55d510bd56b0 msgr2=0x55d510cc1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- 172.21.15.123:0/2621647893 shutdown_connections 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- 172.21.15.123:0/2621647893 wait complete. 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 Processor -- start 2024-03-20T13:37:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- start start 2024-03-20T13:37:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510ccc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff84b645980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d510ae6e00 con 0x55d510bd9de0 2024-03-20T13:37:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510ccc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510ccc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54894/0 (socket says 172.21.15.123:54894) 2024-03-20T13:37:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.606+0000 7ff849160640 1 -- 172.21.15.123:0/3632841287 learned_addr learned my addr 172.21.15.123:0/3632841287 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff849160640 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d510bdb8f0 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff849160640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510ccc220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff83c018f70 tx=0x7ff83c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff735e03640 1 -- 172.21.15.123:0/3632841287 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff83c0cb070 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff735e03640 1 -- 172.21.15.123:0/3632841287 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0c6690 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff735e03640 1 -- 172.21.15.123:0/3632841287 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff83c0c6930 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d510ccc760 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d510cccb90 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff735e03640 1 -- 172.21.15.123:0/3632841287 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff83c0c6b60 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff735e03640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7300342b0 0x7ff730036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff735e03640 1 -- 172.21.15.123:0/3632841287 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff83c0e49f0 con 0x55d510bd9de0 2024-03-20T13:37:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84895f640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7300342b0 0x7ff730036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510bda700 0x55d510cd2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510cd33e0 con 0x55d510bda700 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff849961640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510bda700 0x55d510cd2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84895f640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7300342b0 0x7ff730036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8340012f0 tx=0x7ff834006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff849961640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510bda700 0x55d510cd2ea0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff849961640 1 -- 172.21.15.123:0/3632841287 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff8440083f0 con 0x55d510bda700 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510cd3c50 0x55d510cd6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510cd66a0 con 0x55d510cd3c50 2024-03-20T13:37:01.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.610+0000 7ff849160640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510cd3c50 0x55d510cd6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849160640 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510cd3c50 0x55d510cd6040 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849160640 1 -- 172.21.15.123:0/3632841287 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510cd3c50 2024-03-20T13:37:01.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510cd7ee0 con 0x55d510cd3c50 2024-03-20T13:37:01.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849160640 1 -- 172.21.15.123:0/3632841287 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510cd3c50 2024-03-20T13:37:01.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510cd70e0 con 0x55d510cd3c50 2024-03-20T13:37:01.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849160640 1 -- 172.21.15.123:0/3632841287 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510cd3c50 2024-03-20T13:37:01.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510cd74f0 con 0x55d510bda700 2024-03-20T13:37:01.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849961640 1 -- 172.21.15.123:0/3632841287 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff8440083f0 con 0x55d510bda700 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 Processor -- start 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 -- start start 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 0x55d510ce69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff84b645980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d510a7fe30 con 0x55d510ce65a0 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849961640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 0x55d510ce69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849961640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 0x55d510ce69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54906/0 (socket says 172.21.15.123:54906) 2024-03-20T13:37:01.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.614+0000 7ff849961640 1 -- 172.21.15.123:0/3989631459 learned_addr learned my addr 172.21.15.123:0/3989631459 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 -- 172.21.15.123:0/3989631459 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d510ce6f00 con 0x55d510ce65a0 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 0x55d510ce69c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff84400aae0 tx=0x7ff844008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff72effd640 1 -- 172.21.15.123:0/3989631459 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff84401d070 con 0x55d510ce65a0 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d510ce7150 con 0x55d510ce65a0 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff72effd640 1 -- 172.21.15.123:0/3989631459 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844010040 con 0x55d510ce65a0 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff72effd640 1 -- 172.21.15.123:0/3989631459 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff844007e70 con 0x55d510ce65a0 2024-03-20T13:37:01.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d510ce7ca0 con 0x55d510ce65a0 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff72effd640 1 -- 172.21.15.123:0/3989631459 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff844018430 con 0x55d510ce65a0 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff72effd640 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7240342b0 0x7ff724036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff72effd640 1 -- 172.21.15.123:0/3989631459 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff84404a600 con 0x55d510ce65a0 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849160640 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7240342b0 0x7ff724036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff84b645980 1 Processor -- start 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff84b645980 1 -- start start 2024-03-20T13:37:01.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849160640 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7240342b0 0x7ff724036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d510cd6be0 tx=0x7ff83c0e0040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff84b645980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cf3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff84b645980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d510a73790 con 0x55d510cf3540 2024-03-20T13:37:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cf3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cf3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54914/0 (socket says 172.21.15.123:54914) 2024-03-20T13:37:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 -- 172.21.15.123:0/3710633228 learned_addr learned my addr 172.21.15.123:0/3710633228 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 -- 172.21.15.123:0/3710633228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d510cf3f10 con 0x55d510cf3540 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.618+0000 7ff849961640 1 --2- 172.21.15.123:0/3710633228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cf3940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff8440489f0 tx=0x7ff844048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3df606c4ced3127 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff72cff9640 1 -- 172.21.15.123:0/3710633228 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff844047070 con 0x55d510cf3540 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff72cff9640 1 -- 172.21.15.123:0/3710633228 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844022410 con 0x55d510cf3540 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff72cff9640 1 -- 172.21.15.123:0/3710633228 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff844016330 con 0x55d510cf3540 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3710633228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 msgr2=0x55d510cf3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 --2- 172.21.15.123:0/3710633228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cf3940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff8440489f0 tx=0x7ff844048f00 comp rx=0 tx=0).stop 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3710633228 shutdown_connections 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 --2- 172.21.15.123:0/3710633228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cf3940 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3710633228 >> 172.21.15.123:0/3710633228 conn(0x55d510cef880 msgr2=0x55d510ced8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3710633228 shutdown_connections 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3710633228 wait complete. 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 Processor -- start 2024-03-20T13:37:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- start start 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cfa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d510cfa8f0 con 0x55d510cf3540 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff849961640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cfa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff849961640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cfa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54926/0 (socket says 172.21.15.123:54926) 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 learned_addr learned my addr 172.21.15.123:0/3175865566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d510ce7ca0 con 0x55d510cf3540 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff849961640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cfa3b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff844020890 tx=0x7ff844048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff71affd640 1 -- 172.21.15.123:0/3175865566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff844022580 con 0x55d510cf3540 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d510cfaaf0 con 0x55d510cf3540 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff71affd640 1 -- 172.21.15.123:0/3175865566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84404a960 con 0x55d510cf3540 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d510cfaf80 con 0x55d510cf3540 2024-03-20T13:37:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff71affd640 1 -- 172.21.15.123:0/3175865566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff84404ac00 con 0x55d510cf3540 2024-03-20T13:37:01.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.622+0000 7ff71affd640 1 -- 172.21.15.123:0/3175865566 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff844018730 con 0x55d510cf3540 2024-03-20T13:37:01.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff71affd640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff714034260 0x7ff714036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff71affd640 1 -- 172.21.15.123:0/3175865566 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff844037c60 con 0x55d510cf3540 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff849160640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff714034260 0x7ff714036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510d05b10 0x55d510d07fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d08720 con 0x55d510d05b10 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84895f640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510d05b10 0x55d510d07fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff849160640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff714034260 0x7ff714036720 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0cfff0 tx=0x7ff83c0e2000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84895f640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510d05b10 0x55d510d07fd0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 realm 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d04ff0 con 0x55d510d05b10 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d091a0 con 0x55d510d05b10 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510d09d40 0x55d510d0c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d0c970 con 0x55d510d09d40 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff849961640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510d09d40 0x55d510d0c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff849961640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510d09d40 0x55d510d0c200 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.626+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d0d170 con 0x55d510d09d40 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:01.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84b645980 20 searching for the correct realm 2024-03-20T13:37:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d510d0f190 0x55d510d11650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849160640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d510d0f190 0x55d510d11650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849160640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d510d0f190 0x55d510d11650 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849961640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff844036020 0x7ff8440146b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x7ff844036020 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff844036020 0x7ff8440146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff844036020 0x7ff8440146b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.630+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x7ff844036020 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x7ff844036020 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.634+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x7ff844036020 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d05b10 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x7ff844036020 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x7ff844036020 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d0f190 2024-03-20T13:37:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.638+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d11d20 con 0x55d510d09d40 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:01.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d0e720 con 0x55d510d05b10 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d0d680 con 0x55d510d09d40 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d0df70 con 0x55d510d05b10 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 zone default found 2024-03-20T13:37:01.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 4 Realm: () 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 zonegroup default 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d12600 con 0x7ff844036020 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d147e0 con 0x55d510d0f190 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d14b40 con 0x55d510d0f190 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 started sync module instance, tier type = 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.642+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d13c20 con 0x55d510d09d40 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373598543872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d13c20 con 0x55d510d09d40 2024-03-20T13:37:01.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d153c0 con 0x55d510d05b10 2024-03-20T13:37:01.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373598547616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x55d510d05b10 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d165f0 con 0x55d510d09d40 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373598543872] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.646+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373598547616] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373598549872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d13780 con 0x55d510d09d40 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d16e70 con 0x7ff844036020 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373598554576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d17290 con 0x7ff844036020 2024-03-20T13:37:01.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d17cc0 con 0x55d510d09d40 2024-03-20T13:37:01.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373598549872] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.650+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373598554576] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373598558144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d16df0 con 0x55d510d09d40 2024-03-20T13:37:01.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d18510 con 0x55d510d0f190 2024-03-20T13:37:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373598560368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d16df0 con 0x55d510d0f190 2024-03-20T13:37:01.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d18f40 con 0x55d510d0f190 2024-03-20T13:37:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373598558144] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373598560368] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373598561424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d18aa0 con 0x55d510d0f190 2024-03-20T13:37:01.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d19790 con 0x7ff844036020 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373598561424] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373598552336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d18aa0 con 0x7ff844036020 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=0 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=1 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=2 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=3 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=4 2024-03-20T13:37:01.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=5 2024-03-20T13:37:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.654+0000 7ff84b645980 20 add_watcher() i=6 2024-03-20T13:37:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373598552336] v32'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 20 add_watcher() i=7 2024-03-20T13:37:01.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:01.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d1c850 con 0x55d510d05b10 2024-03-20T13:37:01.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373598565104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d19c90 con 0x55d510d05b10 2024-03-20T13:37:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373598565104] v32'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff6ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:01.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff84b645980 5 note: GC not initialized 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.658+0000 7ff6fe7e4640 20 reqs_thread_entry: start 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 Filter name: none 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff66ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d3e7e0 con 0x7ff844036020 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d40340 con 0x7ff844036020 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:01.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d41b40 con 0x55d510d09d40 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-03-20T13:37:01.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d45e70 con 0x7ff844036020 2024-03-20T13:37:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.662+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d4bcc0 con 0x55d510d09d40 2024-03-20T13:37:01.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94373598732272 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d46260 con 0x55d510d05b10 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== watch-notify(notify (1) cookie 94373598547616 notify 137438953473 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7ff83402b040 con 0x55d510d05b10 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff72cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94373598547616 notifier 4500 bl.length()=725 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff72cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff72cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff72cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:01.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff72cff9640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff70c003ea0 con 0x55d510d05b10 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(67 notify.1 [notify cookie 94373598732272 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== watch-notify(notify_complete (2) cookie 94373598732272 notify 137438953473 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d510b274c0 con 0x55d510d05b10 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_sources= new_sources= 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential sources added=[] removed=[] 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_dests= new_dests= 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential dests added=[] removed=[] 2024-03-20T13:37:01.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.666+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d41fd0 con 0x55d510d05b10 2024-03-20T13:37:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d4b560 con 0x7ff844036020 2024-03-20T13:37:01.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84b645980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84b645980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84b645980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94373598732240 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d4a9f0 con 0x55d510d0f190 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 94373598561424 notify 137438953475 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55d510cccb90 con 0x55d510d0f190 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff71bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94373598561424 notifier 4500 bl.length()=314 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff71bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff71bfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [notify cookie 94373598732240 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff71bfff640 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff67c003400 con 0x55d510d0f190 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== watch-notify(notify_complete (2) cookie 94373598732240 notify 137438953475 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d510ccc760 con 0x55d510d0f190 2024-03-20T13:37:01.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff6ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.670+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373598565104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d42b70 con 0x55d510d05b10 2024-03-20T13:37:01.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.674+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94373598565104] v32'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.674+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373598543872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d192f0 con 0x55d510d09d40 2024-03-20T13:37:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.674+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94373598543872] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.674+0000 7ff84b645980 20 remove_watcher() i=0 2024-03-20T13:37:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.674+0000 7ff84b645980 2 removed watcher, disabling cache 2024-03-20T13:37:01.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.674+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373598547616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x55d510d05b10 2024-03-20T13:37:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94373598547616] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x55d510d05b10 2024-03-20T13:37:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84b645980 20 remove_watcher() i=1 2024-03-20T13:37:01.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373598549872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x55d510d09d40 2024-03-20T13:37:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94373598549872] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84b645980 20 remove_watcher() i=2 2024-03-20T13:37:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373598554576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x7ff844036020 2024-03-20T13:37:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94373598554576] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84b645980 20 remove_watcher() i=3 2024-03-20T13:37:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.678+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373598558144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x55d510d09d40 2024-03-20T13:37:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff849961640 1 -- 172.21.15.123:0/3175865566 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94373598558144] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff844033070 con 0x55d510d09d40 2024-03-20T13:37:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff84b645980 20 remove_watcher() i=4 2024-03-20T13:37:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373598560368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x55d510d0f190 2024-03-20T13:37:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94373598560368] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff84b645980 20 remove_watcher() i=5 2024-03-20T13:37:01.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373598561424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x55d510d0f190 2024-03-20T13:37:01.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff849160640 1 -- 172.21.15.123:0/3175865566 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94373598561424] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff83c0cd070 con 0x55d510d0f190 2024-03-20T13:37:01.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff84b645980 20 remove_watcher() i=6 2024-03-20T13:37:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.682+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373598552336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d510d15c10 con 0x7ff844036020 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94373598552336] v32'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff834003460 con 0x7ff844036020 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 20 remove_watcher() i=7 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510d09d40 msgr2=0x55d510d0c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510d09d40 0x55d510d0c200 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510d05b10 msgr2=0x55d510d07fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510d05b10 0x55d510d07fd0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff844036020 msgr2=0x7ff8440146b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff844036020 0x7ff8440146b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d510d0f190 msgr2=0x55d510d11650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d510d0f190 0x55d510d11650 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff714034260 msgr2=0x7ff714036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff714034260 0x7ff714036720 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0cfff0 tx=0x7ff83c0e2000 comp rx=0 tx=0).stop 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 msgr2=0x55d510cfa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84895f640 1 -- 172.21.15.123:0/3175865566 reap_dead start 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cfa3b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff844020890 tx=0x7ff844048980 comp rx=0 tx=0).stop 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 shutdown_connections 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3175865566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510cf3540 0x55d510cfa3b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 >> 172.21.15.123:0/3175865566 conn(0x55d510cef880 msgr2=0x55d510cecee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 shutdown_connections 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3175865566 wait complete. 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7240342b0 msgr2=0x7ff724036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7240342b0 0x7ff724036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d510cd6be0 tx=0x7ff83c0e0040 comp rx=0 tx=0).stop 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 msgr2=0x55d510ce69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 0x55d510ce69c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff84400aae0 tx=0x7ff844008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 shutdown_connections 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7240342b0 0x7ff724036770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3989631459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510ce65a0 0x55d510ce69c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 >> 172.21.15.123:0/3989631459 conn(0x55d510cdb3b0 msgr2=0x55d510cdbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 shutdown_connections 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3989631459 wait complete. 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510cd3c50 msgr2=0x55d510cd6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510cd3c50 0x55d510cd6040 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510bda700 msgr2=0x55d510cd2ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510bda700 0x55d510cd2ea0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7300342b0 msgr2=0x7ff730036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7300342b0 0x7ff730036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8340012f0 tx=0x7ff834006700 comp rx=0 tx=0).stop 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 msgr2=0x55d510ccc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510ccc220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff83c018f70 tx=0x7ff83c0180e0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 shutdown_connections 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d510cd3c50 0x55d510cd6040 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d510bda700 0x55d510cd2ea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff7300342b0 0x7ff730036770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 --2- 172.21.15.123:0/3632841287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d510bd9de0 0x55d510ccc220 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 >> 172.21.15.123:0/3632841287 conn(0x55d510bd56b0 msgr2=0x55d510cbfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 shutdown_connections 2024-03-20T13:37:01.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.686+0000 7ff84b645980 1 -- 172.21.15.123:0/3632841287 wait complete. 2024-03-20T13:37:01.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-03-20T13:37:01.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-03-20T13:37:01.701 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-03-20T13:37:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe5b496980 1 Processor -- start 2024-03-20T13:37:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe5b496980 1 -- start start 2024-03-20T13:37:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe5b496980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ccee4dde40 0x55ccee4de220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe5b496980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ccee42b520 con 0x55ccee4de760 2024-03-20T13:37:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe5b496980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ccee3f20f0 con 0x55ccee4dde40 2024-03-20T13:37:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe58fb1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ccee4dde40 0x55ccee4de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe58fb1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ccee4dde40 0x55ccee4de220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54932/0 (socket says 172.21.15.123:54932) 2024-03-20T13:37:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe58fb1640 1 -- 172.21.15.123:0/1562874192 learned_addr learned my addr 172.21.15.123:0/1562874192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe58fb1640 1 -- 172.21.15.123:0/1562874192 >> v1:172.21.15.89:6789/0 conn(0x55ccee4de760 legacy=0x55ccee4df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.770+0000 7fbe58fb1640 1 -- 172.21.15.123:0/1562874192 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccee4df950 con 0x55ccee4dde40 2024-03-20T13:37:01.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/1562874192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee4de220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000a4e0 tx=0x7fbe5001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d089019fe372bea5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe57faf640 1 -- 172.21.15.123:0/1562874192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe500aa540 con 0x55ccee4dde40 2024-03-20T13:37:01.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe57faf640 1 -- 172.21.15.123:0/1562874192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe500a6070 con 0x55ccee4dde40 2024-03-20T13:37:01.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe57faf640 1 -- 172.21.15.123:0/1562874192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe500aa850 con 0x55ccee4dde40 2024-03-20T13:37:01.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 -- 172.21.15.123:0/1562874192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 msgr2=0x55ccee4de220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1562874192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee4de220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000a4e0 tx=0x7fbe5001b090 comp rx=0 tx=0).stop 2024-03-20T13:37:01.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 -- 172.21.15.123:0/1562874192 shutdown_connections 2024-03-20T13:37:01.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1562874192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee4de220 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 -- 172.21.15.123:0/1562874192 >> 172.21.15.123:0/1562874192 conn(0x55ccee4d9710 msgr2=0x55ccee4dbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 -- 172.21.15.123:0/1562874192 shutdown_connections 2024-03-20T13:37:01.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.774+0000 7fbe5b496980 1 -- 172.21.15.123:0/1562874192 wait complete. 2024-03-20T13:37:01.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe5b496980 1 Processor -- start 2024-03-20T13:37:01.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe5b496980 1 -- start start 2024-03-20T13:37:01.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe5b496980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee453010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe5b496980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccee3ef620 con 0x55ccee4dde40 2024-03-20T13:37:01.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe58fb1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee453010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe58fb1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee453010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54944/0 (socket says 172.21.15.123:54944) 2024-03-20T13:37:01.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.786+0000 7fbe58fb1640 1 -- 172.21.15.123:0/1231781668 learned_addr learned my addr 172.21.15.123:0/1231781668 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 -- 172.21.15.123:0/1231781668 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5000a1c0 con 0x55ccee4dde40 2024-03-20T13:37:01.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/1231781668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee453010 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbe50017ca0 tx=0x7fbe500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f6ee18dd3b0e4b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbd46e0d640 1 -- 172.21.15.123:0/1231781668 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe500aa780 con 0x55ccee4dde40 2024-03-20T13:37:01.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbd46e0d640 1 -- 172.21.15.123:0/1231781668 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe500aa8e0 con 0x55ccee4dde40 2024-03-20T13:37:01.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbd46e0d640 1 -- 172.21.15.123:0/1231781668 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe500aab80 con 0x55ccee4dde40 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- 172.21.15.123:0/1231781668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 msgr2=0x55ccee453010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1231781668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee453010 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbe50017ca0 tx=0x7fbe500033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- 172.21.15.123:0/1231781668 shutdown_connections 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1231781668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee453010 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- 172.21.15.123:0/1231781668 >> 172.21.15.123:0/1231781668 conn(0x55ccee4d9710 msgr2=0x55ccee5c3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- 172.21.15.123:0/1231781668 shutdown_connections 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- 172.21.15.123:0/1231781668 wait complete. 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 Processor -- start 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- start start 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee5d0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccee3eae00 con 0x55ccee4dde40 2024-03-20T13:37:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee5d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee5d0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54952/0 (socket says 172.21.15.123:54952) 2024-03-20T13:37:01.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 -- 172.21.15.123:0/3365154623 learned_addr learned my addr 172.21.15.123:0/3365154623 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccee4df950 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee5d0110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbe5001aec0 tx=0x7fbe50017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbd4560a640 1 -- 172.21.15.123:0/3365154623 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe500c4070 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.790+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccee5d0650 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbd4560a640 1 -- 172.21.15.123:0/3365154623 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe500b5650 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbd4560a640 1 -- 172.21.15.123:0/3365154623 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe500b58f0 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccee5d0a80 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbd4560a640 1 -- 172.21.15.123:0/3365154623 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe500a8070 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbd4560a640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd400342b0 0x7fbd40036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbd4560a640 1 -- 172.21.15.123:0/3365154623 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbe500e3720 con 0x55ccee4dde40 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe587b0640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd400342b0 0x7fbd40036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee4de760 0x55ccee5d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee5d7280 con 0x55ccee4de760 2024-03-20T13:37:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe597b2640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee4de760 0x55ccee5d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe587b0640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd400342b0 0x7fbd40036770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c000f70 tx=0x7fbe4c001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe597b2640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee4de760 0x55ccee5d6d40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe597b2640 1 -- 172.21.15.123:0/3365154623 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe480083f0 con 0x55ccee4de760 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee5d7af0 0x55ccee5d9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee5da5c0 con 0x55ccee5d7af0 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee5d7af0 0x55ccee5d9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee5d7af0 0x55ccee5d9ee0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe58fb1640 1 -- 172.21.15.123:0/3365154623 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee5d7af0 2024-03-20T13:37:01.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.794+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee5dbe20 con 0x55ccee5d7af0 2024-03-20T13:37:01.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe58fb1640 1 -- 172.21.15.123:0/3365154623 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee5d7af0 2024-03-20T13:37:01.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee5db020 con 0x55ccee5d7af0 2024-03-20T13:37:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe58fb1640 1 -- 172.21.15.123:0/3365154623 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee5d7af0 2024-03-20T13:37:01.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee5db430 con 0x55ccee4de760 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe597b2640 1 -- 172.21.15.123:0/3365154623 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbe480083f0 con 0x55ccee4de760 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe5b496980 1 Processor -- start 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe5b496980 1 -- start start 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe5b496980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 0x55ccee5c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe5b496980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccee383e30 con 0x55ccee5c9d00 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe597b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 0x55ccee5c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe597b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 0x55ccee5c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54962/0 (socket says 172.21.15.123:54962) 2024-03-20T13:37:01.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe597b2640 1 -- 172.21.15.123:0/1223090860 learned_addr learned my addr 172.21.15.123:0/1223090860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe597b2640 1 -- 172.21.15.123:0/1223090860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccee5c86e0 con 0x55ccee5c9d00 2024-03-20T13:37:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.798+0000 7fbe597b2640 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 0x55ccee5c81a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800aae0 tx=0x7fbe48008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd3e7fc640 1 -- 172.21.15.123:0/1223090860 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe4801d070 con 0x55ccee5c9d00 2024-03-20T13:37:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd3e7fc640 1 -- 172.21.15.123:0/1223090860 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48010040 con 0x55ccee5c9d00 2024-03-20T13:37:01.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccee5c8990 con 0x55ccee5c9d00 2024-03-20T13:37:01.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd3e7fc640 1 -- 172.21.15.123:0/1223090860 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe48007e70 con 0x55ccee5c9d00 2024-03-20T13:37:01.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccee5c8e20 con 0x55ccee5c9d00 2024-03-20T13:37:01.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd3e7fc640 1 -- 172.21.15.123:0/1223090860 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe48018430 con 0x55ccee5c9d00 2024-03-20T13:37:01.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd3e7fc640 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd300342b0 0x7fbd30036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd3e7fc640 1 -- 172.21.15.123:0/1223090860 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbe4804a8b0 con 0x55ccee5c9d00 2024-03-20T13:37:01.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd300342b0 0x7fbd30036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 Processor -- start 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- start start 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd300342b0 0x7fbd30036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55ccee5dab20 tx=0x7fbe500bd530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee5f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccee377790 con 0x55ccee5f9820 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe597b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee5f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe597b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee5f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54966/0 (socket says 172.21.15.123:54966) 2024-03-20T13:37:01.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe597b2640 1 -- 172.21.15.123:0/2265301105 learned_addr learned my addr 172.21.15.123:0/2265301105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe597b2640 1 -- 172.21.15.123:0/2265301105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccee5fa210 con 0x55ccee5f9820 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe597b2640 1 --2- 172.21.15.123:0/2265301105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee5f9c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe48048be0 tx=0x7fbe48048de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e72e28df74aad3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd2ffff640 1 -- 172.21.15.123:0/2265301105 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe48047070 con 0x55ccee5f9820 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd2ffff640 1 -- 172.21.15.123:0/2265301105 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48021c50 con 0x55ccee5f9820 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbd2ffff640 1 -- 172.21.15.123:0/2265301105 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe48021de0 con 0x55ccee5f9820 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/2265301105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 msgr2=0x55ccee5f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 --2- 172.21.15.123:0/2265301105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee5f9c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe48048be0 tx=0x7fbe48048de0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/2265301105 shutdown_connections 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 --2- 172.21.15.123:0/2265301105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee5f9c40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/2265301105 >> 172.21.15.123:0/2265301105 conn(0x55ccee5f5b60 msgr2=0x55ccee5f3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/2265301105 shutdown_connections 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.802+0000 7fbe5b496980 1 -- 172.21.15.123:0/2265301105 wait complete. 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 Processor -- start 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- start start 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee600680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccee600bc0 con 0x55ccee5f9820 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe597b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee600680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe597b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee600680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54970/0 (socket says 172.21.15.123:54970) 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 learned_addr learned my addr 172.21.15.123:0/4248173548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccee5c8e20 con 0x55ccee5f9820 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe597b2640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee600680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbe48048be0 tx=0x7fbe48048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbd2e7fc640 1 -- 172.21.15.123:0/4248173548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe4803ae90 con 0x55ccee5f9820 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccee600dc0 con 0x55ccee5f9820 2024-03-20T13:37:01.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbd2e7fc640 1 -- 172.21.15.123:0/4248173548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48020900 con 0x55ccee5f9820 2024-03-20T13:37:01.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccee601250 con 0x55ccee5f9820 2024-03-20T13:37:01.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbd2e7fc640 1 -- 172.21.15.123:0/4248173548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe4804acc0 con 0x55ccee5f9820 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbd2e7fc640 1 -- 172.21.15.123:0/4248173548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe48017ac0 con 0x55ccee5f9820 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbd2e7fc640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd240342b0 0x7fbd24036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbd2e7fc640 1 -- 172.21.15.123:0/4248173548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbe48036c60 con 0x55ccee5f9820 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd240342b0 0x7fbd24036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee60bdd0 0x55ccee60e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee60e9e0 con 0x55ccee60bdd0 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe587b0640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee60bdd0 0x55ccee60e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd240342b0 0x7fbd24036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe500033d0 tx=0x7fbe500b4c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe587b0640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee60bdd0 0x55ccee60e290 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 20 realm 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee60b280 con 0x55ccee60bdd0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.806+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee60f460 con 0x55ccee60bdd0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee6101f0 0x55ccee6125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee612cc0 con 0x55ccee6101f0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe597b2640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee6101f0 0x55ccee6125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe597b2640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee6101f0 0x55ccee6125e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee6134c0 con 0x55ccee6101f0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 20 searching for the correct realm 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ccee615500 0x55ccee6179c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ccee615500 0x55ccee6179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe58fb1640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ccee615500 0x55ccee6179c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.810+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fbe48035020 0x7fbe48047290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x7fbe48035020 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fbe48035020 0x7fbe48047290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fbe48035020 0x7fbe48047290 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x7fbe48035020 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x7fbe48035020 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x7fbe48035020 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x7fbe48035020 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x7fbe48035020 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.814+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c00bdd0 con 0x55ccee60bdd0 2024-03-20T13:37:01.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x7fbe48035020 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee60bdd0 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x7fbe48035020 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.818+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x7fbe48035020 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee615500 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee618090 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:01.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee614ab0 con 0x55ccee60bdd0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.822+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee613a00 con 0x55ccee6101f0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee6139d0 con 0x55ccee60bdd0 2024-03-20T13:37:01.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:01.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 zone default found 2024-03-20T13:37:01.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 4 Realm: () 2024-03-20T13:37:01.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 zonegroup default 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee614520 con 0x7fbe48035020 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61a4d0 con 0x55ccee615500 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61a930 con 0x55ccee615500 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 started sync module instance, tier type = 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61a100 con 0x55ccee6101f0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338661061456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61ad50 con 0x55ccee6101f0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.826+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61b550 con 0x55ccee60bdd0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338661068112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61b7f0 con 0x55ccee60bdd0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61c2c0 con 0x55ccee6101f0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338661061456] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338661068112] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338661072288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61c280 con 0x55ccee6101f0 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.830+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61b3c0 con 0x7fbe48035020 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338661074544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61d000 con 0x7fbe48035020 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61d9b0 con 0x55ccee6101f0 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338661072288] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338661074544] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338661062720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61cb60 con 0x55ccee6101f0 2024-03-20T13:37:01.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61e200 con 0x55ccee615500 2024-03-20T13:37:01.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338661080416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61cb60 con 0x55ccee615500 2024-03-20T13:37:01.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61ec30 con 0x55ccee615500 2024-03-20T13:37:01.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.834+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338661062720] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338661080416] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338661081472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61e790 con 0x55ccee615500 2024-03-20T13:37:01.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61f480 con 0x7fbe48035020 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338661085152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61f8a0 con 0x7fbe48035020 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=0 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=1 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=2 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=3 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=4 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=5 2024-03-20T13:37:01.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338661081472] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=6 2024-03-20T13:37:01.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338661085152] v32'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 20 add_watcher() i=7 2024-03-20T13:37:01.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:01.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee6228d0 con 0x55ccee60bdd0 2024-03-20T13:37:01.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.838+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338661086208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61fcc0 con 0x55ccee60bdd0 2024-03-20T13:37:01.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338661086208] v32'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbd0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbe5b496980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:01.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbe5b496980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:01.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62ab50 con 0x55ccee6101f0 2024-03-20T13:37:01.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.842+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62abb0 con 0x7fbe48035020 2024-03-20T13:37:01.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.846+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.846+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62b090 con 0x55ccee615500 2024-03-20T13:37:01.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.846+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.846+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62b5c0 con 0x55ccee60bdd0 2024-03-20T13:37:01.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.850+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.850+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62baf0 con 0x55ccee6101f0 2024-03-20T13:37:01.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.850+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.850+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62c020 con 0x55ccee615500 2024-03-20T13:37:01.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.850+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.850+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62c550 con 0x55ccee6101f0 2024-03-20T13:37:01.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.854+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.854+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62ca80 con 0x55ccee60bdd0 2024-03-20T13:37:01.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.854+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.854+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62cfb0 con 0x55ccee6101f0 2024-03-20T13:37:01.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.858+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.858+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62cfb0 con 0x55ccee6101f0 2024-03-20T13:37:01.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.862+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.862+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62cfb0 con 0x55ccee6101f0 2024-03-20T13:37:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.862+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'34 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.862+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62cfb0 con 0x55ccee615500 2024-03-20T13:37:01.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.862+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.862+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62cfb0 con 0x55ccee6101f0 2024-03-20T13:37:01.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.866+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.866+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62cfb0 con 0x55ccee60bdd0 2024-03-20T13:37:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.866+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.866+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62d250 con 0x55ccee60bdd0 2024-03-20T13:37:01.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.870+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.870+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee62d250 con 0x55ccee6101f0 2024-03-20T13:37:01.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.870+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.870+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628b90 con 0x55ccee6101f0 2024-03-20T13:37:01.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.874+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'35 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.874+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628b90 con 0x55ccee615500 2024-03-20T13:37:01.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.878+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.878+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628b90 con 0x55ccee6101f0 2024-03-20T13:37:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.878+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.878+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee60bdd0 2024-03-20T13:37:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.882+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.882+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee6101f0 2024-03-20T13:37:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.882+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.882+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee6101f0 2024-03-20T13:37:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.886+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.886+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee615500 2024-03-20T13:37:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.886+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.886+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee6101f0 2024-03-20T13:37:01.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.890+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.890+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee615500 2024-03-20T13:37:01.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.890+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.890+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee615500 2024-03-20T13:37:01.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.894+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.894+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee615500 2024-03-20T13:37:01.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.894+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.894+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee6101f0 2024-03-20T13:37:01.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.898+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.898+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee60bdd0 2024-03-20T13:37:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.902+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.902+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee6101f0 2024-03-20T13:37:01.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.902+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.902+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x55ccee60bdd0 2024-03-20T13:37:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee628d60 con 0x7fbe48035020 2024-03-20T13:37:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbd0dfe3640 20 reqs_thread_entry: start 2024-03-20T13:37:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 20 Filter name: none 2024-03-20T13:37:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbc7f7fe640 20 reqs_thread_entry: start 2024-03-20T13:37:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:37:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 20 rados->read ofs=0 len=0 2024-03-20T13:37:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee627ee0 con 0x7fbe48035020 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.906+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee627eb0 con 0x55ccee60bdd0 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.910+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.915 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-03-20T13:37:01.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.910+0000 7fbd0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:01.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.910+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338661086208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee6244e0 con 0x55ccee60bdd0 2024-03-20T13:37:01.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.910+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94338661086208] v32'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.910+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338661061456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee6244e0 con 0x55ccee6101f0 2024-03-20T13:37:01.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94338661061456] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe5b496980 20 remove_watcher() i=0 2024-03-20T13:37:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe5b496980 2 removed watcher, disabling cache 2024-03-20T13:37:01.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338661068112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee619350 con 0x55ccee60bdd0 2024-03-20T13:37:01.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94338661068112] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x55ccee60bdd0 2024-03-20T13:37:01.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe5b496980 20 remove_watcher() i=1 2024-03-20T13:37:01.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.914+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338661072288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee619350 con 0x55ccee6101f0 2024-03-20T13:37:01.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.918+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94338661072288] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.918+0000 7fbe5b496980 20 remove_watcher() i=2 2024-03-20T13:37:01.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.918+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338661074544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee619350 con 0x7fbe48035020 2024-03-20T13:37:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.922+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94338661074544] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.922+0000 7fbe5b496980 20 remove_watcher() i=3 2024-03-20T13:37:01.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.922+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338661062720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee619350 con 0x55ccee6101f0 2024-03-20T13:37:01.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe597b2640 1 -- 172.21.15.123:0/4248173548 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94338661062720] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe48040070 con 0x55ccee6101f0 2024-03-20T13:37:01.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 20 remove_watcher() i=4 2024-03-20T13:37:01.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338661080416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee619350 con 0x55ccee615500 2024-03-20T13:37:01.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94338661080416] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 20 remove_watcher() i=5 2024-03-20T13:37:01.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338661081472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee61dd60 con 0x55ccee615500 2024-03-20T13:37:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe58fb1640 1 -- 172.21.15.123:0/4248173548 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94338661081472] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe500a9ce0 con 0x55ccee615500 2024-03-20T13:37:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 20 remove_watcher() i=6 2024-03-20T13:37:01.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338661085152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccee619350 con 0x7fbe48035020 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94338661085152] v32'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe4c028040 con 0x7fbe48035020 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.926+0000 7fbe5b496980 20 remove_watcher() i=7 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee6101f0 msgr2=0x55ccee6125e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee6101f0 0x55ccee6125e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee60bdd0 msgr2=0x55ccee60e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee60bdd0 0x55ccee60e290 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fbe48035020 msgr2=0x7fbe48047290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fbe48035020 0x7fbe48047290 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ccee615500 msgr2=0x55ccee6179c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ccee615500 0x55ccee6179c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd240342b0 msgr2=0x7fbd24036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd240342b0 0x7fbd24036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe500033d0 tx=0x7fbe500b4c10 comp rx=0 tx=0).stop 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 msgr2=0x55ccee600680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/4248173548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5f9820 0x55ccee600680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbe48048be0 tx=0x7fbe48048b70 comp rx=0 tx=0).stop 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe587b0640 1 -- 172.21.15.123:0/4248173548 reap_dead start 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 shutdown_connections 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 >> 172.21.15.123:0/4248173548 conn(0x55ccee5f5b60 msgr2=0x55ccee5f31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 shutdown_connections 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/4248173548 wait complete. 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd300342b0 msgr2=0x7fbd30036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd300342b0 0x7fbd30036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55ccee5dab20 tx=0x7fbe500bd530 comp rx=0 tx=0).stop 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 msgr2=0x55ccee5c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 0x55ccee5c81a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800aae0 tx=0x7fbe48008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 shutdown_connections 2024-03-20T13:37:01.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd300342b0 0x7fbd30036770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/1223090860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee5c9d00 0x55ccee5c81a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 >> 172.21.15.123:0/1223090860 conn(0x55ccee5df310 msgr2=0x55ccee5dfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 shutdown_connections 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/1223090860 wait complete. 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee5d7af0 msgr2=0x55ccee5d9ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee5d7af0 0x55ccee5d9ee0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee4de760 msgr2=0x55ccee5d6d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee4de760 0x55ccee5d6d40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd400342b0 msgr2=0x7fbd40036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd400342b0 0x7fbd40036770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c000f70 tx=0x7fbe4c001420 comp rx=0 tx=0).stop 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 msgr2=0x55ccee5d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee5d0110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbe5001aec0 tx=0x7fbe50017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 shutdown_connections 2024-03-20T13:37:01.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ccee5d7af0 0x55ccee5d9ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ccee4de760 0x55ccee5d6d40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbd400342b0 0x7fbd40036770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 --2- 172.21.15.123:0/3365154623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ccee4dde40 0x55ccee5d0110 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:01.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 >> 172.21.15.123:0/3365154623 conn(0x55ccee4d9710 msgr2=0x55ccee5c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:01.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 shutdown_connections 2024-03-20T13:37:01.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:01.930+0000 7fbe5b496980 1 -- 172.21.15.123:0/3365154623 wait complete. 2024-03-20T13:37:01.945 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:37:01.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-03-20T13:37:01.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-03-20T13:37:01.945 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-03-20T13:37:02.021 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:02.021 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:02.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.014+0000 7ff7c3786980 1 Processor -- start 2024-03-20T13:37:02.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.014+0000 7ff7c3786980 1 -- start start 2024-03-20T13:37:02.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.014+0000 7ff7c3786980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5605dc76c320 0x5605dc76e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c3786980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5605dc6b44c0 con 0x5605dc6dc080 2024-03-20T13:37:02.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c3786980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5605dc67b0f0 con 0x5605dc76c320 2024-03-20T13:37:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c0aa0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5605dc76c320 0x5605dc76e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c0aa0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5605dc76c320 0x5605dc76e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54978/0 (socket says 172.21.15.123:54978) 2024-03-20T13:37:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/4236522637 learned_addr learned my addr 172.21.15.123:0/4236522637 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c12a1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5605dc6dc080 0x5605dc76ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59200/0 (socket says 172.21.15.123:59200) 2024-03-20T13:37:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/4236522637 >> v1:172.21.15.89:6789/0 conn(0x5605dc6dc080 legacy=0x5605dc76ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/4236522637 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605dc76fcf0 con 0x5605dc76c320 2024-03-20T13:37:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/4236522637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc76c320 0x5605dc76e710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800a5c0 tx=0x7ff7b801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272727f75ac59ddb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7b3fff640 1 -- 172.21.15.123:0/4236522637 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b80aa470 con 0x5605dc76c320 2024-03-20T13:37:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7b3fff640 1 -- 172.21.15.123:0/4236522637 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b80aa5d0 con 0x5605dc76c320 2024-03-20T13:37:02.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.018+0000 7ff7b3fff640 1 -- 172.21.15.123:0/4236522637 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b80aa890 con 0x5605dc76c320 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 -- 172.21.15.123:0/4236522637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc76c320 msgr2=0x5605dc76e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 --2- 172.21.15.123:0/4236522637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc76c320 0x5605dc76e710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800a5c0 tx=0x7ff7b801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 -- 172.21.15.123:0/4236522637 shutdown_connections 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 --2- 172.21.15.123:0/4236522637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc76c320 0x5605dc76e710 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 -- 172.21.15.123:0/4236522637 >> 172.21.15.123:0/4236522637 conn(0x5605dc7626e0 msgr2=0x5605dc764b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 -- 172.21.15.123:0/4236522637 shutdown_connections 2024-03-20T13:37:02.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.022+0000 7ff7c3786980 1 -- 172.21.15.123:0/4236522637 wait complete. 2024-03-20T13:37:02.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c3786980 1 Processor -- start 2024-03-20T13:37:02.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c3786980 1 -- start start 2024-03-20T13:37:02.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c3786980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc768360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c3786980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605dc678620 con 0x5605dc6dc080 2024-03-20T13:37:02.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c12a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc768360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c12a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc768360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54984/0 (socket says 172.21.15.123:54984) 2024-03-20T13:37:02.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c12a1640 1 -- 172.21.15.123:0/1477830805 learned_addr learned my addr 172.21.15.123:0/1477830805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c12a1640 1 -- 172.21.15.123:0/1477830805 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8005df0 con 0x5605dc6dc080 2024-03-20T13:37:02.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/1477830805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc768360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc006fb0 tx=0x7ff7bc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3ecaca61ef9f01 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff6af606640 1 -- 172.21.15.123:0/1477830805 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc013420 con 0x5605dc6dc080 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff6af606640 1 -- 172.21.15.123:0/1477830805 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc013580 con 0x5605dc6dc080 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.034+0000 7ff6af606640 1 -- 172.21.15.123:0/1477830805 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc013860 con 0x5605dc6dc080 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/1477830805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 msgr2=0x5605dc768360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 --2- 172.21.15.123:0/1477830805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc768360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc006fb0 tx=0x7ff7bc001940 comp rx=0 tx=0).stop 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/1477830805 shutdown_connections 2024-03-20T13:37:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 --2- 172.21.15.123:0/1477830805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc768360 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/1477830805 >> 172.21.15.123:0/1477830805 conn(0x5605dc7626e0 msgr2=0x5605dc84da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/1477830805 shutdown_connections 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/1477830805 wait complete. 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 Processor -- start 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- start start 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc85afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605dc673e00 con 0x5605dc6dc080 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c12a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc85afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c12a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc85afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:54996/0 (socket says 172.21.15.123:54996) 2024-03-20T13:37:02.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c12a1640 1 -- 172.21.15.123:0/2159761038 learned_addr learned my addr 172.21.15.123:0/2159761038 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c12a1640 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605dc6b44c0 con 0x5605dc6dc080 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc85afc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5605dc767b90 tx=0x7ff7bc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff6ade03640 1 -- 172.21.15.123:0/2159761038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc0037a0 con 0x5605dc6dc080 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605dc85b500 con 0x5605dc6dc080 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff6ade03640 1 -- 172.21.15.123:0/2159761038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc003900 con 0x5605dc6dc080 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605dc85b930 con 0x5605dc6dc080 2024-03-20T13:37:02.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff6ade03640 1 -- 172.21.15.123:0/2159761038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc003ba0 con 0x5605dc6dc080 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff6ade03640 1 -- 172.21.15.123:0/2159761038 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff7bc003d00 con 0x5605dc6dc080 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff6ade03640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6a80342b0 0x7ff6a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff6ade03640 1 -- 172.21.15.123:0/2159761038 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff7bc049630 con 0x5605dc6dc080 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.038+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6a80342b0 0x7ff6a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc76c320 0x5605dc861c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc862180 con 0x5605dc76c320 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc76c320 0x5605dc861c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6a80342b0 0x7ff6a8036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80ae000 tx=0x7ff7b80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc76c320 0x5605dc861c40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/2159761038 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7b40083f0 con 0x5605dc76c320 2024-03-20T13:37:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc8629f0 0x5605dc864de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8654e0 con 0x5605dc8629f0 2024-03-20T13:37:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc8629f0 0x5605dc864de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc8629f0 0x5605dc864de0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c12a1640 1 -- 172.21.15.123:0/2159761038 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc8629f0 2024-03-20T13:37:02.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc866d20 con 0x5605dc8629f0 2024-03-20T13:37:02.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c12a1640 1 -- 172.21.15.123:0/2159761038 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc8629f0 2024-03-20T13:37:02.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc865e30 con 0x5605dc8629f0 2024-03-20T13:37:02.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c12a1640 1 -- 172.21.15.123:0/2159761038 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc8629f0 2024-03-20T13:37:02.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.042+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc866240 con 0x5605dc76c320 2024-03-20T13:37:02.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/2159761038 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff7b40083f0 con 0x5605dc76c320 2024-03-20T13:37:02.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 Processor -- start 2024-03-20T13:37:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 -- start start 2024-03-20T13:37:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 0x5605dc875760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605dc60ce30 con 0x5605dc875340 2024-03-20T13:37:02.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c1aa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 0x5605dc875760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c1aa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 0x5605dc875760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55012/0 (socket says 172.21.15.123:55012) 2024-03-20T13:37:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/3014626573 learned_addr learned my addr 172.21.15.123:0/3014626573 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/3014626573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605dc875ca0 con 0x5605dc875340 2024-03-20T13:37:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 0x5605dc875760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400aae0 tx=0x7ff7b4008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff6a6ffd640 1 -- 172.21.15.123:0/3014626573 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b401d070 con 0x5605dc875340 2024-03-20T13:37:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605dc875ef0 con 0x5605dc875340 2024-03-20T13:37:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff6a6ffd640 1 -- 172.21.15.123:0/3014626573 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4010040 con 0x5605dc875340 2024-03-20T13:37:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff6a6ffd640 1 -- 172.21.15.123:0/3014626573 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b4007e70 con 0x5605dc875340 2024-03-20T13:37:02.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605dc876a40 con 0x5605dc875340 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff6a6ffd640 1 -- 172.21.15.123:0/3014626573 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff7b4018430 con 0x5605dc875340 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff6a6ffd640 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6980342b0 0x7ff698036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff6a6ffd640 1 -- 172.21.15.123:0/3014626573 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff7b404a6c0 con 0x5605dc875340 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6980342b0 0x7ff698036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.046+0000 7ff7c3786980 1 Processor -- start 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- start start 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6980342b0 0x7ff698036770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5605dc865930 tx=0x7ff7bc0123c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc8826e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605dc600790 con 0x5605dc8822c0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc8826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc8826e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55020/0 (socket says 172.21.15.123:55020) 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/1026847678 learned_addr learned my addr 172.21.15.123:0/1026847678 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/1026847678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605dc882cb0 con 0x5605dc8822c0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/1026847678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc8826e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4048a30 tx=0x7ff7b4048c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ee697af6e725f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff6a4ff9640 1 -- 172.21.15.123:0/1026847678 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b4047070 con 0x5605dc8822c0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff6a4ff9640 1 -- 172.21.15.123:0/1026847678 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4039230 con 0x5605dc8822c0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff6a4ff9640 1 -- 172.21.15.123:0/1026847678 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40393a0 con 0x5605dc8822c0 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/1026847678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 msgr2=0x5605dc8826e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 --2- 172.21.15.123:0/1026847678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc8826e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4048a30 tx=0x7ff7b4048c30 comp rx=0 tx=0).stop 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/1026847678 shutdown_connections 2024-03-20T13:37:02.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 --2- 172.21.15.123:0/1026847678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc8826e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/1026847678 >> 172.21.15.123:0/1026847678 conn(0x5605dc87e600 msgr2=0x5605dc87c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/1026847678 shutdown_connections 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/1026847678 wait complete. 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 Processor -- start 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- start start 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc889180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605dc8896c0 con 0x5605dc8822c0 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc889180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc889180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55026/0 (socket says 172.21.15.123:55026) 2024-03-20T13:37:02.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 learned_addr learned my addr 172.21.15.123:0/148608215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605dc876a40 con 0x5605dc8822c0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc889180 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4020ac0 tx=0x7ff7b40489c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff696ffd640 1 -- 172.21.15.123:0/148608215 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b4021a30 con 0x5605dc8822c0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605dc8898c0 con 0x5605dc8822c0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff696ffd640 1 -- 172.21.15.123:0/148608215 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4021b90 con 0x5605dc8822c0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff696ffd640 1 -- 172.21.15.123:0/148608215 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7b4021d00 con 0x5605dc8822c0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.050+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605dc889d50 con 0x5605dc8822c0 2024-03-20T13:37:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff696ffd640 1 -- 172.21.15.123:0/148608215 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff7b404a9a0 con 0x5605dc8822c0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff696ffd640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff68c0342b0 0x7ff68c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff696ffd640 1 -- 172.21.15.123:0/148608215 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff7b4037ca0 con 0x5605dc8822c0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff68c0342b0 0x7ff68c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc8948e0 0x5605dc896da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8974f0 con 0x5605dc8948e0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc8948e0 0x5605dc896da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff68c0342b0 0x7ff68c036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc049960 tx=0x7ff7bc034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc8948e0 0x5605dc896da0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 realm 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8978e0 con 0x5605dc8948e0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc898160 con 0x5605dc8948e0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc898b40 0x5605dc89af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc89b6e0 con 0x5605dc898b40 2024-03-20T13:37:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc898b40 0x5605dc89af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.054+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc898b40 0x5605dc89af70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc89bee0 con 0x5605dc898b40 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 20 searching for the correct realm 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5605dc89dee0 0x5605dc8a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5605dc89dee0 0x5605dc8a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c12a1640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5605dc89dee0 0x5605dc8a03a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c1aa2640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff7b4036020 0x7ff7b4017710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x7ff7b4036020 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff7b4036020 0x7ff7b4017710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff7b4036020 0x7ff7b4017710 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x7ff7b4036020 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.058+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x7ff7b4036020 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x7ff7b4036020 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x7ff7b4036020 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff7b80b0020 con 0x7ff7b4036020 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.062+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80b0020 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x7ff7b4036020 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc8948e0 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x7ff7b4036020 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x7ff7b4036020 2024-03-20T13:37:02.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.066+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc89dee0 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a0a70 con 0x5605dc898b40 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc89d440 con 0x5605dc8948e0 2024-03-20T13:37:02.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc89c3c0 con 0x5605dc898b40 2024-03-20T13:37:02.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc89ccd0 con 0x5605dc8948e0 2024-03-20T13:37:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:02.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 zone default found 2024-03-20T13:37:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 4 Realm: () 2024-03-20T13:37:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 zonegroup default 2024-03-20T13:37:02.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a1350 con 0x7ff7b4036020 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a3530 con 0x5605dc89dee0 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a3890 con 0x5605dc89dee0 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 started sync module instance, tier type = 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:02.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.070+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a2b00 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583174868656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a2b00 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a4200 con 0x5605dc8948e0 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583174872416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a4620 con 0x5605dc8948e0 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a50c0 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583174868656] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.074+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583174872416] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.078+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.078+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583174876064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a4180 con 0x5605dc898b40 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.078+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a5910 con 0x7ff7b4036020 2024-03-20T13:37:02.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.082+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.082+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583174878320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a4180 con 0x7ff7b4036020 2024-03-20T13:37:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.082+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a63e0 con 0x5605dc898b40 2024-03-20T13:37:02.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.082+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583174876064] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583174878320] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583174866528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a5f00 con 0x5605dc898b40 2024-03-20T13:37:02.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a6870 con 0x5605dc89dee0 2024-03-20T13:37:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583174882256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a7070 con 0x5605dc89dee0 2024-03-20T13:37:02.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.086+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a79e0 con 0x5605dc89dee0 2024-03-20T13:37:02.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.090+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583174866528] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.090+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.090+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583174886720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a7960 con 0x5605dc89dee0 2024-03-20T13:37:02.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.090+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a8710 con 0x7ff7b4036020 2024-03-20T13:37:02.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.090+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583174882256] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.090+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583174886720] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583174884304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a8230 con 0x7ff7b4036020 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=0 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=1 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=2 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=3 2024-03-20T13:37:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=4 2024-03-20T13:37:02.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=5 2024-03-20T13:37:02.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=6 2024-03-20T13:37:02.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583174884304] v32'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 add_watcher() i=7 2024-03-20T13:37:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a8230 con 0x5605dc8948e0 2024-03-20T13:37:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583174888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a8f10 con 0x5605dc8948e0 2024-03-20T13:37:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583174888848] v32'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff6777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 5 note: GC not initialized 2024-03-20T13:37:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff6767e4640 20 reqs_thread_entry: start 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.094+0000 7ff7c3786980 20 Filter name: none 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff5e7fff640 20 reqs_thread_entry: start 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8cd630 con 0x7ff7b4036020 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:02.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8cf190 con 0x7ff7b4036020 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8d09c0 con 0x5605dc898b40 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-03-20T13:37:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8d3eb0 con 0x5605dc8948e0 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8d2ec0 con 0x7ff7b4036020 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.098+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8d78e0 con 0x7ff7b4036020 2024-03-20T13:37:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c3786980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:37:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c3786980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c3786980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:02.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94583175066560 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8d4ef0 con 0x5605dc89dee0 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 94583174886720 notify 137438953476 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7ff7bc03a040 con 0x5605dc89dee0 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff6a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94583174886720 notifier 4514 bl.length()=338 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff6a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff6a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff6a4ff9640 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff684003ea0 con 0x5605dc89dee0 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(68 notify.6 [notify cookie 94583175066560 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== watch-notify(notify_complete (2) cookie 94583175066560 notify 137438953476 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5605dc85b930 con 0x5605dc89dee0 2024-03-20T13:37:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff6777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.102+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583174888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8d1e90 con 0x5605dc8948e0 2024-03-20T13:37:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.106+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94583174888848] v32'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.106+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583174868656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a7d90 con 0x5605dc898b40 2024-03-20T13:37:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.106+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94583174868656] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.106+0000 7ff7c3786980 20 remove_watcher() i=0 2024-03-20T13:37:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.106+0000 7ff7c3786980 2 removed watcher, disabling cache 2024-03-20T13:37:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.106+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583174872416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a2eb0 con 0x5605dc8948e0 2024-03-20T13:37:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.110+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94583174872416] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x5605dc8948e0 2024-03-20T13:37:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.110+0000 7ff7c3786980 20 remove_watcher() i=1 2024-03-20T13:37:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.110+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583174876064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a2eb0 con 0x5605dc898b40 2024-03-20T13:37:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.110+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94583174876064] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.110+0000 7ff7c3786980 20 remove_watcher() i=2 2024-03-20T13:37:02.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.110+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583174878320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a4ba0 con 0x7ff7b4036020 2024-03-20T13:37:02.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94583174878320] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c3786980 20 remove_watcher() i=3 2024-03-20T13:37:02.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583174866528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a2eb0 con 0x5605dc898b40 2024-03-20T13:37:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c1aa2640 1 -- 172.21.15.123:0/148608215 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94583174866528] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b4033070 con 0x5605dc898b40 2024-03-20T13:37:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c3786980 20 remove_watcher() i=4 2024-03-20T13:37:02.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583174882256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a5470 con 0x5605dc89dee0 2024-03-20T13:37:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94583174882256] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c3786980 20 remove_watcher() i=5 2024-03-20T13:37:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.114+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583174886720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a4ba0 con 0x5605dc89dee0 2024-03-20T13:37:02.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c12a1640 1 -- 172.21.15.123:0/148608215 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94583174886720] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7bc024020 con 0x5605dc89dee0 2024-03-20T13:37:02.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 20 remove_watcher() i=6 2024-03-20T13:37:02.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583174884304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5605dc8a2eb0 con 0x7ff7b4036020 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94583174884304] v32'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7b80d5060 con 0x7ff7b4036020 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 20 remove_watcher() i=7 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc898b40 msgr2=0x5605dc89af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc898b40 0x5605dc89af70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc8948e0 msgr2=0x5605dc896da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc8948e0 0x5605dc896da0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff7b4036020 msgr2=0x7ff7b4017710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff7b4036020 0x7ff7b4017710 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5605dc89dee0 msgr2=0x5605dc8a03a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5605dc89dee0 0x5605dc8a03a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff68c0342b0 msgr2=0x7ff68c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff68c0342b0 0x7ff68c036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc049960 tx=0x7ff7bc034000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 msgr2=0x5605dc889180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c0aa0640 1 -- 172.21.15.123:0/148608215 reap_dead start 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc889180 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4020ac0 tx=0x7ff7b40489c0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 shutdown_connections 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/148608215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc8822c0 0x5605dc889180 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 >> 172.21.15.123:0/148608215 conn(0x5605dc87e600 msgr2=0x5605dc87bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 shutdown_connections 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/148608215 wait complete. 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6980342b0 msgr2=0x7ff698036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6980342b0 0x7ff698036770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5605dc865930 tx=0x7ff7bc0123c0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 msgr2=0x5605dc875760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 0x5605dc875760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400aae0 tx=0x7ff7b4008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:02.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 shutdown_connections 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6980342b0 0x7ff698036770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/3014626573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc875340 0x5605dc875760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 >> 172.21.15.123:0/3014626573 conn(0x5605dc86a150 msgr2=0x5605dc86ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 shutdown_connections 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/3014626573 wait complete. 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc8629f0 msgr2=0x5605dc864de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc8629f0 0x5605dc864de0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc76c320 msgr2=0x5605dc861c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc76c320 0x5605dc861c40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6a80342b0 msgr2=0x7ff6a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6a80342b0 0x7ff6a8036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80ae000 tx=0x7ff7b80a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 msgr2=0x5605dc85afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc85afc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5605dc767b90 tx=0x7ff7bc000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:02.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 shutdown_connections 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5605dc8629f0 0x5605dc864de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5605dc76c320 0x5605dc861c40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff6a80342b0 0x7ff6a8036770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 --2- 172.21.15.123:0/2159761038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605dc6dc080 0x5605dc85afc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 >> 172.21.15.123:0/2159761038 conn(0x5605dc7626e0 msgr2=0x5605dc766cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 shutdown_connections 2024-03-20T13:37:02.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.118+0000 7ff7c3786980 1 -- 172.21.15.123:0/2159761038 wait complete. 2024-03-20T13:37:02.134 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1'] 2024-03-20T13:37:02.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1'] 2024-03-20T13:37:02.134 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:02.209 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:02.210 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:02.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac5c391980 1 Processor -- start 2024-03-20T13:37:02.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac5c391980 1 -- start start 2024-03-20T13:37:02.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac5c391980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556d1adca270 0x556d1adcc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac5c391980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556d1ad124c0 con 0x556d1ad3a050 2024-03-20T13:37:02.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac5c391980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x556d1acd90f0 con 0x556d1adca270 2024-03-20T13:37:02.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac596ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556d1adca270 0x556d1adcc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac596ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556d1adca270 0x556d1adcc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55034/0 (socket says 172.21.15.123:55034) 2024-03-20T13:37:02.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac596ab640 1 -- 172.21.15.123:0/815157645 learned_addr learned my addr 172.21.15.123:0/815157645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac59eac640 1 --1- 172.21.15.123:0/815157645 >> v1:172.21.15.89:6789/0 conn(0x556d1ad3a050 0x556d1adc8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59208/0 (socket says 172.21.15.123:59208) 2024-03-20T13:37:02.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac596ab640 1 -- 172.21.15.123:0/815157645 >> v1:172.21.15.89:6789/0 conn(0x556d1ad3a050 legacy=0x556d1adc8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.206+0000 7fac596ab640 1 -- 172.21.15.123:0/815157645 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1adcdc70 con 0x556d1adca270 2024-03-20T13:37:02.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac596ab640 1 --2- 172.21.15.123:0/815157645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adca270 0x556d1adcc660 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fac5000a5c0 tx=0x7fac5001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409e40fc290105b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac58eaa640 1 -- 172.21.15.123:0/815157645 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac500aa470 con 0x556d1adca270 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac58eaa640 1 -- 172.21.15.123:0/815157645 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac500aa5d0 con 0x556d1adca270 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac58eaa640 1 -- 172.21.15.123:0/815157645 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac500aa890 con 0x556d1adca270 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 -- 172.21.15.123:0/815157645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adca270 msgr2=0x556d1adcc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 --2- 172.21.15.123:0/815157645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adca270 0x556d1adcc660 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fac5000a5c0 tx=0x7fac5001b340 comp rx=0 tx=0).stop 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 -- 172.21.15.123:0/815157645 shutdown_connections 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 --2- 172.21.15.123:0/815157645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adca270 0x556d1adcc660 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 -- 172.21.15.123:0/815157645 >> 172.21.15.123:0/815157645 conn(0x556d1adc0670 msgr2=0x556d1adc2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 -- 172.21.15.123:0/815157645 shutdown_connections 2024-03-20T13:37:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.210+0000 7fac5c391980 1 -- 172.21.15.123:0/815157645 wait complete. 2024-03-20T13:37:02.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac5c391980 1 Processor -- start 2024-03-20T13:37:02.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac5c391980 1 -- start start 2024-03-20T13:37:02.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac5c391980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeaff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac5c391980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1acd6620 con 0x556d1ad3a050 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac59eac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeaff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac59eac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeaff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55042/0 (socket says 172.21.15.123:55042) 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac59eac640 1 -- 172.21.15.123:0/2693776401 learned_addr learned my addr 172.21.15.123:0/2693776401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac59eac640 1 -- 172.21.15.123:0/2693776401 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50005df0 con 0x556d1ad3a050 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fac59eac640 1 --2- 172.21.15.123:0/2693776401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeaff30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fac4c001cc0 tx=0x7fac4c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29520f8eefaf5a05 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fab47e07640 1 -- 172.21.15.123:0/2693776401 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac4c014070 con 0x556d1ad3a050 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fab47e07640 1 -- 172.21.15.123:0/2693776401 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00f590 con 0x556d1ad3a050 2024-03-20T13:37:02.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.222+0000 7fab47e07640 1 -- 172.21.15.123:0/2693776401 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac4c007040 con 0x556d1ad3a050 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/2693776401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 msgr2=0x556d1aeaff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 --2- 172.21.15.123:0/2693776401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeaff30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fac4c001cc0 tx=0x7fac4c00b610 comp rx=0 tx=0).stop 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/2693776401 shutdown_connections 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 --2- 172.21.15.123:0/2693776401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeaff30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/2693776401 >> 172.21.15.123:0/2693776401 conn(0x556d1adc0670 msgr2=0x556d1aeabac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/2693776401 shutdown_connections 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/2693776401 wait complete. 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 Processor -- start 2024-03-20T13:37:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- start start 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeb6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1acd1e00 con 0x556d1ad3a050 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac59eac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeb6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac59eac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeb6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55052/0 (socket says 172.21.15.123:55052) 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac59eac640 1 -- 172.21.15.123:0/187525760 learned_addr learned my addr 172.21.15.123:0/187525760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac59eac640 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1ad124c0 con 0x556d1ad3a050 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac59eac640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeb6ea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x556d1aeb0dc0 tx=0x7fac4c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fab46604640 1 -- 172.21.15.123:0/187525760 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac4c014030 con 0x556d1ad3a050 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fab46604640 1 -- 172.21.15.123:0/187525760 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c01c840 con 0x556d1ad3a050 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d1aeb73e0 con 0x556d1ad3a050 2024-03-20T13:37:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fab46604640 1 -- 172.21.15.123:0/187525760 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac4c01cb40 con 0x556d1ad3a050 2024-03-20T13:37:02.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.226+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d1aeb7810 con 0x556d1ad3a050 2024-03-20T13:37:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fab46604640 1 -- 172.21.15.123:0/187525760 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fac4c01cca0 con 0x556d1ad3a050 2024-03-20T13:37:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fab46604640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab40034300 0x7fab400367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fab46604640 1 -- 172.21.15.123:0/187525760 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fac4c006070 con 0x556d1ad3a050 2024-03-20T13:37:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac596ab640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab40034300 0x7fab400367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1adca270 0x556d1aebda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aebdfc0 con 0x556d1adca270 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1adca270 0x556d1aebda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac596ab640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab40034300 0x7fab400367c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fac500ae000 tx=0x7fac500a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1adca270 0x556d1aebda80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5a6ad640 1 -- 172.21.15.123:0/187525760 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1adca270 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aebe830 0x556d1aec0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aec1300 con 0x556d1aebe830 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac59eac640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aebe830 0x556d1aec0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac59eac640 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aebe830 0x556d1aec0c20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac59eac640 1 -- 172.21.15.123:0/187525760 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fac4c016070 con 0x556d1aebe830 2024-03-20T13:37:02.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aec2b60 con 0x556d1aebe830 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac59eac640 1 -- 172.21.15.123:0/187525760 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fac4c016070 con 0x556d1aebe830 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.230+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aec1d60 con 0x556d1aebe830 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac59eac640 1 -- 172.21.15.123:0/187525760 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fac4c016070 con 0x556d1aebe830 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aec2170 con 0x556d1adca270 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5a6ad640 1 -- 172.21.15.123:0/187525760 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1adca270 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 Processor -- start 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 -- start start 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 0x556d1aed1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1ac6ae30 con 0x556d1aed1330 2024-03-20T13:37:02.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5a6ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 0x556d1aed1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5a6ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 0x556d1aed1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55054/0 (socket says 172.21.15.123:55054) 2024-03-20T13:37:02.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1082805448 learned_addr learned my addr 172.21.15.123:0/1082805448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1082805448 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1aed1c90 con 0x556d1aed1330 2024-03-20T13:37:02.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 0x556d1aed1750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac54016cf0 tx=0x7fac5400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fab3f7fe640 1 -- 172.21.15.123:0/1082805448 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac54017660 con 0x556d1aed1330 2024-03-20T13:37:02.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fab3f7fe640 1 -- 172.21.15.123:0/1082805448 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540177c0 con 0x556d1aed1330 2024-03-20T13:37:02.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d1aed1ee0 con 0x556d1aed1330 2024-03-20T13:37:02.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fab3f7fe640 1 -- 172.21.15.123:0/1082805448 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac54017a60 con 0x556d1aed1330 2024-03-20T13:37:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d1aed2a30 con 0x556d1aed1330 2024-03-20T13:37:02.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fab3f7fe640 1 -- 172.21.15.123:0/1082805448 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fac5401d020 con 0x556d1aed1330 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fab3f7fe640 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab340342b0 0x7fab34036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.234+0000 7fab3f7fe640 1 -- 172.21.15.123:0/1082805448 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fac5404b1b0 con 0x556d1aed1330 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac59eac640 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab340342b0 0x7fab34036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 Processor -- start 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- start start 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac59eac640 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab340342b0 0x7fab34036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x556d1aec17a0 tx=0x7fac4c033040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1adc6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1ac5e790 con 0x556d1adc60e0 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1adc6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1adc6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55060/0 (socket says 172.21.15.123:55060) 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 -- 172.21.15.123:0/3982560128 learned_addr learned my addr 172.21.15.123:0/3982560128 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 -- 172.21.15.123:0/3982560128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1adc4930 con 0x556d1adc60e0 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/3982560128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1adc6500 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fac540495a0 tx=0x7fac54014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cee3146e049a90 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fab3d7fa640 1 -- 172.21.15.123:0/3982560128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac5403b070 con 0x556d1adc60e0 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fab3d7fa640 1 -- 172.21.15.123:0/3982560128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540481d0 con 0x556d1adc60e0 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fab3d7fa640 1 -- 172.21.15.123:0/3982560128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac5403b300 con 0x556d1adc60e0 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- 172.21.15.123:0/3982560128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 msgr2=0x556d1adc6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 --2- 172.21.15.123:0/3982560128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1adc6500 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fac540495a0 tx=0x7fac54014740 comp rx=0 tx=0).stop 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- 172.21.15.123:0/3982560128 shutdown_connections 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 --2- 172.21.15.123:0/3982560128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1adc6500 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- 172.21.15.123:0/3982560128 >> 172.21.15.123:0/3982560128 conn(0x556d1aeda5f0 msgr2=0x556d1aed8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- 172.21.15.123:0/3982560128 shutdown_connections 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- 172.21.15.123:0/3982560128 wait complete. 2024-03-20T13:37:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 Processor -- start 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- start start 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1aeeb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5c391980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1aeebc40 con 0x556d1adc60e0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1aeeb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1aeeb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55066/0 (socket says 172.21.15.123:55066) 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 learned_addr learned my addr 172.21.15.123:0/1408988683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1aed2a30 con 0x556d1adc60e0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.238+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1aeeb700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fac5403a040 tx=0x7fac54049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fab2b7fe640 1 -- 172.21.15.123:0/1408988683 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac5401fac0 con 0x556d1adc60e0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d1aeebe40 con 0x556d1adc60e0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fab2b7fe640 1 -- 172.21.15.123:0/1408988683 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5401fc20 con 0x556d1adc60e0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fab2b7fe640 1 -- 172.21.15.123:0/1408988683 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac540113d0 con 0x556d1adc60e0 2024-03-20T13:37:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d1aeec2d0 con 0x556d1adc60e0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fab2b7fe640 1 -- 172.21.15.123:0/1408988683 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fac54011640 con 0x556d1adc60e0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fab2b7fe640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab240342b0 0x7fab24036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fab2b7fe640 1 -- 172.21.15.123:0/1408988683 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fac54035cb0 con 0x556d1adc60e0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac59eac640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab240342b0 0x7fab24036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1aef6e90 0x556d1aef9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aef9aa0 con 0x556d1aef6e90 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac596ab640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1aef6e90 0x556d1aef9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac59eac640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab240342b0 0x7fab24036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac4c049c40 tx=0x7fac4c03d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac596ab640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1aef6e90 0x556d1aef9350 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 realm 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aef9e90 con 0x556d1aef6e90 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefa710 con 0x556d1aef6e90 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aefb0f0 0x556d1aefd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefdc90 con 0x556d1aefb0f0 2024-03-20T13:37:02.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.242+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aefb0f0 0x556d1aefd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aefb0f0 0x556d1aefd520 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 20 searching for the correct realm 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1af003d0 0x556d1af02890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af02f60 con 0x556d1af003d0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac59eac640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1af003d0 0x556d1af02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac59eac640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1af003d0 0x556d1af02890 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af02f60 con 0x556d1aefb0f0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5a6ad640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fac54034070 0x7fac54038170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x7fac54034070 2024-03-20T13:37:02.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac596ab640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fac54034070 0x7fac54038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.246+0000 7fac596ab640 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fac54034070 0x7fac54038170 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x7fac54034070 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1af003d0 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x7fac54034070 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x7fac54034070 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x7fac54034070 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fac500b0020 con 0x7fac54034070 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.250+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1af003d0 2024-03-20T13:37:02.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1af003d0 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500b0020 con 0x556d1aef6e90 2024-03-20T13:37:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1af003d0 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x7fac54034070 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aef6e90 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x7fac54034070 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.254+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1af003d0 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x7fac54034070 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1af003d0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe490 con 0x556d1aefb0f0 2024-03-20T13:37:02.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefe7f0 con 0x556d1aef6e90 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.258+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefeba0 con 0x556d1aefb0f0 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aefeba0 con 0x556d1aef6e90 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 zone default found 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 4 Realm: () 2024-03-20T13:37:02.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 zonegroup default 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x7fac54034070 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af05270 con 0x556d1af003d0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af055d0 con 0x556d1af003d0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 started sync module instance, tier type = 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:02.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af04840 con 0x556d1aefb0f0 2024-03-20T13:37:02.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93927091751920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af04840 con 0x556d1aefb0f0 2024-03-20T13:37:02.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.262+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af05f80 con 0x556d1aef6e90 2024-03-20T13:37:02.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93927091755680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af05ec0 con 0x556d1aef6e90 2024-03-20T13:37:02.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af06e50 con 0x556d1aefb0f0 2024-03-20T13:37:02.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93927091751920] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93927091755680] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93927091757872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af06e50 con 0x556d1aefb0f0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.266+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af076d0 con 0x7fac54034070 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93927091761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af06e50 con 0x7fac54034070 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af08230 con 0x556d1aefb0f0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93927091757872] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93927091761712] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93927091762768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af081f0 con 0x556d1aefb0f0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.270+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af085e0 con 0x556d1af003d0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93927091759472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af085e0 con 0x556d1af003d0 2024-03-20T13:37:02.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af094d0 con 0x556d1af003d0 2024-03-20T13:37:02.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93927091762768] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93927091759472] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93927091767696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af09490 con 0x556d1af003d0 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af09d20 con 0x7fac54034070 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93927091771520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af09490 con 0x7fac54034070 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=0 2024-03-20T13:37:02.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=1 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=2 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=3 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=4 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=5 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93927091767696] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.274+0000 7fac5c391980 20 add_watcher() i=6 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93927091771520] v32'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 add_watcher() i=7 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:02.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af08fd0 con 0x556d1aef6e90 2024-03-20T13:37:02.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93927091772576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af08fd0 con 0x556d1aef6e90 2024-03-20T13:37:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93927091772576] v32'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fab0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 5 note: GC not initialized 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fab0a7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 Filter name: none 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7faa7ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af2edb0 con 0x556d1aef6e90 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.278+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af30910 con 0x7fac54034070 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af32120 con 0x556d1aefb0f0 2024-03-20T13:37:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:02.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:02.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-03-20T13:37:02.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af36480 con 0x556d1aef6e90 2024-03-20T13:37:02.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.282+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af3c2a0 con 0x556d1aefb0f0 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 93927091938768 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af36870 con 0x556d1aef6e90 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== watch-notify(notify (1) cookie 93927091755680 notify 137438953474 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7fac500d0040 con 0x556d1aef6e90 2024-03-20T13:37:02.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fab3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93927091755680 notifier 4521 bl.length()=725 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fab3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fab3d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fab3d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(67 notify.1 [notify cookie 93927091938768 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fab3d7fa640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fab1c003ea0 con 0x556d1aef6e90 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== watch-notify(notify_complete (2) cookie 93927091938768 notify 137438953474 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fac500b9070 con 0x556d1aef6e90 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_sources= new_sources= 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential sources added=[] removed=[] 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_dests= new_dests= 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential dests added=[] removed=[] 2024-03-20T13:37:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af325b0 con 0x7fac54034070 2024-03-20T13:37:02.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.286+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af325b0 con 0x7fac54034070 2024-03-20T13:37:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac5c391980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:37:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac5c391980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac5c391980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93927091938736 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af3b000 con 0x556d1af003d0 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 93927091767696 notify 137438953477 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7fac4c050070 con 0x556d1af003d0 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fab3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93927091767696 notifier 4521 bl.length()=314 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fab3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fab3cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fab3cff9640 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7faa8c003400 con 0x556d1af003d0 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [notify cookie 93927091938736 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== watch-notify(notify_complete (2) cookie 93927091938736 notify 137438953477 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556d1aeb7810 con 0x556d1af003d0 2024-03-20T13:37:02.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fab0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.290+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93927091772576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af325b0 con 0x556d1aef6e90 2024-03-20T13:37:02.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93927091772576] v32'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93927091751920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1af09ca0 con 0x556d1aefb0f0 2024-03-20T13:37:02.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93927091751920] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5c391980 20 remove_watcher() i=0 2024-03-20T13:37:02.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5c391980 2 removed watcher, disabling cache 2024-03-20T13:37:02.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93927091755680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x556d1aef6e90 2024-03-20T13:37:02.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93927091755680] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x556d1aef6e90 2024-03-20T13:37:02.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5c391980 20 remove_watcher() i=1 2024-03-20T13:37:02.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.294+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93927091757872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x556d1aefb0f0 2024-03-20T13:37:02.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.298+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93927091757872] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.298+0000 7fac5c391980 20 remove_watcher() i=2 2024-03-20T13:37:02.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.298+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93927091761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x7fac54034070 2024-03-20T13:37:02.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.298+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93927091761712] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.298+0000 7fac5c391980 20 remove_watcher() i=3 2024-03-20T13:37:02.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.298+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93927091762768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x556d1aefb0f0 2024-03-20T13:37:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.302+0000 7fac5a6ad640 1 -- 172.21.15.123:0/1408988683 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93927091762768] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac5400a4d0 con 0x556d1aefb0f0 2024-03-20T13:37:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.302+0000 7fac5c391980 20 remove_watcher() i=4 2024-03-20T13:37:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.302+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93927091759472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x556d1af003d0 2024-03-20T13:37:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.302+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93927091759472] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.302+0000 7fac5c391980 20 remove_watcher() i=5 2024-03-20T13:37:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.302+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93927091767696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x556d1af003d0 2024-03-20T13:37:02.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac59eac640 1 -- 172.21.15.123:0/1408988683 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93927091767696] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac4c016070 con 0x556d1af003d0 2024-03-20T13:37:02.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 20 remove_watcher() i=6 2024-03-20T13:37:02.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93927091771520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556d1aeff420 con 0x7fac54034070 2024-03-20T13:37:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93927091771520] v32'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac500d5060 con 0x7fac54034070 2024-03-20T13:37:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 20 remove_watcher() i=7 2024-03-20T13:37:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aefb0f0 msgr2=0x556d1aefd520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aefb0f0 0x556d1aefd520 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1aef6e90 msgr2=0x556d1aef9350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1aef6e90 0x556d1aef9350 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fac54034070 msgr2=0x7fac54038170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fac54034070 0x7fac54038170 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1af003d0 msgr2=0x556d1af02890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1af003d0 0x556d1af02890 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab240342b0 msgr2=0x7fab24036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab240342b0 0x7fab24036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac4c049c40 tx=0x7fac4c03d000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 msgr2=0x556d1aeeb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac596ab640 1 -- 172.21.15.123:0/1408988683 reap_dead start 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1aeeb700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fac5403a040 tx=0x7fac54049530 comp rx=0 tx=0).stop 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 shutdown_connections 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1408988683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1adc60e0 0x556d1aeeb700 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 >> 172.21.15.123:0/1408988683 conn(0x556d1aeda5f0 msgr2=0x556d1aed7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 shutdown_connections 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1408988683 wait complete. 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab340342b0 msgr2=0x7fab34036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab340342b0 0x7fab34036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x556d1aec17a0 tx=0x7fac4c033040 comp rx=0 tx=0).stop 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 msgr2=0x556d1aed1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 0x556d1aed1750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac54016cf0 tx=0x7fac5400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 shutdown_connections 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab340342b0 0x7fab34036770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/1082805448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1aed1330 0x556d1aed1750 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 >> 172.21.15.123:0/1082805448 conn(0x556d1aec6140 msgr2=0x556d1aec6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 shutdown_connections 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/1082805448 wait complete. 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aebe830 msgr2=0x556d1aec0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aebe830 0x556d1aec0c20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1adca270 msgr2=0x556d1aebda80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1adca270 0x556d1aebda80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab40034300 msgr2=0x7fab400367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab40034300 0x7fab400367c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fac500ae000 tx=0x7fac500a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 msgr2=0x556d1aeb6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeb6ea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x556d1aeb0dc0 tx=0x7fac4c000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 shutdown_connections 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d1aebe830 0x556d1aec0c20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1adca270 0x556d1aebda80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab40034300 0x7fab400367c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 --2- 172.21.15.123:0/187525760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1ad3a050 0x556d1aeb6ea0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 >> 172.21.15.123:0/187525760 conn(0x556d1adc0670 msgr2=0x556d1aeaa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 shutdown_connections 2024-03-20T13:37:02.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.306+0000 7fac5c391980 1 -- 172.21.15.123:0/187525760 wait complete. 2024-03-20T13:37:02.324 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-03-20T13:37:02.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-03-20T13:37:02.324 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-03-20T13:37:02.400 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:02.400 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:02.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a9cc9980 1 Processor -- start 2024-03-20T13:37:02.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a9cc9980 1 -- start start 2024-03-20T13:37:02.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a9cc9980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a3c5594f80 0x55a3c5595360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a9cc9980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a3c54e1520 con 0x55a3c55958a0 2024-03-20T13:37:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a9cc9980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a3c54a80f0 con 0x55a3c5594f80 2024-03-20T13:37:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a77e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a3c5594f80 0x55a3c5595360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a77e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a3c5594f80 0x55a3c5595360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55076/0 (socket says 172.21.15.123:55076) 2024-03-20T13:37:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.394+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2830604257 learned_addr learned my addr 172.21.15.123:0/2830604257 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2830604257 >> v1:172.21.15.89:6789/0 conn(0x55a3c55958a0 legacy=0x55a3c5596210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2830604257 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c5596a40 con 0x55a3c5594f80 2024-03-20T13:37:02.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/2830604257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c5595360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000a4e0 tx=0x7fc0a001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b941f796cec6a1de server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a67e2640 1 -- 172.21.15.123:0/2830604257 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00aa540 con 0x55a3c5594f80 2024-03-20T13:37:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a67e2640 1 -- 172.21.15.123:0/2830604257 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00a6070 con 0x55a3c5594f80 2024-03-20T13:37:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a67e2640 1 -- 172.21.15.123:0/2830604257 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00aa850 con 0x55a3c5594f80 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2830604257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 msgr2=0x55a3c5595360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2830604257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c5595360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000a4e0 tx=0x7fc0a001b090 comp rx=0 tx=0).stop 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2830604257 shutdown_connections 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2830604257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c5595360 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2830604257 >> 172.21.15.123:0/2830604257 conn(0x55a3c5590850 msgr2=0x55a3c5592c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2830604257 shutdown_connections 2024-03-20T13:37:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.398+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2830604257 wait complete. 2024-03-20T13:37:02.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a9cc9980 1 Processor -- start 2024-03-20T13:37:02.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a9cc9980 1 -- start start 2024-03-20T13:37:02.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a9cc9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c567f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a9cc9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c54a5620 con 0x55a3c5594f80 2024-03-20T13:37:02.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a77e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c567f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a77e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c567f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55088/0 (socket says 172.21.15.123:55088) 2024-03-20T13:37:02.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2899750767 learned_addr learned my addr 172.21.15.123:0/2899750767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2899750767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a000a1c0 con 0x55a3c5594f80 2024-03-20T13:37:02.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/2899750767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c567f360 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0017ca0 tx=0x7fc0a00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d295c8f90526eb79 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fbf9560a640 1 -- 172.21.15.123:0/2899750767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00aa780 con 0x55a3c5594f80 2024-03-20T13:37:02.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fbf9560a640 1 -- 172.21.15.123:0/2899750767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00aa8e0 con 0x55a3c5594f80 2024-03-20T13:37:02.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.414+0000 7fbf9560a640 1 -- 172.21.15.123:0/2899750767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00aab80 con 0x55a3c5594f80 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2899750767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 msgr2=0x55a3c567f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2899750767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c567f360 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0017ca0 tx=0x7fc0a00033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2899750767 shutdown_connections 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2899750767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c567f360 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2899750767 >> 172.21.15.123:0/2899750767 conn(0x55a3c5590850 msgr2=0x55a3c567aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2899750767 shutdown_connections 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2899750767 wait complete. 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 Processor -- start 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- start start 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c56860b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c54a0e00 con 0x55a3c5594f80 2024-03-20T13:37:02.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a77e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c56860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a77e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c56860b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55102/0 (socket says 172.21.15.123:55102) 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2733040561 learned_addr learned my addr 172.21.15.123:0/2733040561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c5596a40 con 0x55a3c5594f80 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c56860b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001aec0 tx=0x7fc0a0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fbf93e07640 1 -- 172.21.15.123:0/2733040561 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00c4070 con 0x55a3c5594f80 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a3c56865f0 con 0x55a3c5594f80 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fbf93e07640 1 -- 172.21.15.123:0/2733040561 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00b5650 con 0x55a3c5594f80 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3c5686a20 con 0x55a3c5594f80 2024-03-20T13:37:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fbf93e07640 1 -- 172.21.15.123:0/2733040561 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00b58f0 con 0x55a3c5594f80 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fbf93e07640 1 -- 172.21.15.123:0/2733040561 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc0a00a8070 con 0x55a3c5594f80 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.418+0000 7fbf93e07640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf8c0342b0 0x7fbf8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fbf93e07640 1 -- 172.21.15.123:0/2733040561 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc0a00e3710 con 0x55a3c5594f80 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a6fe3640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf8c0342b0 0x7fbf8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c55958a0 0x55a3c568cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c568d220 con 0x55a3c55958a0 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c55958a0 0x55a3c568cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a6fe3640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf8c0342b0 0x7fbf8c036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000f70 tx=0x7fc09c001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c55958a0 0x55a3c568cce0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/2733040561 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0980083f0 con 0x55a3c55958a0 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c568da90 0x55a3c568fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c5690630 con 0x55a3c568da90 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c568da90 0x55a3c568fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c568da90 0x55a3c568fec0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2733040561 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c568da90 2024-03-20T13:37:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c5691e90 con 0x55a3c568da90 2024-03-20T13:37:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2733040561 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c568da90 2024-03-20T13:37:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.422+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c5690fd0 con 0x55a3c568da90 2024-03-20T13:37:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a77e4640 1 -- 172.21.15.123:0/2733040561 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c568da90 2024-03-20T13:37:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56913e0 con 0x55a3c55958a0 2024-03-20T13:37:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/2733040561 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc0980083f0 con 0x55a3c55958a0 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 Processor -- start 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 -- start start 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 0x55a3c56a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c5439e30 con 0x55a3c56a05a0 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a7fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 0x55a3c56a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a7fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 0x55a3c56a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55110/0 (socket says 172.21.15.123:55110) 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/4210429105 learned_addr learned my addr 172.21.15.123:0/4210429105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/4210429105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c56a0f00 con 0x55a3c56a05a0 2024-03-20T13:37:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 0x55a3c56a09c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc09800aae0 tx=0x7fc098008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fbf91602640 1 -- 172.21.15.123:0/4210429105 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc09801d070 con 0x55a3c56a05a0 2024-03-20T13:37:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fbf91602640 1 -- 172.21.15.123:0/4210429105 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098010040 con 0x55a3c56a05a0 2024-03-20T13:37:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a3c56a1150 con 0x55a3c56a05a0 2024-03-20T13:37:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fbf91602640 1 -- 172.21.15.123:0/4210429105 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc098007e70 con 0x55a3c56a05a0 2024-03-20T13:37:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.426+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3c56a1ca0 con 0x55a3c56a05a0 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fbf91602640 1 -- 172.21.15.123:0/4210429105 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc098018430 con 0x55a3c56a05a0 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fbf91602640 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf800342b0 0x7fbf80036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fbf91602640 1 -- 172.21.15.123:0/4210429105 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc09804a6e0 con 0x55a3c56a05a0 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf800342b0 0x7fbf80036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 Processor -- start 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- start start 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf800342b0 0x7fbf80036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55a3c5690ad0 tx=0x7fc0a00b48d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c550b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c542d790 con 0x55a3c550b5d0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c550b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c550b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55112/0 (socket says 172.21.15.123:55112) 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/276575617 learned_addr learned my addr 172.21.15.123:0/276575617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/276575617 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c5509e00 con 0x55a3c550b5d0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/276575617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c550b9f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc098048a10 tx=0x7fc098020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c972fcce130a15 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fbf8affd640 1 -- 172.21.15.123:0/276575617 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc098047070 con 0x55a3c550b5d0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fbf8affd640 1 -- 172.21.15.123:0/276575617 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098021790 con 0x55a3c550b5d0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fbf8affd640 1 -- 172.21.15.123:0/276575617 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc098039240 con 0x55a3c550b5d0 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/276575617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 msgr2=0x55a3c550b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/276575617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c550b9f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc098048a10 tx=0x7fc098020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/276575617 shutdown_connections 2024-03-20T13:37:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/276575617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c550b9f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/276575617 >> 172.21.15.123:0/276575617 conn(0x55a3c56a9880 msgr2=0x55a3c56a78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/276575617 shutdown_connections 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/276575617 wait complete. 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 Processor -- start 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- start start 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c56b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a9cc9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c56b6ad0 con 0x55a3c550b5d0 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c56b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c56b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55114/0 (socket says 172.21.15.123:55114) 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.430+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 learned_addr learned my addr 172.21.15.123:0/3518698972 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c56a1ca0 con 0x55a3c550b5d0 2024-03-20T13:37:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c56b6590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc0980077a0 tx=0x7fc0980489a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fbf897fa640 1 -- 172.21.15.123:0/3518698972 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc098048c10 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a3c56b6cd0 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fbf897fa640 1 -- 172.21.15.123:0/3518698972 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09803ab50 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fbf897fa640 1 -- 172.21.15.123:0/3518698972 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc09803adf0 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3c56b7100 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fbf897fa640 1 -- 172.21.15.123:0/3518698972 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc098018730 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fbf897fa640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fbf897fa640 1 -- 172.21.15.123:0/3518698972 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc09802dce0 con 0x55a3c550b5d0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c56c1ce0 0x55a3c56c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56c48f0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a6fe3640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c56c1ce0 0x55a3c56c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00e3a40 tx=0x7fc0a00e8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a6fe3640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c56c1ce0 0x55a3c56c41a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 realm 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56c1140 con 0x55a3c56c1ce0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56c5370 con 0x55a3c56c1ce0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c56c6100 0x55a3c56c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.434+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56c8bd0 con 0x55a3c56c6100 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c56c6100 0x55a3c56c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c56c6100 0x55a3c56c84f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc098032020 con 0x55a3c56c6100 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56c93d0 con 0x55a3c56c6100 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc098032020 con 0x55a3c56c6100 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 20 searching for the correct realm 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a3c56cb3d0 0x55a3c56cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a3c56cb3d0 0x55a3c56cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a77e4640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a3c56cb3d0 0x55a3c56cd890 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098032020 con 0x55a3c56c6100 2024-03-20T13:37:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc098017710 0x7fc098036460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x7fc098017710 2024-03-20T13:37:02.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a6fe3640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc098017710 0x7fc098036460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.438+0000 7fc0a6fe3640 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc098017710 0x7fc098036460 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x7fc098017710 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098032020 con 0x55a3c56c6100 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098032020 con 0x55a3c56c6100 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x7fc098017710 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x7fc098017710 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x7fc098017710 2024-03-20T13:37:02.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc09c00bdd0 con 0x7fc098017710 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.442+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098032020 con 0x55a3c56c6100 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c00bdd0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x7fc098017710 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x7fc098017710 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x7fc098017710 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.446+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cdf60 con 0x55a3c56c6100 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:02.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56ca930 con 0x55a3c56c1ce0 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.450+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56c98b0 con 0x55a3c56c6100 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56ca1c0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 zone default found 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 4 Realm: () 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:02.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 zonegroup default 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56ce840 con 0x7fc098017710 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d0a20 con 0x55a3c56cb3d0 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d0d80 con 0x55a3c56cb3d0 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 started sync module instance, tier type = 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:02.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.454+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cfeb0 con 0x55a3c56c6100 2024-03-20T13:37:02.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94161880285840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cfeb0 con 0x55a3c56c6100 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d15c0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94161880289504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d1a40 con 0x55a3c56c1ce0 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d2510 con 0x55a3c56c6100 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94161880289504] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94161880285840] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94161880283664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d24d0 con 0x55a3c56c6100 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.458+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d2d60 con 0x7fc098017710 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94161880295616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d24d0 con 0x7fc098017710 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d3830 con 0x55a3c56c6100 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94161880283664] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94161880295616] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94161880296672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d3830 con 0x55a3c56c6100 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.462+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d3c20 con 0x55a3c56cb3d0 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.466+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.466+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94161880298272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d3be0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.466+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d4ac0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.466+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.466+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94161880303072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d4ac0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d59d0 con 0x7fc098017710 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94161880296672] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94161880298272] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94161880303072] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94161880301520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d5990 con 0x7fc098017710 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=0 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=1 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=2 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=3 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=4 2024-03-20T13:37:02.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=5 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=6 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94161880301520] v32'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 20 add_watcher() i=7 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d4ea0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.470+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94161880293360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d4ea0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94161880293360] v32'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fbf5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fc0a9cc9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:02.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fc0a9cc9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:02.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e0a80 con 0x55a3c56c6100 2024-03-20T13:37:02.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.474+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e0b30 con 0x7fc098017710 2024-03-20T13:37:02.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.478+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.478+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e1460 con 0x55a3c56cb3d0 2024-03-20T13:37:02.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.478+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.478+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dfdb0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.482+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.482+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dfdb0 con 0x55a3c56c6100 2024-03-20T13:37:02.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.482+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'36 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.482+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e2120 con 0x55a3c56cb3d0 2024-03-20T13:37:02.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.486+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.486+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e2650 con 0x55a3c56c6100 2024-03-20T13:37:02.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.486+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.486+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e2b80 con 0x55a3c56c1ce0 2024-03-20T13:37:02.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.490+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.490+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e30b0 con 0x55a3c56c6100 2024-03-20T13:37:02.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.490+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.490+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e30b0 con 0x55a3c56c6100 2024-03-20T13:37:02.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.494+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.494+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e30b0 con 0x55a3c56c6100 2024-03-20T13:37:02.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.494+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.494+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e30b0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.494+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.494+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e35e0 con 0x55a3c56c6100 2024-03-20T13:37:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.498+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.498+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e35e0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.498+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.498+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e35e0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.502+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.502+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e35e0 con 0x55a3c56c6100 2024-03-20T13:37:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.502+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.502+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e35e0 con 0x55a3c56c6100 2024-03-20T13:37:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.506+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.506+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e35e0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.506+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.506+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3870 con 0x55a3c56c6100 2024-03-20T13:37:02.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.510+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.510+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3790 con 0x55a3c56c1ce0 2024-03-20T13:37:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.510+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.510+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3790 con 0x55a3c56c6100 2024-03-20T13:37:02.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.514+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.514+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3610 con 0x55a3c56c6100 2024-03-20T13:37:02.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.514+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.514+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3610 con 0x55a3c56cb3d0 2024-03-20T13:37:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.514+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.514+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e36a0 con 0x55a3c56c6100 2024-03-20T13:37:02.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.518+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.518+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e36a0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.522+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.522+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e36a0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.522+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.522+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e36a0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.522+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.522+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3870 con 0x55a3c56c6100 2024-03-20T13:37:02.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.526+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.526+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3870 con 0x55a3c56c1ce0 2024-03-20T13:37:02.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.526+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.526+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e3870 con 0x55a3c56c6100 2024-03-20T13:37:02.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.530+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.530+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e36a0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.530+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.530+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56e36a0 con 0x7fc098017710 2024-03-20T13:37:02.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.530+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fbf5cfe1640 20 reqs_thread_entry: start 2024-03-20T13:37:02.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 20 Filter name: none 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fbed67fc640 20 reqs_thread_entry: start 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56ddc80 con 0x7fc098017710 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:37:02.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56ffc70 con 0x55a3c56c1ce0 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94161880340448 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c5700110 con 0x55a3c56c6100 2024-03-20T13:37:02.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== watch-notify(notify (1) cookie 94161880283664 notify 137438953496 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7fc098054040 con 0x55a3c56c6100 2024-03-20T13:37:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fbf8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94161880283664 notifier 4528 bl.length()=170 2024-03-20T13:37:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fbf8affd640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fbf6c003d60 con 0x55a3c56c6100 2024-03-20T13:37:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(96 notify.2 [notify cookie 94161880340448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== watch-notify(notify_complete (2) cookie 94161880340448 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a3c56b7100 con 0x55a3c56c6100 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.534+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v32'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 10 removing email index: 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 10 removing user buckets index 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-03-20T13:37:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94161880340448 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c5700110 con 0x55a3c56cb3d0 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== watch-notify(notify (1) cookie 94161880303072 notify 137438953478 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55a3c5686a20 con 0x55a3c56cb3d0 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fbf8a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94161880303072 notifier 4528 bl.length()=160 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(99 notify.6 [notify cookie 94161880340448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fbedc0032c0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== watch-notify(notify_complete (2) cookie 94161880340448 notify 137438953478 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a3c56865f0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(101 fud.buckets [delete] v32'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 10 removing user index: fud 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 10 removing default.rgw.meta+users.uid+fud from cache 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94161880340448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56ff100 con 0x55a3c56cb3d0 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== watch-notify(notify (1) cookie 94161880298272 notify 137438953479 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55a3c56865f0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fbf8a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94161880298272 notifier 4528 bl.length()=152 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(102 notify.5 [notify cookie 94161880340448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.538+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fbedc0032c0 con 0x55a3c56cb3d0 2024-03-20T13:37:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.542+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.542+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== watch-notify(notify_complete (2) cookie 94161880340448 notify 137438953479 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a3c5596a40 con 0x55a3c56cb3d0 2024-03-20T13:37:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.542+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x7fc098017710 2024-03-20T13:37:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.542+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(104 fud [call,call,delete] v32'4 uv4 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.542+0000 7fbf5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.542+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94161880293360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.546+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94161880293360] v32'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.546+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94161880285840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x55a3c56c6100 2024-03-20T13:37:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.546+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94161880285840] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.546+0000 7fc0a9cc9980 20 remove_watcher() i=0 2024-03-20T13:37:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.546+0000 7fc0a9cc9980 2 removed watcher, disabling cache 2024-03-20T13:37:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.546+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94161880289504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x55a3c56c1ce0 2024-03-20T13:37:02.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.550+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94161880289504] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x55a3c56c1ce0 2024-03-20T13:37:02.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.550+0000 7fc0a9cc9980 20 remove_watcher() i=1 2024-03-20T13:37:02.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.550+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94161880283664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d10e0 con 0x55a3c56c6100 2024-03-20T13:37:02.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.550+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94161880283664] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.550+0000 7fc0a9cc9980 20 remove_watcher() i=2 2024-03-20T13:37:02.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.550+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94161880295616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56dd7e0 con 0x7fc098017710 2024-03-20T13:37:02.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94161880295616] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a9cc9980 20 remove_watcher() i=3 2024-03-20T13:37:02.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94161880296672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56cfa10 con 0x55a3c56c6100 2024-03-20T13:37:02.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a7fe5640 1 -- 172.21.15.123:0/3518698972 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94161880296672] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc098061040 con 0x55a3c56c6100 2024-03-20T13:37:02.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a9cc9980 20 remove_watcher() i=4 2024-03-20T13:37:02.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94161880298272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d2d60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94161880298272] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a9cc9980 20 remove_watcher() i=5 2024-03-20T13:37:02.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.554+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94161880303072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d2d60 con 0x55a3c56cb3d0 2024-03-20T13:37:02.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a77e4640 1 -- 172.21.15.123:0/3518698972 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94161880303072] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a00bd780 con 0x55a3c56cb3d0 2024-03-20T13:37:02.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 20 remove_watcher() i=6 2024-03-20T13:37:02.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94161880301520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a3c56d2d60 con 0x7fc098017710 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94161880301520] v32'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc09c028040 con 0x7fc098017710 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 20 remove_watcher() i=7 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c56c6100 msgr2=0x55a3c56c84f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c56c6100 0x55a3c56c84f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c56c1ce0 msgr2=0x55a3c56c41a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c56c1ce0 0x55a3c56c41a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc098017710 msgr2=0x7fc098036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc098017710 0x7fc098036460 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a3c56cb3d0 msgr2=0x55a3c56cd890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a3c56cb3d0 0x55a3c56cd890 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 msgr2=0x7fbf70036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00e3a40 tx=0x7fc0a00e8000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 msgr2=0x55a3c56b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a6fe3640 1 -- 172.21.15.123:0/3518698972 reap_dead start 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c56b6590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc0980077a0 tx=0x7fc0980489a0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 shutdown_connections 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/3518698972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c550b5d0 0x55a3c56b6590 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 >> 172.21.15.123:0/3518698972 conn(0x55a3c56a9880 msgr2=0x55a3c56a6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 shutdown_connections 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/3518698972 wait complete. 2024-03-20T13:37:02.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf800342b0 msgr2=0x7fbf80036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf800342b0 0x7fbf80036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55a3c5690ad0 tx=0x7fc0a00b48d0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 msgr2=0x55a3c56a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 0x55a3c56a09c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc09800aae0 tx=0x7fc098008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 shutdown_connections 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf800342b0 0x7fbf80036770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/4210429105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c56a05a0 0x55a3c56a09c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 >> 172.21.15.123:0/4210429105 conn(0x55a3c56953b0 msgr2=0x55a3c5695ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 shutdown_connections 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/4210429105 wait complete. 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c568da90 msgr2=0x55a3c568fec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c568da90 0x55a3c568fec0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c55958a0 msgr2=0x55a3c568cce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c55958a0 0x55a3c568cce0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf8c0342b0 msgr2=0x7fbf8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf8c0342b0 0x7fbf8c036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000f70 tx=0x7fc09c001420 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 msgr2=0x55a3c56860b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c56860b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001aec0 tx=0x7fc0a0017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 shutdown_connections 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a3c568da90 0x55a3c568fec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a3c55958a0 0x55a3c568cce0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf8c0342b0 0x7fbf8c036770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 --2- 172.21.15.123:0/2733040561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3c5594f80 0x55a3c56860b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 >> 172.21.15.123:0/2733040561 conn(0x55a3c5590850 msgr2=0x55a3c5679a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 shutdown_connections 2024-03-20T13:37:02.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.558+0000 7fc0a9cc9980 1 -- 172.21.15.123:0/2733040561 wait complete. 2024-03-20T13:37:02.574 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:37:02.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:37:02.575 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-03-20T13:37:02.662 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:02.663 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:02.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa55bcc6980 1 Processor -- start 2024-03-20T13:37:02.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa55bcc6980 1 -- start start 2024-03-20T13:37:02.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa55bcc6980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555edb8b1010 0x555edb93fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa55bcc6980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555edb8894c0 con 0x555edb9400d0 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa55bcc6980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x555edb8500f0 con 0x555edb8b1010 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa5597e1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555edb8b1010 0x555edb93fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa558fe0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x555edb9400d0 0x555edb9424c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59234/0 (socket says 172.21.15.123:59234) 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa5597e1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555edb8b1010 0x555edb93fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55116/0 (socket says 172.21.15.123:55116) 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa558fe0640 1 -- 172.21.15.123:0/2684297075 learned_addr learned my addr 172.21.15.123:0/2684297075 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa5597e1640 1 -- 172.21.15.123:0/2684297075 >> v1:172.21.15.89:6789/0 conn(0x555edb9400d0 legacy=0x555edb9424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.658+0000 7fa5597e1640 1 -- 172.21.15.123:0/2684297075 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555edb944c80 con 0x555edb8b1010 2024-03-20T13:37:02.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa5597e1640 1 --2- 172.21.15.123:0/2684297075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edb93fb90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa55400a420 tx=0x7fa55401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1077446fca7f6aeb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa54bfff640 1 -- 172.21.15.123:0/2684297075 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540aa530 con 0x555edb8b1010 2024-03-20T13:37:02.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa54bfff640 1 -- 172.21.15.123:0/2684297075 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540a6050 con 0x555edb8b1010 2024-03-20T13:37:02.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa54bfff640 1 -- 172.21.15.123:0/2684297075 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540aa800 con 0x555edb8b1010 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2684297075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 msgr2=0x555edb93fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2684297075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edb93fb90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa55400a420 tx=0x7fa55401afd0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2684297075 shutdown_connections 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2684297075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edb93fb90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2684297075 >> 172.21.15.123:0/2684297075 conn(0x555edb937670 msgr2=0x555edb939a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2684297075 shutdown_connections 2024-03-20T13:37:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.662+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2684297075 wait complete. 2024-03-20T13:37:02.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.674+0000 7fa55bcc6980 1 Processor -- start 2024-03-20T13:37:02.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.674+0000 7fa55bcc6980 1 -- start start 2024-03-20T13:37:02.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba26ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555edb84d620 con 0x555edb8b1010 2024-03-20T13:37:02.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba26ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba26ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55118/0 (socket says 172.21.15.123:55118) 2024-03-20T13:37:02.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 -- 172.21.15.123:0/2577278850 learned_addr learned my addr 172.21.15.123:0/2577278850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 -- 172.21.15.123:0/2577278850 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55400a100 con 0x555edb8b1010 2024-03-20T13:37:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 --2- 172.21.15.123:0/2577278850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba26ee0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa5540ad040 tx=0x7fa5540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b33d93a654f1fc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa447606640 1 -- 172.21.15.123:0/2577278850 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540aa6c0 con 0x555edb8b1010 2024-03-20T13:37:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa447606640 1 -- 172.21.15.123:0/2577278850 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540aa820 con 0x555edb8b1010 2024-03-20T13:37:02.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa447606640 1 -- 172.21.15.123:0/2577278850 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540aaac0 con 0x555edb8b1010 2024-03-20T13:37:02.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2577278850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 msgr2=0x555edba26ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2577278850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba26ee0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa5540ad040 tx=0x7fa5540033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2577278850 shutdown_connections 2024-03-20T13:37:02.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2577278850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba26ee0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2577278850 >> 172.21.15.123:0/2577278850 conn(0x555edb937670 msgr2=0x555edba22a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2577278850 shutdown_connections 2024-03-20T13:37:02.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2577278850 wait complete. 2024-03-20T13:37:02.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 Processor -- start 2024-03-20T13:37:02.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- start start 2024-03-20T13:37:02.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba2dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa55bcc6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555edb848e00 con 0x555edb8b1010 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba2dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba2dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55128/0 (socket says 172.21.15.123:55128) 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 -- 172.21.15.123:0/1136096529 learned_addr learned my addr 172.21.15.123:0/1136096529 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.678+0000 7fa5597e1640 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555edb944c80 con 0x555edb8b1010 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa5597e1640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba2dc10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa55401b4b0 tx=0x7fa554019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa445e03640 1 -- 172.21.15.123:0/1136096529 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540c5070 con 0x555edb8b1010 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555edba2e150 con 0x555edb8b1010 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa445e03640 1 -- 172.21.15.123:0/1136096529 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540b6bb0 con 0x555edb8b1010 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa445e03640 1 -- 172.21.15.123:0/1136096529 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5540b6e50 con 0x555edb8b1010 2024-03-20T13:37:02.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555edba2e5e0 con 0x555edb8b1010 2024-03-20T13:37:02.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa445e03640 1 -- 172.21.15.123:0/1136096529 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa5540ca410 con 0x555edb8b1010 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa445e03640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4400342b0 0x7fa440036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa445e03640 1 -- 172.21.15.123:0/1136096529 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa5540e3cc0 con 0x555edb8b1010 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa558fe0640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4400342b0 0x7fa440036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edb9400d0 0x555edba347f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba34d30 con 0x555edb9400d0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa559fe2640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edb9400d0 0x555edba347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa558fe0640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4400342b0 0x7fa440036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa550000f70 tx=0x7fa5500012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa559fe2640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edb9400d0 0x555edba347f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa559fe2640 1 -- 172.21.15.123:0/1136096529 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa54c0083f0 con 0x555edb9400d0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba355a0 0x555edba37990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba38040 con 0x555edba355a0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa5597e1640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba355a0 0x555edba37990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.682+0000 7fa5597e1640 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba355a0 0x555edba37990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa5597e1640 1 -- 172.21.15.123:0/1136096529 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba355a0 2024-03-20T13:37:02.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba398a0 con 0x555edba355a0 2024-03-20T13:37:02.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa5597e1640 1 -- 172.21.15.123:0/1136096529 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba355a0 2024-03-20T13:37:02.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba38aa0 con 0x555edba355a0 2024-03-20T13:37:02.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa5597e1640 1 -- 172.21.15.123:0/1136096529 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba355a0 2024-03-20T13:37:02.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba38eb0 con 0x555edb9400d0 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa559fe2640 1 -- 172.21.15.123:0/1136096529 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa54c0083f0 con 0x555edb9400d0 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 Processor -- start 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 -- start start 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 0x555edba483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa55bcc6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555edb7e1e30 con 0x555edba47fa0 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa559fe2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 0x555edba483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa559fe2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 0x555edba483c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55134/0 (socket says 172.21.15.123:55134) 2024-03-20T13:37:02.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.686+0000 7fa559fe2640 1 -- 172.21.15.123:0/1133968803 learned_addr learned my addr 172.21.15.123:0/1133968803 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa559fe2640 1 -- 172.21.15.123:0/1133968803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555edba48900 con 0x555edba47fa0 2024-03-20T13:37:02.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa559fe2640 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 0x555edba483c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00aae0 tx=0x7fa54c008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa43effd640 1 -- 172.21.15.123:0/1133968803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c01d070 con 0x555edba47fa0 2024-03-20T13:37:02.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa43effd640 1 -- 172.21.15.123:0/1133968803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c010040 con 0x555edba47fa0 2024-03-20T13:37:02.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555edba48b50 con 0x555edba47fa0 2024-03-20T13:37:02.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa43effd640 1 -- 172.21.15.123:0/1133968803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c007e70 con 0x555edba47fa0 2024-03-20T13:37:02.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555edba496a0 con 0x555edba47fa0 2024-03-20T13:37:02.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa43effd640 1 -- 172.21.15.123:0/1133968803 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa54c018430 con 0x555edba47fa0 2024-03-20T13:37:02.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa43effd640 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa430034300 0x7fa4300367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa43effd640 1 -- 172.21.15.123:0/1133968803 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa54c04a5a0 con 0x555edba47fa0 2024-03-20T13:37:02.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa5597e1640 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa430034300 0x7fa4300367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa55bcc6980 1 Processor -- start 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa55bcc6980 1 -- start start 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa5597e1640 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa430034300 0x7fa4300367c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x555edba385a0 tx=0x7fa5540e1fc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa55bcc6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edb93d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa55bcc6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555edb7d5790 con 0x555edb93d120 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa559fe2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edb93d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa559fe2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edb93d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55144/0 (socket says 172.21.15.123:55144) 2024-03-20T13:37:02.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa559fe2640 1 -- 172.21.15.123:0/2515684010 learned_addr learned my addr 172.21.15.123:0/2515684010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.690+0000 7fa559fe2640 1 -- 172.21.15.123:0/2515684010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555edb93b970 con 0x555edb93d120 2024-03-20T13:37:02.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa559fe2640 1 --2- 172.21.15.123:0/2515684010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edb93d540 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa54c048990 tx=0x7fa54c020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3e425471f2d3af server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa43cff9640 1 -- 172.21.15.123:0/2515684010 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c047070 con 0x555edb93d120 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa43cff9640 1 -- 172.21.15.123:0/2515684010 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c022410 con 0x555edb93d120 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa43cff9640 1 -- 172.21.15.123:0/2515684010 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c016330 con 0x555edb93d120 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2515684010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 msgr2=0x555edb93d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2515684010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edb93d540 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa54c048990 tx=0x7fa54c020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2515684010 shutdown_connections 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2515684010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edb93d540 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2515684010 >> 172.21.15.123:0/2515684010 conn(0x555edba51280 msgr2=0x555edba4f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2515684010 shutdown_connections 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2515684010 wait complete. 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 Processor -- start 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- start start 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edba5dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555edba5e530 con 0x555edb93d120 2024-03-20T13:37:02.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa559fe2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edba5dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa559fe2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edba5dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55154/0 (socket says 172.21.15.123:55154) 2024-03-20T13:37:02.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 learned_addr learned my addr 172.21.15.123:0/2922488964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555edba496a0 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa559fe2640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edba5dff0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x555edba50010 tx=0x7fa54c048920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa42effd640 1 -- 172.21.15.123:0/2922488964 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c0186e0 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555edba5e730 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa42effd640 1 -- 172.21.15.123:0/2922488964 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c018840 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555edba5eb60 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.694+0000 7fa42effd640 1 -- 172.21.15.123:0/2922488964 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c018ae0 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa42effd640 1 -- 172.21.15.123:0/2922488964 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa54c047070 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa42effd640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa424034260 0x7fa424036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa42effd640 1 -- 172.21.15.123:0/2922488964 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa54c037020 con 0x555edb93d120 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa5597e1640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa424034260 0x7fa424036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edba69790 0x555edba6bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba6c3a0 con 0x555edba69790 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa558fe0640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edba69790 0x555edba6bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa5597e1640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa424034260 0x7fa424036720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5540b36f0 tx=0x7fa5540de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa558fe0640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edba69790 0x555edba6bc50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 realm 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba68c30 con 0x555edba69790 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba6ce20 con 0x555edba69790 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba6dbb0 0x555edba6ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba70650 con 0x555edba6dbb0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa559fe2640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba6dbb0 0x555edba6ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa559fe2640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba6dbb0 0x555edba6ffa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa54c033070 con 0x555edba6dbb0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.698+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba70e50 con 0x555edba6dbb0 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa54c033070 con 0x555edba6dbb0 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa55bcc6980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa55bcc6980 20 searching for the correct realm 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555edba72eb0 0x555edba75370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa5597e1640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555edba72eb0 0x555edba75370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa5597e1640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555edba72eb0 0x555edba75370 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c033070 con 0x555edba6dbb0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa559fe2640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa54c036020 0x7fa54c02d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x7fa54c036020 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa54c036020 0x7fa54c02d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa54c036020 0x7fa54c02d470 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.702+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c033070 con 0x555edba6dbb0 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c033070 con 0x555edba6dbb0 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x7fa54c036020 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x7fa54c036020 2024-03-20T13:37:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.706+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x7fa54c036020 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba69790 2024-03-20T13:37:02.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x7fa54c036020 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x7fa54c036020 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.710+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba72eb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75a40 con 0x555edba6dbb0 2024-03-20T13:37:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba72440 con 0x555edba69790 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba713c0 con 0x555edba6dbb0 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba71cb0 con 0x555edba69790 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa55000e5a0 con 0x555edba69790 2024-03-20T13:37:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 zone default found 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 4 Realm: () 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 zonegroup default 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba76320 con 0x7fa54c036020 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa55000e5a0 con 0x7fa54c036020 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba75f40 con 0x555edba72eb0 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.714+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba785c0 con 0x555edba72eb0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 20 started sync module instance, tier type = 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba77ad0 con 0x555edba6dbb0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93865900473984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba77ad0 con 0x555edba6dbb0 2024-03-20T13:37:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba78ff0 con 0x555edba69790 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x555edba69790 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93865900477264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba797f0 con 0x555edba69790 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.718+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7a250 con 0x555edba6dbb0 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93865900477264] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x555edba69790 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93865900473984] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93865900471856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba79d40 con 0x555edba6dbb0 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7aaa0 con 0x7fa54c036020 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93865900484096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7aa20 con 0x7fa54c036020 2024-03-20T13:37:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7b940 con 0x555edba6dbb0 2024-03-20T13:37:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.722+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93865900484096] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93865900471856] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93865900479312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7b460 con 0x555edba6dbb0 2024-03-20T13:37:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7c190 con 0x555edba72eb0 2024-03-20T13:37:02.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93865900489968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7b460 con 0x555edba72eb0 2024-03-20T13:37:02.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7cfa0 con 0x555edba72eb0 2024-03-20T13:37:02.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93865900479312] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93865900489968] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93865900492016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7cb00 con 0x555edba72eb0 2024-03-20T13:37:02.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.726+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7d360 con 0x7fa54c036020 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93865900493568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7cf60 con 0x7fa54c036020 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=0 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=1 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=2 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=3 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=4 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=5 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93865900492016] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=6 2024-03-20T13:37:02.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93865900493568] v32'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 20 add_watcher() i=7 2024-03-20T13:37:02.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:02.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ae50 con 0x555edba69790 2024-03-20T13:37:02.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa550043040 con 0x555edba69790 2024-03-20T13:37:02.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.730+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93865900486224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ddc0 con 0x555edba69790 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93865900486224] v32'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa550043040 con 0x555edba69790 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa40f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 5 note: GC not initialized 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa40e7e4640 20 reqs_thread_entry: start 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 Filter name: none 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa37ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edbaa2a50 con 0x555edba72eb0 2024-03-20T13:37:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edbaa1150 con 0x555edba72eb0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:37:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edbaa5410 con 0x555edba72eb0 2024-03-20T13:37:02.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~385] v32'7 uv7 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93865900654400 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edbaa5d80 con 0x7fa54c036020 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== watch-notify(notify (1) cookie 93865900484096 notify 137438953483 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x555edb8894c0 con 0x7fa54c036020 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa43cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93865900484096 notifier 4535 bl.length()=576 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa43cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa43cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(65 notify.3 [notify cookie 93865900654400 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa43cff9640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa41c003ea0 con 0x7fa54c036020 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== watch-notify(notify_complete (2) cookie 93865900654400 notify 137438953483 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa55002e920 con 0x7fa54c036020 2024-03-20T13:37:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.734+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edbaa33d0 con 0x555edba72eb0 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'8 uv8 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa55bcc6980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa55bcc6980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa55bcc6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93865900650288 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edbaa3350 con 0x555edba6dbb0 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 93865900471856 notify 137438953497 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x555edba5eb60 con 0x555edba6dbb0 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa43cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 93865900471856 notifier 4535 bl.length()=192 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa43cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa43cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa43cff9640 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa41c003ea0 con 0x555edba6dbb0 2024-03-20T13:37:02.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(68 notify.2 [notify cookie 93865900650288 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 93865900650288 notify 137438953497 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa54c04e060 con 0x555edba6dbb0 2024-03-20T13:37:02.746 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa40f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.738+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93865900486224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba83100 con 0x555edba69790 2024-03-20T13:37:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.742+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93865900486224] v32'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa550043040 con 0x555edba69790 2024-03-20T13:37:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.742+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93865900473984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ae50 con 0x555edba6dbb0 2024-03-20T13:37:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.742+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93865900473984] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.742+0000 7fa55bcc6980 20 remove_watcher() i=0 2024-03-20T13:37:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.742+0000 7fa55bcc6980 2 removed watcher, disabling cache 2024-03-20T13:37:02.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.742+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93865900477264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ae50 con 0x555edba69790 2024-03-20T13:37:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.746+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93865900477264] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x555edba69790 2024-03-20T13:37:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.746+0000 7fa55bcc6980 20 remove_watcher() i=1 2024-03-20T13:37:02.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.746+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93865900471856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ae50 con 0x555edba6dbb0 2024-03-20T13:37:02.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.746+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93865900471856] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.746+0000 7fa55bcc6980 20 remove_watcher() i=2 2024-03-20T13:37:02.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.746+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93865900484096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba77630 con 0x7fa54c036020 2024-03-20T13:37:02.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93865900484096] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa55bcc6980 20 remove_watcher() i=3 2024-03-20T13:37:02.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93865900479312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ae50 con 0x555edba6dbb0 2024-03-20T13:37:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa559fe2640 1 -- 172.21.15.123:0/2922488964 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93865900479312] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa54c060040 con 0x555edba6dbb0 2024-03-20T13:37:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa55bcc6980 20 remove_watcher() i=4 2024-03-20T13:37:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93865900489968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7a600 con 0x555edba72eb0 2024-03-20T13:37:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93865900489968] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa55bcc6980 20 remove_watcher() i=5 2024-03-20T13:37:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.750+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93865900492016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba79350 con 0x555edba72eb0 2024-03-20T13:37:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa5597e1640 1 -- 172.21.15.123:0/2922488964 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93865900492016] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5540b1040 con 0x555edba72eb0 2024-03-20T13:37:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 20 remove_watcher() i=6 2024-03-20T13:37:02.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93865900493568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555edba7ae50 con 0x7fa54c036020 2024-03-20T13:37:02.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93865900493568] v32'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa550043040 con 0x7fa54c036020 2024-03-20T13:37:02.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 20 remove_watcher() i=7 2024-03-20T13:37:02.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba6dbb0 msgr2=0x555edba6ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba6dbb0 0x555edba6ffa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edba69790 msgr2=0x555edba6bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edba69790 0x555edba6bc50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa54c036020 msgr2=0x7fa54c02d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa54c036020 0x7fa54c02d470 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555edba72eb0 msgr2=0x555edba75370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x555edba72eb0 0x555edba75370 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa424034260 msgr2=0x7fa424036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa424034260 0x7fa424036720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5540b36f0 tx=0x7fa5540de000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 msgr2=0x555edba5dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/2922488964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb93d120 0x555edba5dff0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x555edba50010 tx=0x7fa54c048920 comp rx=0 tx=0).stop 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 reap_dead start 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa558fe0640 1 -- 172.21.15.123:0/2922488964 reap_dead start 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 shutdown_connections 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 >> 172.21.15.123:0/2922488964 conn(0x555edba51280 msgr2=0x555edba4e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 shutdown_connections 2024-03-20T13:37:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/2922488964 wait complete. 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa430034300 msgr2=0x7fa4300367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa430034300 0x7fa4300367c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x555edba385a0 tx=0x7fa5540e1fc0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 msgr2=0x555edba483c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 0x555edba483c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00aae0 tx=0x7fa54c008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 shutdown_connections 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa430034300 0x7fa4300367c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1133968803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edba47fa0 0x555edba483c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 >> 172.21.15.123:0/1133968803 conn(0x555edba3cdb0 msgr2=0x555edba3d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 shutdown_connections 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1133968803 wait complete. 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba355a0 msgr2=0x555edba37990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba355a0 0x555edba37990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edb9400d0 msgr2=0x555edba347f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edb9400d0 0x555edba347f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4400342b0 msgr2=0x7fa440036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4400342b0 0x7fa440036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa550000f70 tx=0x7fa5500012c0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 msgr2=0x555edba2dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba2dc10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa55401b4b0 tx=0x7fa554019810 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 shutdown_connections 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555edba355a0 0x555edba37990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555edb9400d0 0x555edba347f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4400342b0 0x7fa440036770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 --2- 172.21.15.123:0/1136096529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555edb8b1010 0x555edba2dc10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 >> 172.21.15.123:0/1136096529 conn(0x555edb937670 msgr2=0x555edba21580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 shutdown_connections 2024-03-20T13:37:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.754+0000 7fa55bcc6980 1 -- 172.21.15.123:0/1136096529 wait complete. 2024-03-20T13:37:02.770 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:02.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:37:02.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:37:02.770 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-03-20T13:37:02.800 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:02.800 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:02.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f369cc0d980 1 Processor -- start 2024-03-20T13:37:02.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f369cc0d980 1 -- start start 2024-03-20T13:37:02.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f369cc0d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d996b152f0 0x55d996b176e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f369cc0d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d996a5d4c0 con 0x55d996a85850 2024-03-20T13:37:02.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f369cc0d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d996a240f0 con 0x55d996b152f0 2024-03-20T13:37:02.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f3699f27640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d996b152f0 0x55d996b176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f3699f27640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d996b152f0 0x55d996b176e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55164/0 (socket says 172.21.15.123:55164) 2024-03-20T13:37:02.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.794+0000 7f3699f27640 1 -- 172.21.15.123:0/3175939613 learned_addr learned my addr 172.21.15.123:0/3175939613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f3699f27640 1 -- 172.21.15.123:0/3175939613 >> v1:172.21.15.89:6789/0 conn(0x55d996a85850 legacy=0x55d996b13bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f3699f27640 1 -- 172.21.15.123:0/3175939613 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d996b18c60 con 0x55d996b152f0 2024-03-20T13:37:02.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f3699f27640 1 --2- 172.21.15.123:0/3175939613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996b152f0 0x55d996b176e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f369000a5c0 tx=0x7f369001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e267db01971acd4e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f3699726640 1 -- 172.21.15.123:0/3175939613 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36900aa470 con 0x55d996b152f0 2024-03-20T13:37:02.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f3699726640 1 -- 172.21.15.123:0/3175939613 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36900aa5d0 con 0x55d996b152f0 2024-03-20T13:37:02.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f3699726640 1 -- 172.21.15.123:0/3175939613 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36900aa890 con 0x55d996b152f0 2024-03-20T13:37:02.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 -- 172.21.15.123:0/3175939613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996b152f0 msgr2=0x55d996b176e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3175939613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996b152f0 0x55d996b176e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f369000a5c0 tx=0x7f369001b340 comp rx=0 tx=0).stop 2024-03-20T13:37:02.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 -- 172.21.15.123:0/3175939613 shutdown_connections 2024-03-20T13:37:02.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3175939613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996b152f0 0x55d996b176e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 -- 172.21.15.123:0/3175939613 >> 172.21.15.123:0/3175939613 conn(0x55d996b0b6b0 msgr2=0x55d996b0dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 -- 172.21.15.123:0/3175939613 shutdown_connections 2024-03-20T13:37:02.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.798+0000 7f369cc0d980 1 -- 172.21.15.123:0/3175939613 wait complete. 2024-03-20T13:37:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 Processor -- start 2024-03-20T13:37:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- start start 2024-03-20T13:37:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996b11330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d996a21620 con 0x55d996a85850 2024-03-20T13:37:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996b11330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996b11330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55172/0 (socket says 172.21.15.123:55172) 2024-03-20T13:37:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 -- 172.21.15.123:0/614219356 learned_addr learned my addr 172.21.15.123:0/614219356 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 -- 172.21.15.123:0/614219356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690005df0 con 0x55d996a85850 2024-03-20T13:37:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 --2- 172.21.15.123:0/614219356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996b11330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f368c001d60 tx=0x7f368c00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401de60cd55e2d7a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f3588608640 1 -- 172.21.15.123:0/614219356 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f368c014070 con 0x55d996a85850 2024-03-20T13:37:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f3588608640 1 -- 172.21.15.123:0/614219356 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00f540 con 0x55d996a85850 2024-03-20T13:37:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f3588608640 1 -- 172.21.15.123:0/614219356 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f368c00f820 con 0x55d996a85850 2024-03-20T13:37:02.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- 172.21.15.123:0/614219356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 msgr2=0x55d996b11330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 --2- 172.21.15.123:0/614219356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996b11330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f368c001d60 tx=0x7f368c00b5c0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- 172.21.15.123:0/614219356 shutdown_connections 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 --2- 172.21.15.123:0/614219356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996b11330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- 172.21.15.123:0/614219356 >> 172.21.15.123:0/614219356 conn(0x55d996b0b6b0 msgr2=0x55d996bf69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- 172.21.15.123:0/614219356 shutdown_connections 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- 172.21.15.123:0/614219356 wait complete. 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 Processor -- start 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- start start 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996c03d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369cc0d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d996a1ce00 con 0x55d996a85850 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996c03d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996c03d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55176/0 (socket says 172.21.15.123:55176) 2024-03-20T13:37:02.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.814+0000 7f369a728640 1 -- 172.21.15.123:0/3935806234 learned_addr learned my addr 172.21.15.123:0/3935806234 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369a728640 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d996a5d4c0 con 0x55d996a85850 2024-03-20T13:37:02.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369a728640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996c03d10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55d996b10b60 tx=0x7f368c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3586e05640 1 -- 172.21.15.123:0/3935806234 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f368c014050 con 0x55d996a85850 2024-03-20T13:37:02.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d996c04250 con 0x55d996a85850 2024-03-20T13:37:02.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3586e05640 1 -- 172.21.15.123:0/3935806234 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c001300 con 0x55d996a85850 2024-03-20T13:37:02.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d996c046e0 con 0x55d996a85850 2024-03-20T13:37:02.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3586e05640 1 -- 172.21.15.123:0/3935806234 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f368c01bd90 con 0x55d996a85850 2024-03-20T13:37:02.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3586e05640 1 -- 172.21.15.123:0/3935806234 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f368c022020 con 0x55d996a85850 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3586e05640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35800342b0 0x7f3580036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3586e05640 1 -- 172.21.15.123:0/3935806234 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f368c049440 con 0x55d996a85850 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3699f27640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35800342b0 0x7f3580036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996b152f0 0x55d996c0a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c0ae30 con 0x55d996b152f0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369af29640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996b152f0 0x55d996c0a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f3699f27640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35800342b0 0x7f3580036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f36900ae000 tx=0x7f36900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369af29640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996b152f0 0x55d996c0a8f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369af29640 1 -- 172.21.15.123:0/3935806234 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996b152f0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c0b6a0 0x55d996c0da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c0e170 con 0x55d996c0b6a0 2024-03-20T13:37:02.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.818+0000 7f369a728640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c0b6a0 0x55d996c0da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369a728640 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c0b6a0 0x55d996c0da90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369a728640 1 -- 172.21.15.123:0/3935806234 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f368c016070 con 0x55d996c0b6a0 2024-03-20T13:37:02.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c0f9d0 con 0x55d996c0b6a0 2024-03-20T13:37:02.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369a728640 1 -- 172.21.15.123:0/3935806234 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f368c016070 con 0x55d996c0b6a0 2024-03-20T13:37:02.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c0ebd0 con 0x55d996c0b6a0 2024-03-20T13:37:02.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369a728640 1 -- 172.21.15.123:0/3935806234 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f368c016070 con 0x55d996c0b6a0 2024-03-20T13:37:02.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c0efe0 con 0x55d996b152f0 2024-03-20T13:37:02.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369af29640 1 -- 172.21.15.123:0/3935806234 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996b152f0 2024-03-20T13:37:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 Processor -- start 2024-03-20T13:37:02.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 -- start start 2024-03-20T13:37:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 0x55d996c1e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369cc0d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9969b5e30 con 0x55d996c1e0d0 2024-03-20T13:37:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369af29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 0x55d996c1e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369af29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 0x55d996c1e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55180/0 (socket says 172.21.15.123:55180) 2024-03-20T13:37:02.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.822+0000 7f369af29640 1 -- 172.21.15.123:0/487761822 learned_addr learned my addr 172.21.15.123:0/487761822 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369af29640 1 -- 172.21.15.123:0/487761822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d996c1ea30 con 0x55d996c1e0d0 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369af29640 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 0x55d996c1e4f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3694016cf0 tx=0x7f369400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f357ffff640 1 -- 172.21.15.123:0/487761822 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3694017660 con 0x55d996c1e0d0 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f357ffff640 1 -- 172.21.15.123:0/487761822 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940177c0 con 0x55d996c1e0d0 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d996c1ec80 con 0x55d996c1e0d0 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f357ffff640 1 -- 172.21.15.123:0/487761822 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3694017a60 con 0x55d996c1e0d0 2024-03-20T13:37:02.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d996c1f7d0 con 0x55d996c1e0d0 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f357ffff640 1 -- 172.21.15.123:0/487761822 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f369401d020 con 0x55d996c1e0d0 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f357ffff640 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35740342b0 0x7f3574036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f357ffff640 1 -- 172.21.15.123:0/487761822 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f369404b1b0 con 0x55d996c1e0d0 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369a728640 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35740342b0 0x7f3574036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369cc0d980 1 Processor -- start 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369cc0d980 1 -- start start 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369a728640 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35740342b0 0x7f3574036770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d996c0e6d0 tx=0x7f368c025f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369cc0d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c2b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369cc0d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9969a9790 con 0x55d996c2b050 2024-03-20T13:37:02.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369af29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c2b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369af29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c2b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55192/0 (socket says 172.21.15.123:55192) 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369af29640 1 -- 172.21.15.123:0/484177689 learned_addr learned my addr 172.21.15.123:0/484177689 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.826+0000 7f369af29640 1 -- 172.21.15.123:0/484177689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d996c2ba40 con 0x55d996c2b050 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369af29640 1 --2- 172.21.15.123:0/484177689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c2b470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f36940495a0 tx=0x7f3694014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b337c1ff56807de server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f357dffb640 1 -- 172.21.15.123:0/484177689 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f369403b070 con 0x55d996c2b050 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f357dffb640 1 -- 172.21.15.123:0/484177689 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940481d0 con 0x55d996c2b050 2024-03-20T13:37:02.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f357dffb640 1 -- 172.21.15.123:0/484177689 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f369403b300 con 0x55d996c2b050 2024-03-20T13:37:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/484177689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 msgr2=0x55d996c2b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 --2- 172.21.15.123:0/484177689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c2b470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f36940495a0 tx=0x7f3694014740 comp rx=0 tx=0).stop 2024-03-20T13:37:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/484177689 shutdown_connections 2024-03-20T13:37:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 --2- 172.21.15.123:0/484177689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c2b470 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/484177689 >> 172.21.15.123:0/484177689 conn(0x55d996c27390 msgr2=0x55d996c253f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/484177689 shutdown_connections 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/484177689 wait complete. 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 Processor -- start 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- start start 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c31f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d996c32470 con 0x55d996c2b050 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369af29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c31f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369af29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c31f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55200/0 (socket says 172.21.15.123:55200) 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 learned_addr learned my addr 172.21.15.123:0/253439773 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d996c1f7d0 con 0x55d996c2b050 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369af29640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c31f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f369400dce0 tx=0x7f3694049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f356bfff640 1 -- 172.21.15.123:0/253439773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3694011e30 con 0x55d996c2b050 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d996c32670 con 0x55d996c2b050 2024-03-20T13:37:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f356bfff640 1 -- 172.21.15.123:0/253439773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369401fac0 con 0x55d996c2b050 2024-03-20T13:37:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d996c32b00 con 0x55d996c2b050 2024-03-20T13:37:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.830+0000 7f356bfff640 1 -- 172.21.15.123:0/253439773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f369401fda0 con 0x55d996c2b050 2024-03-20T13:37:02.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f356bfff640 1 -- 172.21.15.123:0/253439773 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f36940113d0 con 0x55d996c2b050 2024-03-20T13:37:02.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f356bfff640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3564034350 0x7f3564036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f356bfff640 1 -- 172.21.15.123:0/253439773 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f369404cd70 con 0x55d996c2b050 2024-03-20T13:37:02.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369a728640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3564034350 0x7f3564036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996c3d690 0x55d996c3fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c402a0 con 0x55d996c3d690 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f3699f27640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996c3d690 0x55d996c3fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369a728640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3564034350 0x7f3564036810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55d996c04a20 tx=0x7f368c03b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f3699f27640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996c3d690 0x55d996c3fb50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 realm 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c40690 con 0x55d996c3d690 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c40f10 con 0x55d996c3d690 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c418f0 0x55d996c43d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c44490 con 0x55d996c418f0 2024-03-20T13:37:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369af29640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c418f0 0x55d996c43d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.834+0000 7f369af29640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c418f0 0x55d996c43d20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c44c90 con 0x55d996c418f0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 20 searching for the correct realm 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d996c46c70 0x55d996c49130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369a728640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d996c46c70 0x55d996c49130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369a728640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d996c46c70 0x55d996c49130 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369af29640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3694033070 0x7f3694044020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x7f3694033070 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3694033070 0x7f3694044020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3694033070 0x7f3694044020 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x7f3694033070 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.838+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x7f3694033070 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x7f3694033070 2024-03-20T13:37:02.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x7f3694033070 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f36900b0020 con 0x7f3694033070 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.842+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900b0020 con 0x55d996c3d690 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x7f3694033070 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c3d690 2024-03-20T13:37:02.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x7f3694033070 2024-03-20T13:37:02.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x7f3694033070 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.846+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c46c70 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c49800 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:02.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c461f0 con 0x55d996c3d690 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c451a0 con 0x55d996c418f0 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c451b0 con 0x55d996c3d690 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 zone default found 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 4 Realm: () 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 zonegroup default 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c45ce0 con 0x7f3694033070 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.850+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4bcd0 con 0x55d996c46c70 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4c140 con 0x55d996c46c70 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 20 started sync module instance, tier type = 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:02.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4aff0 con 0x55d996c418f0 2024-03-20T13:37:02.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393025735504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4b3a0 con 0x55d996c418f0 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.854+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4cea0 con 0x55d996c3d690 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393025743360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4d3c0 con 0x55d996c3d690 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4de90 con 0x55d996c418f0 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393025735504] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393025743360] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393025747312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4de50 con 0x55d996c418f0 2024-03-20T13:37:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4cfd0 con 0x7f3694033070 2024-03-20T13:37:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393025749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4eb00 con 0x7f3694033070 2024-03-20T13:37:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.858+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4f4d0 con 0x55d996c418f0 2024-03-20T13:37:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393025749568] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393025747312] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393025753040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4e660 con 0x55d996c418f0 2024-03-20T13:37:02.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4fd20 con 0x55d996c46c70 2024-03-20T13:37:02.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393025755264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c4e660 con 0x55d996c46c70 2024-03-20T13:37:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c50750 con 0x55d996c46c70 2024-03-20T13:37:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393025753040] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393025755264] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393025756320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c502b0 con 0x55d996c46c70 2024-03-20T13:37:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.862+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c50fa0 con 0x7f3694033070 2024-03-20T13:37:02.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393025756320] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393025742176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c502b0 con 0x7f3694033070 2024-03-20T13:37:02.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=0 2024-03-20T13:37:02.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=1 2024-03-20T13:37:02.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=2 2024-03-20T13:37:02.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=3 2024-03-20T13:37:02.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=4 2024-03-20T13:37:02.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=5 2024-03-20T13:37:02.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=6 2024-03-20T13:37:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393025742176] v32'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 20 add_watcher() i=7 2024-03-20T13:37:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c54090 con 0x55d996c3d690 2024-03-20T13:37:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.866+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393025760000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c515a0 con 0x55d996c3d690 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393025760000] v32'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f34cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 5 note: GC not initialized 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f34caffd640 20 reqs_thread_entry: start 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 Filter name: none 2024-03-20T13:37:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f34c8ff9640 20 reqs_thread_entry: start 2024-03-20T13:37:02.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-03-20T13:37:02.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c76180 con 0x55d996c46c70 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=385 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c77cc0 con 0x7f3694033070 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rados->read ofs=0 len=0 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c793c0 con 0x55d996c418f0 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-03-20T13:37:02.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.870+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c7d710 con 0x7f3694033070 2024-03-20T13:37:02.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 8.d 8:b36ff40a:root::.bucket.meta.testx%3amyfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80fd0 con 0x7f3694033070 2024-03-20T13:37:02.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [create,call,writefull 0~371,setxattr (203)] v32'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369cc0d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x7 2024-03-20T13:37:02.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369cc0d980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369cc0d980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-20T13:37:02.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369cc0d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:02.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94393025949200 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c809e0 con 0x55d996c418f0 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== watch-notify(notify (1) cookie 94393025735504 notify 137438953498 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7f3694067040 con 0x55d996c418f0 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f357dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94393025735504 notifier 4542 bl.length()=806 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f357dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x7 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f357dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f357dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f357dffb640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f355c003ea0 con 0x55d996c418f0 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.874+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(67 notify.0 [notify cookie 94393025949200 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify_complete (2) cookie 94393025949200 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d996c32b00 con 0x55d996c418f0 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369cc0d980 20 handle_bi_update(): bucket=testx:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_sources= new_sources= 2024-03-20T13:37:02.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369cc0d980 20 handle_bi_update(): bucket=testx:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential sources added=[] removed=[] 2024-03-20T13:37:02.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369cc0d980 20 handle_bi_update(): bucket=testx:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_dests= new_dests= 2024-03-20T13:37:02.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369cc0d980 20 handle_bi_update(): bucket=testx:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential dests added=[] removed=[] 2024-03-20T13:37:02.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80b40 con 0x55d996c3d690 2024-03-20T13:37:02.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.878+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80b40 con 0x55d996c3d690 2024-03-20T13:37:02.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-03-20T13:37:02.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-03-20T13:37:02.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-03-20T13:37:02.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94393025955488 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80ac0 con 0x55d996c418f0 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== watch-notify(notify (1) cookie 94393025753040 notify 137438953499 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x55d996c32b00 con 0x55d996c418f0 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94393025753040 notifier 4542 bl.length()=348 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357d7fa640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f34d0003400 con 0x55d996c418f0 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(71 notify.4 [notify cookie 94393025955488 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== watch-notify(notify_complete (2) cookie 94393025955488 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d996c32670 con 0x55d996c418f0 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 removing default.rgw.meta+root+myfoo from cache 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94393025955488 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80ac0 con 0x55d996c46c70 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== watch-notify(notify (1) cookie 94393025756320 notify 137438953480 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55d996c046e0 con 0x55d996c46c70 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94393025756320 notifier 4542 bl.length()=149 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357dffb640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f355c003ea0 con 0x55d996c46c70 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 notify.6 [notify cookie 94393025955488 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== watch-notify(notify_complete (2) cookie 94393025955488 notify 137438953480 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d996c04250 con 0x55d996c46c70 2024-03-20T13:37:02.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80b00 con 0x7f3694033070 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(75 myfoo [call,delete] v32'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 from cache 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [notify cookie 94393025927280 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80b00 con 0x55d996c3d690 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== watch-notify(notify (1) cookie 94393025743360 notify 137438953475 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f36900d0040 con 0x55d996c3d690 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94393025743360 notifier 4542 bl.length()=206 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f357d7fa640 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f34d0003400 con 0x55d996c3d690 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.882+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 notify.1 [notify cookie 94393025927280 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.886+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== watch-notify(notify_complete (2) cookie 94393025927280 notify 137438953475 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f36900b9070 con 0x55d996c3d690 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.886+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(77 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.886+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c80660 con 0x55d996c418f0 2024-03-20T13:37:02.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.886+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(78 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call,delete] v32'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.886+0000 7f34cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:02.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.886+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393025760000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c53fa0 con 0x55d996c3d690 2024-03-20T13:37:02.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.890+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94393025760000] v32'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.890+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393025735504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c53fa0 con 0x55d996c418f0 2024-03-20T13:37:02.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.890+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94393025735504] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.890+0000 7f369cc0d980 20 remove_watcher() i=0 2024-03-20T13:37:02.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.890+0000 7f369cc0d980 2 removed watcher, disabling cache 2024-03-20T13:37:02.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.890+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393025743360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c53fa0 con 0x55d996c3d690 2024-03-20T13:37:02.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94393025743360] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x55d996c3d690 2024-03-20T13:37:02.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369cc0d980 20 remove_watcher() i=1 2024-03-20T13:37:02.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393025747312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c78de0 con 0x55d996c418f0 2024-03-20T13:37:02.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94393025747312] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369cc0d980 20 remove_watcher() i=2 2024-03-20T13:37:02.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393025749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c78de0 con 0x7f3694033070 2024-03-20T13:37:02.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94393025749568] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369cc0d980 20 remove_watcher() i=3 2024-03-20T13:37:02.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.894+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393025753040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c78de0 con 0x55d996c418f0 2024-03-20T13:37:02.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369af29640 1 -- 172.21.15.123:0/253439773 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94393025753040] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f369400a4d0 con 0x55d996c418f0 2024-03-20T13:37:02.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369cc0d980 20 remove_watcher() i=4 2024-03-20T13:37:02.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393025755264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c78de0 con 0x55d996c46c70 2024-03-20T13:37:02.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94393025755264] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369cc0d980 20 remove_watcher() i=5 2024-03-20T13:37:02.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393025756320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c78de0 con 0x55d996c46c70 2024-03-20T13:37:02.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369a728640 1 -- 172.21.15.123:0/253439773 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94393025756320] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f368c016070 con 0x55d996c46c70 2024-03-20T13:37:02.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369cc0d980 20 remove_watcher() i=6 2024-03-20T13:37:02.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.898+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393025742176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d996c78de0 con 0x7f3694033070 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94393025742176] v32'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36900d5060 con 0x7f3694033070 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 20 remove_watcher() i=7 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c418f0 msgr2=0x55d996c43d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c418f0 0x55d996c43d20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996c3d690 msgr2=0x55d996c3fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996c3d690 0x55d996c3fb50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3694033070 msgr2=0x7f3694044020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3694033070 0x7f3694044020 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d996c46c70 msgr2=0x55d996c49130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55d996c46c70 0x55d996c49130 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3564034350 msgr2=0x7f3564036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3564034350 0x7f3564036810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55d996c04a20 tx=0x7f368c03b000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f3699f27640 1 -- 172.21.15.123:0/253439773 reap_dead start 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 msgr2=0x55d996c31f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c31f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f369400dce0 tx=0x7f3694049530 comp rx=0 tx=0).stop 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 shutdown_connections 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/253439773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c2b050 0x55d996c31f30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 >> 172.21.15.123:0/253439773 conn(0x55d996c27390 msgr2=0x55d996c249f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 shutdown_connections 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/253439773 wait complete. 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35740342b0 msgr2=0x7f3574036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35740342b0 0x7f3574036770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d996c0e6d0 tx=0x7f368c025f90 comp rx=0 tx=0).stop 2024-03-20T13:37:02.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 msgr2=0x55d996c1e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 0x55d996c1e4f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3694016cf0 tx=0x7f369400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 shutdown_connections 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35740342b0 0x7f3574036770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/487761822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996c1e0d0 0x55d996c1e4f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 >> 172.21.15.123:0/487761822 conn(0x55d996c12ee0 msgr2=0x55d996c139f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 shutdown_connections 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/487761822 wait complete. 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c0b6a0 msgr2=0x55d996c0da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c0b6a0 0x55d996c0da90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996b152f0 msgr2=0x55d996c0a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996b152f0 0x55d996c0a8f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35800342b0 msgr2=0x7f3580036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35800342b0 0x7f3580036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f36900ae000 tx=0x7f36900a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 msgr2=0x55d996c03d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996c03d10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55d996b10b60 tx=0x7f368c000ee0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 shutdown_connections 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55d996c0b6a0 0x55d996c0da90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55d996b152f0 0x55d996c0a8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35800342b0 0x7f3580036770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 --2- 172.21.15.123:0/3935806234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d996a85850 0x55d996c03d10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 >> 172.21.15.123:0/3935806234 conn(0x55d996b0b6b0 msgr2=0x55d996b0fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 shutdown_connections 2024-03-20T13:37:02.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.902+0000 7f369cc0d980 1 -- 172.21.15.123:0/3935806234 wait complete. 2024-03-20T13:37:02.919 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-03-20T13:37:02.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-03-20T13:37:02.920 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-03-20T13:37:02.993 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f390bb98980 1 Processor -- start 2024-03-20T13:37:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f390bb98980 1 -- start start 2024-03-20T13:37:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f390bb98980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558810142690 0x5588101d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f390bb98980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558810119520 con 0x558810143980 2024-03-20T13:37:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f390bb98980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5588100e00f0 con 0x558810142690 2024-03-20T13:37:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f3908eb2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558810142690 0x5588101d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:02.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f39096b3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558810143980 0x558810141f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59248/0 (socket says 172.21.15.123:59248) 2024-03-20T13:37:02.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f3908eb2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558810142690 0x5588101d5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55204/0 (socket says 172.21.15.123:55204) 2024-03-20T13:37:02.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f39096b3640 1 -- 172.21.15.123:0/4284923069 learned_addr learned my addr 172.21.15.123:0/4284923069 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:02.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f3908eb2640 1 -- 172.21.15.123:0/4284923069 >> v1:172.21.15.89:6789/0 conn(0x558810143980 legacy=0x558810141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f3908eb2640 1 -- 172.21.15.123:0/4284923069 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558810142aa0 con 0x558810142690 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.990+0000 7f3908eb2640 1 --2- 172.21.15.123:0/4284923069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588101d5f90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f390000a480 tx=0x7f390001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1219d40074aa61 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f38fbfff640 1 -- 172.21.15.123:0/4284923069 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39000aa530 con 0x558810142690 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f38fbfff640 1 -- 172.21.15.123:0/4284923069 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000a6050 con 0x558810142690 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f38fbfff640 1 -- 172.21.15.123:0/4284923069 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39000aa7e0 con 0x558810142690 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 -- 172.21.15.123:0/4284923069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 msgr2=0x5588101d5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 --2- 172.21.15.123:0/4284923069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588101d5f90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f390000a480 tx=0x7f390001b280 comp rx=0 tx=0).stop 2024-03-20T13:37:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 -- 172.21.15.123:0/4284923069 shutdown_connections 2024-03-20T13:37:03.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 --2- 172.21.15.123:0/4284923069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588101d5f90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 -- 172.21.15.123:0/4284923069 >> 172.21.15.123:0/4284923069 conn(0x5588101c8850 msgr2=0x5588101cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 -- 172.21.15.123:0/4284923069 shutdown_connections 2024-03-20T13:37:03.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:02.994+0000 7f390bb98980 1 -- 172.21.15.123:0/4284923069 wait complete. 2024-03-20T13:37:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f390bb98980 1 Processor -- start 2024-03-20T13:37:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f390bb98980 1 -- start start 2024-03-20T13:37:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f390bb98980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f390bb98980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588100dd620 con 0x558810142690 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f39096b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f39096b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55216/0 (socket says 172.21.15.123:55216) 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f39096b3640 1 -- 172.21.15.123:0/1291919527 learned_addr learned my addr 172.21.15.123:0/1291919527 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f39096b3640 1 -- 172.21.15.123:0/1291919527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900005d30 con 0x558810142690 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f39096b3640 1 --2- 172.21.15.123:0/1291919527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102b9350 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f38fc001c00 tx=0x7f38fc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d00686c17a56a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f37f7606640 1 -- 172.21.15.123:0/1291919527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38fc00e690 con 0x558810142690 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.006+0000 7f37f7606640 1 -- 172.21.15.123:0/1291919527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc00e810 con 0x558810142690 2024-03-20T13:37:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f37f7606640 1 -- 172.21.15.123:0/1291919527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38fc00eb30 con 0x558810142690 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/1291919527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 msgr2=0x5588102b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 --2- 172.21.15.123:0/1291919527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102b9350 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f38fc001c00 tx=0x7f38fc00b6d0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/1291919527 shutdown_connections 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 --2- 172.21.15.123:0/1291919527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102b9350 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/1291919527 >> 172.21.15.123:0/1291919527 conn(0x5588101c8850 msgr2=0x5588102b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/1291919527 shutdown_connections 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/1291919527 wait complete. 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 Processor -- start 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- start start 2024-03-20T13:37:03.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588100d8e00 con 0x558810142690 2024-03-20T13:37:03.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f39096b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f39096b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102c01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55222/0 (socket says 172.21.15.123:55222) 2024-03-20T13:37:03.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f39096b3640 1 -- 172.21.15.123:0/2213956847 learned_addr learned my addr 172.21.15.123:0/2213956847 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f39096b3640 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558810119520 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f39096b3640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102c01a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b710 tx=0x7f38fc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f37f5e03640 1 -- 172.21.15.123:0/2213956847 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38fc01f070 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588102c06e0 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f37f5e03640 1 -- 172.21.15.123:0/2213956847 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc01a910 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f37f5e03640 1 -- 172.21.15.123:0/2213956847 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38fc01abf0 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588102c0b10 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.010+0000 7f37f5e03640 1 -- 172.21.15.123:0/2213956847 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f38fc00a040 con 0x558810142690 2024-03-20T13:37:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f37f5e03640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37f00342b0 0x7f37f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f37f5e03640 1 -- 172.21.15.123:0/2213956847 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f38fc049f60 con 0x558810142690 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f3908eb2640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37f00342b0 0x7f37f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558810143980 0x5588102c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102c7360 con 0x558810143980 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f3909eb4640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558810143980 0x5588102c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f3908eb2640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37f00342b0 0x7f37f0036770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39000ac000 tx=0x7f39000a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f3909eb4640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558810143980 0x5588102c6e20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f3909eb4640 1 -- 172.21.15.123:0/2213956847 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x558810143980 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102c7bd0 0x5588102c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102ca730 con 0x5588102c7bd0 2024-03-20T13:37:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f39096b3640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102c7bd0 0x5588102c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f39096b3640 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102c7bd0 0x5588102c9fc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f39096b3640 1 -- 172.21.15.123:0/2213956847 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f38fc017900 con 0x5588102c7bd0 2024-03-20T13:37:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102cbf90 con 0x5588102c7bd0 2024-03-20T13:37:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f39096b3640 1 -- 172.21.15.123:0/2213956847 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f38fc017900 con 0x5588102c7bd0 2024-03-20T13:37:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.014+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102cb0d0 con 0x5588102c7bd0 2024-03-20T13:37:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f39096b3640 1 -- 172.21.15.123:0/2213956847 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f38fc017900 con 0x5588102c7bd0 2024-03-20T13:37:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102cb4e0 con 0x558810143980 2024-03-20T13:37:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f3909eb4640 1 -- 172.21.15.123:0/2213956847 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f390400a4d0 con 0x558810143980 2024-03-20T13:37:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 Processor -- start 2024-03-20T13:37:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 -- start start 2024-03-20T13:37:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 0x5588102daaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558810071e30 con 0x5588102da6d0 2024-03-20T13:37:03.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f3909eb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 0x5588102daaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f3909eb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 0x5588102daaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55232/0 (socket says 172.21.15.123:55232) 2024-03-20T13:37:03.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f3909eb4640 1 -- 172.21.15.123:0/2415619260 learned_addr learned my addr 172.21.15.123:0/2415619260 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f3909eb4640 1 -- 172.21.15.123:0/2415619260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588102db030 con 0x5588102da6d0 2024-03-20T13:37:03.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f3909eb4640 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 0x5588102daaf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3904016cf0 tx=0x7f390400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f37eeffd640 1 -- 172.21.15.123:0/2415619260 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3904017660 con 0x5588102da6d0 2024-03-20T13:37:03.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588102db280 con 0x5588102da6d0 2024-03-20T13:37:03.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f37eeffd640 1 -- 172.21.15.123:0/2415619260 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040177c0 con 0x5588102da6d0 2024-03-20T13:37:03.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f37eeffd640 1 -- 172.21.15.123:0/2415619260 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3904017a60 con 0x5588102da6d0 2024-03-20T13:37:03.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.018+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588102dbdd0 con 0x5588102da6d0 2024-03-20T13:37:03.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f37eeffd640 1 -- 172.21.15.123:0/2415619260 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f390401d020 con 0x5588102da6d0 2024-03-20T13:37:03.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f37eeffd640 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37e00342b0 0x7f37e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f37eeffd640 1 -- 172.21.15.123:0/2415619260 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f390404b550 con 0x5588102da6d0 2024-03-20T13:37:03.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f39096b3640 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37e00342b0 0x7f37e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 Processor -- start 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f39096b3640 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37e00342b0 0x7f37e0036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5588102cabd0 tx=0x7f38fc023eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- start start 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558810065790 con 0x5588102e7650 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f3909eb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f3909eb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55234/0 (socket says 172.21.15.123:55234) 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f3909eb4640 1 -- 172.21.15.123:0/1544461237 learned_addr learned my addr 172.21.15.123:0/1544461237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f3909eb4640 1 -- 172.21.15.123:0/1544461237 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588102e8040 con 0x5588102e7650 2024-03-20T13:37:03.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f3909eb4640 1 --2- 172.21.15.123:0/1544461237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102e7a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3904049970 tx=0x7f3904011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54385c14af6aba0f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f37ecff9640 1 -- 172.21.15.123:0/1544461237 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3904020510 con 0x5588102e7650 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f37ecff9640 1 -- 172.21.15.123:0/1544461237 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904040030 con 0x5588102e7650 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f37ecff9640 1 -- 172.21.15.123:0/1544461237 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3904017bc0 con 0x5588102e7650 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- 172.21.15.123:0/1544461237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 msgr2=0x5588102e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 --2- 172.21.15.123:0/1544461237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102e7a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3904049970 tx=0x7f3904011ad0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- 172.21.15.123:0/1544461237 shutdown_connections 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 --2- 172.21.15.123:0/1544461237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102e7a70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- 172.21.15.123:0/1544461237 >> 172.21.15.123:0/1544461237 conn(0x5588102e3990 msgr2=0x5588102e19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- 172.21.15.123:0/1544461237 shutdown_connections 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- 172.21.15.123:0/1544461237 wait complete. 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 Processor -- start 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- start start 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.022+0000 7f390bb98980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588102eea40 con 0x5588102e7650 2024-03-20T13:37:03.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3909eb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3909eb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102ee500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55248/0 (socket says 172.21.15.123:55248) 2024-03-20T13:37:03.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 learned_addr learned my addr 172.21.15.123:0/717922271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588102dbdd0 con 0x5588102e7650 2024-03-20T13:37:03.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3909eb4640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102ee500 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f390400dce0 tx=0x7f39040498d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f37deffd640 1 -- 172.21.15.123:0/717922271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3904030070 con 0x5588102e7650 2024-03-20T13:37:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588102eec40 con 0x5588102e7650 2024-03-20T13:37:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f37deffd640 1 -- 172.21.15.123:0/717922271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040484a0 con 0x5588102e7650 2024-03-20T13:37:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f37deffd640 1 -- 172.21.15.123:0/717922271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3904029580 con 0x5588102e7650 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588102ef070 con 0x5588102e7650 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f37deffd640 1 -- 172.21.15.123:0/717922271 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f39040296e0 con 0x5588102e7650 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f37deffd640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37d40342b0 0x7f37d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f37deffd640 1 -- 172.21.15.123:0/717922271 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3904037c90 con 0x5588102e7650 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f39096b3640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37d40342b0 0x7f37d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5588102f9bd0 0x5588102fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102fc7c0 con 0x5588102f9bd0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3908eb2640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5588102f9bd0 0x5588102fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f39096b3640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37d40342b0 0x7f37d4036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38fc04a290 tx=0x7f38fc023f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3908eb2640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5588102f9bd0 0x5588102fc070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f39000aaaa0 con 0x5588102f9bd0 2024-03-20T13:37:03.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 realm 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102fcbb0 con 0x5588102f9bd0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f39000aaaa0 con 0x5588102f9bd0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102fd400 con 0x5588102f9bd0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f39000aaaa0 con 0x5588102f9bd0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102fdde0 0x558810300210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.026+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810300980 con 0x5588102fdde0 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102fdde0 0x558810300210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102fdde0 0x558810300210 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 20 searching for the correct realm 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558810302ef0 0x5588103052e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103058c0 con 0x558810302ef0 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f39096b3640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558810302ef0 0x5588103052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f39096b3640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558810302ef0 0x5588103052e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103058c0 con 0x5588102fdde0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f39040135d0 0x7f390403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x7f39040135d0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.030+0000 7f3908eb2640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f39040135d0 0x7f390403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f39040135d0 0x7f390403b050 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000aaaa0 con 0x7f39040135d0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x558810302ef0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x7f39040135d0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x7f39040135d0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x7f39040135d0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f39000c7040 con 0x7f39040135d0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.034+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x558810302ef0 2024-03-20T13:37:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x558810302ef0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000c7040 con 0x5588102f9bd0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x558810302ef0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x7f39040135d0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102f9bd0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x7f39040135d0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x558810302ef0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x7f39040135d0 2024-03-20T13:37:03.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.038+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x558810302ef0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103011d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103019d0 con 0x5588102f9bd0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810301d80 con 0x5588102fdde0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810301d80 con 0x5588102f9bd0 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 zone default found 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 4 Realm: () 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 zonegroup default 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810302600 con 0x7f39040135d0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.042+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810307bb0 con 0x558810302ef0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810307f10 con 0x558810302ef0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 20 started sync module instance, tier type = 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:03.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810307180 con 0x5588102fdde0 2024-03-20T13:37:03.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94042875524400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810307180 con 0x5588102fdde0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810308880 con 0x5588102f9bd0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94042875528160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810308ca0 con 0x5588102f9bd0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.046+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810309740 con 0x5588102fdde0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.050+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94042875524400] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.050+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94042875528160] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.050+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.050+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94042875531808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810308800 con 0x5588102fdde0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.050+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810309f90 con 0x7f39040135d0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94042875534064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810308800 con 0x7f39040135d0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030aa80 con 0x5588102fdde0 2024-03-20T13:37:03.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94042875531808] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94042875534064] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94042875536768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030aa40 con 0x5588102fdde0 2024-03-20T13:37:03.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.054+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030ae30 con 0x558810302ef0 2024-03-20T13:37:03.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.058+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.058+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94042875535120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030b680 con 0x558810302ef0 2024-03-20T13:37:03.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.058+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030c050 con 0x558810302ef0 2024-03-20T13:37:03.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.058+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94042875536768] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94042875535120] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94042875542352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030b1e0 con 0x558810302ef0 2024-03-20T13:37:03.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030c8a0 con 0x7f39040135d0 2024-03-20T13:37:03.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94042875542352] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.062+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94042875522272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030b1e0 con 0x7f39040135d0 2024-03-20T13:37:03.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=0 2024-03-20T13:37:03.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=1 2024-03-20T13:37:03.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=2 2024-03-20T13:37:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=3 2024-03-20T13:37:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=4 2024-03-20T13:37:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=5 2024-03-20T13:37:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=6 2024-03-20T13:37:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94042875522272] v32'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 add_watcher() i=7 2024-03-20T13:37:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030fb00 con 0x5588102f9bd0 2024-03-20T13:37:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94042875544576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030ce50 con 0x5588102f9bd0 2024-03-20T13:37:03.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94042875544576] v32'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f37bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.066+0000 7f390bb98980 5 note: GC not initialized 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f37befe5640 20 reqs_thread_entry: start 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f390bb98980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f390bb98980 20 Filter name: none 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f37bcfe1640 20 reqs_thread_entry: start 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f390bb98980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810331260 con 0x5588102f9bd0 2024-03-20T13:37:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f390bb98980 20 rados_obj.operate() r=0 bl.length=193 2024-03-20T13:37:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f37bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.070+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94042875544576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588102f3820 con 0x5588102f9bd0 2024-03-20T13:37:03.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94042875544576] v32'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94042875524400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030c400 con 0x5588102fdde0 2024-03-20T13:37:03.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94042875524400] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f390bb98980 20 remove_watcher() i=0 2024-03-20T13:37:03.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f390bb98980 2 removed watcher, disabling cache 2024-03-20T13:37:03.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94042875528160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810307530 con 0x5588102f9bd0 2024-03-20T13:37:03.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94042875528160] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x5588102f9bd0 2024-03-20T13:37:03.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f390bb98980 20 remove_watcher() i=1 2024-03-20T13:37:03.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.074+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94042875531808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103083e0 con 0x5588102fdde0 2024-03-20T13:37:03.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.078+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94042875531808] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.078+0000 7f390bb98980 20 remove_watcher() i=2 2024-03-20T13:37:03.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.078+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94042875534064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103083e0 con 0x7f39040135d0 2024-03-20T13:37:03.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.078+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94042875534064] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.078+0000 7f390bb98980 20 remove_watcher() i=3 2024-03-20T13:37:03.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.078+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94042875536768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558810309af0 con 0x5588102fdde0 2024-03-20T13:37:03.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f3909eb4640 1 -- 172.21.15.123:0/717922271 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94042875536768] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f390400a4d0 con 0x5588102fdde0 2024-03-20T13:37:03.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 20 remove_watcher() i=4 2024-03-20T13:37:03.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94042875535120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103083e0 con 0x558810302ef0 2024-03-20T13:37:03.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94042875535120] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 20 remove_watcher() i=5 2024-03-20T13:37:03.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94042875542352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5588103083e0 con 0x558810302ef0 2024-03-20T13:37:03.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f39096b3640 1 -- 172.21.15.123:0/717922271 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94042875542352] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38fc017900 con 0x558810302ef0 2024-03-20T13:37:03.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 20 remove_watcher() i=6 2024-03-20T13:37:03.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94042875522272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55881030bb50 con 0x7f39040135d0 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94042875522272] v32'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f39000d4060 con 0x7f39040135d0 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.082+0000 7f390bb98980 20 remove_watcher() i=7 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102fdde0 msgr2=0x558810300210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102fdde0 0x558810300210 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5588102f9bd0 msgr2=0x5588102fc070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5588102f9bd0 0x5588102fc070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f39040135d0 msgr2=0x7f390403b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f39040135d0 0x7f390403b050 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558810302ef0 msgr2=0x5588103052e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x558810302ef0 0x5588103052e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37d40342b0 msgr2=0x7f37d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37d40342b0 0x7f37d4036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38fc04a290 tx=0x7f38fc023f60 comp rx=0 tx=0).stop 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 msgr2=0x5588102ee500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f3908eb2640 1 -- 172.21.15.123:0/717922271 reap_dead start 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102ee500 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f390400dce0 tx=0x7f39040498d0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 shutdown_connections 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/717922271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102e7650 0x5588102ee500 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 >> 172.21.15.123:0/717922271 conn(0x5588102e3990 msgr2=0x5588102e0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 shutdown_connections 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/717922271 wait complete. 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37e00342b0 msgr2=0x7f37e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37e00342b0 0x7f37e0036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5588102cabd0 tx=0x7f38fc023eb0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 msgr2=0x5588102daaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 0x5588102daaf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3904016cf0 tx=0x7f390400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 shutdown_connections 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37e00342b0 0x7f37e0036770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2415619260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588102da6d0 0x5588102daaf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 >> 172.21.15.123:0/2415619260 conn(0x5588102cf4e0 msgr2=0x5588102cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 shutdown_connections 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2415619260 wait complete. 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102c7bd0 msgr2=0x5588102c9fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102c7bd0 0x5588102c9fc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558810143980 msgr2=0x5588102c6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558810143980 0x5588102c6e20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37f00342b0 msgr2=0x7f37f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37f00342b0 0x7f37f0036770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39000ac000 tx=0x7f39000a5000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 msgr2=0x5588102c01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102c01a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b710 tx=0x7f38fc000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 shutdown_connections 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5588102c7bd0 0x5588102c9fc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x558810143980 0x5588102c6e20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f37f00342b0 0x7f37f0036770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 --2- 172.21.15.123:0/2213956847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558810142690 0x5588102c01a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 >> 172.21.15.123:0/2213956847 conn(0x5588101c8850 msgr2=0x5588102b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 shutdown_connections 2024-03-20T13:37:03.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.086+0000 7f390bb98980 1 -- 172.21.15.123:0/2213956847 wait complete. 2024-03-20T13:37:03.100 INFO:teuthology.orchestra.run.smithi123.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"+RY8C+55SKv1AWXWvE5WFqjG","ver":2},"mtime":"2024-03-20T13:37:02.883987Z","data":{"bucket":{"name":"myfoo","marker":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","bucket_id":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-03-20T13:36:59.684227Z","linked":true,"has_bucket_info":false}} 2024-03-20T13:37:03.100 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '+RY8C+55SKv1AWXWvE5WFqjG', 'ver': 2}, 'mtime': '2024-03-20T13:37:02.883987Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'bucket_id': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-03-20T13:36:59.684227Z', 'linked': True, 'has_bucket_info': False}} 2024-03-20T13:37:03.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-03-20T13:37:03.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-03-20T13:37:03.101 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-03-20T13:37:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc179685980 1 Processor -- start 2024-03-20T13:37:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc179685980 1 -- start start 2024-03-20T13:37:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc179685980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557f566f52e0 0x557f566f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc179685980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557f5663d4c0 con 0x557f566650c0 2024-03-20T13:37:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc179685980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557f566040f0 con 0x557f566f52e0 2024-03-20T13:37:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc17699f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557f566f52e0 0x557f566f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc17699f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557f566f52e0 0x557f566f76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55254/0 (socket says 172.21.15.123:55254) 2024-03-20T13:37:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc17699f640 1 -- 172.21.15.123:0/1733428256 learned_addr learned my addr 172.21.15.123:0/1733428256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc17699f640 1 -- 172.21.15.123:0/1733428256 >> v1:172.21.15.89:6789/0 conn(0x557f566650c0 legacy=0x557f566f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.166+0000 7fc17699f640 1 -- 172.21.15.123:0/1733428256 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f566f8ce0 con 0x557f566f52e0 2024-03-20T13:37:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc17699f640 1 --2- 172.21.15.123:0/1733428256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f76d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00a5c0 tx=0x7fc16c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a20f28689a2a37c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc17619e640 1 -- 172.21.15.123:0/1733428256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc16c0aa470 con 0x557f566f52e0 2024-03-20T13:37:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc17619e640 1 -- 172.21.15.123:0/1733428256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0aa5d0 con 0x557f566f52e0 2024-03-20T13:37:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc17619e640 1 -- 172.21.15.123:0/1733428256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc16c0aa890 con 0x557f566f52e0 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 -- 172.21.15.123:0/1733428256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 msgr2=0x557f566f76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 --2- 172.21.15.123:0/1733428256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f76d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00a5c0 tx=0x7fc16c01b340 comp rx=0 tx=0).stop 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 -- 172.21.15.123:0/1733428256 shutdown_connections 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 --2- 172.21.15.123:0/1733428256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f76d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 -- 172.21.15.123:0/1733428256 >> 172.21.15.123:0/1733428256 conn(0x557f566eb6e0 msgr2=0x557f566edb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 -- 172.21.15.123:0/1733428256 shutdown_connections 2024-03-20T13:37:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.170+0000 7fc179685980 1 -- 172.21.15.123:0/1733428256 wait complete. 2024-03-20T13:37:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc179685980 1 Processor -- start 2024-03-20T13:37:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc179685980 1 -- start start 2024-03-20T13:37:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc179685980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 0x557f567daee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc179685980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f56601620 con 0x557f566650c0 2024-03-20T13:37:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc1771a0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 0x557f567daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc1771a0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 0x557f567daee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55260/0 (socket says 172.21.15.123:55260) 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc1771a0640 1 -- 172.21.15.123:0/2836399232 learned_addr learned my addr 172.21.15.123:0/2836399232 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.182+0000 7fc1771a0640 1 -- 172.21.15.123:0/2836399232 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c005df0 con 0x557f566650c0 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2836399232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 0x557f567daee0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc168001d10 tx=0x7fc16800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0aea437b08a174 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc06560a640 1 -- 172.21.15.123:0/2836399232 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc168014070 con 0x557f566650c0 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc06560a640 1 -- 172.21.15.123:0/2836399232 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16800f560 con 0x557f566650c0 2024-03-20T13:37:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc06560a640 1 -- 172.21.15.123:0/2836399232 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc16800f840 con 0x557f566650c0 2024-03-20T13:37:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2836399232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 msgr2=0x557f567daee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 --2- 172.21.15.123:0/2836399232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 0x557f567daee0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc168001d10 tx=0x7fc16800b5c0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2836399232 shutdown_connections 2024-03-20T13:37:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 --2- 172.21.15.123:0/2836399232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566650c0 0x557f567daee0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2836399232 >> 172.21.15.123:0/2836399232 conn(0x557f566eb6e0 msgr2=0x557f567d6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2836399232 shutdown_connections 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2836399232 wait complete. 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 Processor -- start 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- start start 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f565fce00 con 0x557f566f52e0 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc1771a0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc1771a0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55270/0 (socket says 172.21.15.123:55270) 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc1771a0640 1 -- 172.21.15.123:0/2796643979 learned_addr learned my addr 172.21.15.123:0/2796643979 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc1771a0640 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f5663d4c0 con 0x557f566f52e0 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f12d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc168002000 tx=0x7fc168000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc063e07640 1 -- 172.21.15.123:0/2796643979 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc168014050 con 0x557f566f52e0 2024-03-20T13:37:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f566f1810 con 0x557f566f52e0 2024-03-20T13:37:03.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc063e07640 1 -- 172.21.15.123:0/2796643979 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16800fe70 con 0x557f566f52e0 2024-03-20T13:37:03.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc063e07640 1 -- 172.21.15.123:0/2796643979 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc16801b8e0 con 0x557f566f52e0 2024-03-20T13:37:03.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.186+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f566efd00 con 0x557f566f52e0 2024-03-20T13:37:03.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc063e07640 1 -- 172.21.15.123:0/2796643979 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc168022020 con 0x557f566f52e0 2024-03-20T13:37:03.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc063e07640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc05c0342b0 0x7fc05c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc063e07640 1 -- 172.21.15.123:0/2796643979 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc168048b20 con 0x557f566f52e0 2024-03-20T13:37:03.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc17699f640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc05c0342b0 0x7fc05c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f567e8f50 0x557f567eb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f567eb880 con 0x557f567e8f50 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1779a1640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f567e8f50 0x557f567eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc17699f640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc05c0342b0 0x7fc05c036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0ae000 tx=0x7fc16c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1779a1640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f567e8f50 0x557f567eb340 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1779a1640 1 -- 172.21.15.123:0/2796643979 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f567e8f50 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f567ec0f0 0x557f567ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f567eeab0 con 0x557f567ec0f0 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f567ec0f0 0x557f567ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f567ec0f0 0x557f567ee4e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1771a0640 1 -- 172.21.15.123:0/2796643979 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc168016070 con 0x557f567ec0f0 2024-03-20T13:37:03.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f567f02c0 con 0x557f567ec0f0 2024-03-20T13:37:03.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc1771a0640 1 -- 172.21.15.123:0/2796643979 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc168016070 con 0x557f567ec0f0 2024-03-20T13:37:03.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.190+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f567ef4c0 con 0x557f567ec0f0 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1771a0640 1 -- 172.21.15.123:0/2796643979 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc168016070 con 0x557f567ec0f0 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f567ef820 con 0x557f567e8f50 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1779a1640 1 -- 172.21.15.123:0/2796643979 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f567e8f50 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 Processor -- start 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 -- start start 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 0x557f567fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f56595e30 con 0x557f567fe9a0 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1779a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 0x557f567fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1779a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 0x557f567fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55274/0 (socket says 172.21.15.123:55274) 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1779a1640 1 -- 172.21.15.123:0/608731749 learned_addr learned my addr 172.21.15.123:0/608731749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1779a1640 1 -- 172.21.15.123:0/608731749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f567ff300 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc1779a1640 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 0x557f567fedc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc170016cf0 tx=0x7fc17000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc061602640 1 -- 172.21.15.123:0/608731749 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc170017660 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f567ff550 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f568000a0 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc061602640 1 -- 172.21.15.123:0/608731749 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700177c0 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.194+0000 7fc061602640 1 -- 172.21.15.123:0/608731749 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc170017a60 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc061602640 1 -- 172.21.15.123:0/608731749 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc17001d020 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc061602640 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc050034300 0x7fc0500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc061602640 1 -- 172.21.15.123:0/608731749 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc17004b530 con 0x557f567fe9a0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1771a0640 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc050034300 0x7fc0500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 Processor -- start 2024-03-20T13:37:03.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- start start 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1771a0640 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc050034300 0x7fc0500367c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x557f567eefc0 tx=0x7fc16800e4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f5680bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f56589790 con 0x557f5680b8e0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f5680bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f5680bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55286/0 (socket says 172.21.15.123:55286) 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 -- 172.21.15.123:0/1669535133 learned_addr learned my addr 172.21.15.123:0/1669535133 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 -- 172.21.15.123:0/1669535133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f5680c2d0 con 0x557f5680b8e0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 --2- 172.21.15.123:0/1669535133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f5680bd00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc17000a100 tx=0x7fc170020510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee033de0759e915 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc05affd640 1 -- 172.21.15.123:0/1669535133 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc170048070 con 0x557f5680b8e0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc05affd640 1 -- 172.21.15.123:0/1669535133 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170011cb0 con 0x557f5680b8e0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc05affd640 1 -- 172.21.15.123:0/1669535133 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17004b0d0 con 0x557f5680b8e0 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- 172.21.15.123:0/1669535133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 msgr2=0x557f5680bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 --2- 172.21.15.123:0/1669535133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f5680bd00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc17000a100 tx=0x7fc170020510 comp rx=0 tx=0).stop 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- 172.21.15.123:0/1669535133 shutdown_connections 2024-03-20T13:37:03.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 --2- 172.21.15.123:0/1669535133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f5680bd00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- 172.21.15.123:0/1669535133 >> 172.21.15.123:0/1669535133 conn(0x557f56807c20 msgr2=0x557f56805c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- 172.21.15.123:0/1669535133 shutdown_connections 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- 172.21.15.123:0/1669535133 wait complete. 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 Processor -- start 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- start start 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f56812760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc179685980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f56812ca0 con 0x557f5680b8e0 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f56812760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f56812760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55292/0 (socket says 172.21.15.123:55292) 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 learned_addr learned my addr 172.21.15.123:0/2713395980 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.198+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f568000a0 con 0x557f5680b8e0 2024-03-20T13:37:03.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc1779a1640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f56812760 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc170029c30 tx=0x7fc170049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc0597fa640 1 -- 172.21.15.123:0/2713395980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17002f070 con 0x557f5680b8e0 2024-03-20T13:37:03.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc0597fa640 1 -- 172.21.15.123:0/2713395980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc170048280 con 0x557f5680b8e0 2024-03-20T13:37:03.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f56812ea0 con 0x557f5680b8e0 2024-03-20T13:37:03.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc0597fa640 1 -- 172.21.15.123:0/2713395980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc170014920 con 0x557f5680b8e0 2024-03-20T13:37:03.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f568132d0 con 0x557f5680b8e0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc0597fa640 1 -- 172.21.15.123:0/2713395980 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc170014a80 con 0x557f5680b8e0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc0597fa640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0400342b0 0x7fc040036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc0597fa640 1 -- 172.21.15.123:0/2713395980 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc170034c70 con 0x557f5680b8e0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0400342b0 0x7fc040036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f5681de30 0x557f568202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56820a40 con 0x557f5681de30 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc17699f640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f5681de30 0x557f568202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0400342b0 0x7fc040036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc168048e50 tx=0x7fc168033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc17699f640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f5681de30 0x557f568202f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 realm 2024-03-20T13:37:03.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56820e30 con 0x557f5681de30 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f568216b0 con 0x557f5681de30 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f56822090 0x557f568244c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56824c30 con 0x557f56822090 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.202+0000 7fc1779a1640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f56822090 0x557f568244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1779a1640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f56822090 0x557f568244c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56825430 con 0x557f56822090 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 20 searching for the correct realm 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f56827430 0x557f568298f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f56827430 0x557f568298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1771a0640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f56827430 0x557f568298f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1779a1640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc170043bd0 0x7fc1700113d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x7fc170043bd0 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc17699f640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc170043bd0 0x7fc1700113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc17699f640 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc170043bd0 0x7fc1700113d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x7fc170043bd0 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.206+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x7fc170043bd0 2024-03-20T13:37:03.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x7fc170043bd0 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x7fc170043bd0 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc16c0b0020 con 0x7fc170043bd0 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.210+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0b0020 con 0x557f5681de30 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x7fc170043bd0 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f5681de30 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x7fc170043bd0 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x7fc170043bd0 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.214+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56827430 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56829fc0 con 0x557f56822090 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f568269c0 con 0x557f5681de30 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56825940 con 0x557f56822090 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56825950 con 0x557f5681de30 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 zone default found 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 4 Realm: () 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 zonegroup default 2024-03-20T13:37:03.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56826480 con 0x7fc170043bd0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682c460 con 0x557f56827430 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682c8b0 con 0x557f56827430 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 started sync module instance, tier type = 2024-03-20T13:37:03.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:03.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.218+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682b780 con 0x557f56822090 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94005400613600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682bb30 con 0x557f56822090 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682d610 con 0x557f5681de30 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94005400621424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682de90 con 0x557f5681de30 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682e960 con 0x557f56822090 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94005400613600] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.222+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94005400621424] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.226+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.226+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94005400623472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682e920 con 0x557f56822090 2024-03-20T13:37:03.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.226+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682f1b0 con 0x7fc170043bd0 2024-03-20T13:37:03.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94005400628496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682e920 con 0x7fc170043bd0 2024-03-20T13:37:03.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682fc80 con 0x557f56822090 2024-03-20T13:37:03.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94005400623472] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94005400628496] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94005400631200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682fc80 con 0x557f56822090 2024-03-20T13:37:03.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.230+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56830030 con 0x557f56827430 2024-03-20T13:37:03.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94005400629552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56830030 con 0x557f56827430 2024-03-20T13:37:03.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56830ef0 con 0x557f56827430 2024-03-20T13:37:03.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94005400631200] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94005400629552] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94005400634336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56830eb0 con 0x557f56827430 2024-03-20T13:37:03.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.234+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56831740 con 0x7fc170043bd0 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94005400634336] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94005400635888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56830eb0 con 0x7fc170043bd0 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=0 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=1 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=2 2024-03-20T13:37:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=3 2024-03-20T13:37:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=4 2024-03-20T13:37:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=5 2024-03-20T13:37:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=6 2024-03-20T13:37:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94005400635888] v32'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 20 add_watcher() i=7 2024-03-20T13:37:03.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:03.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56834860 con 0x557f5681de30 2024-03-20T13:37:03.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.238+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94005400638112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56831d40 con 0x557f5681de30 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94005400638112] v32'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc02dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 5 note: GC not initialized 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc02cfe1640 20 reqs_thread_entry: start 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:03.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 Filter name: none 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fbfa67fc640 20 reqs_thread_entry: start 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56856790 con 0x557f5681de30 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f568582f0 con 0x557f5681de30 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=193 2024-03-20T13:37:03.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.d 8:b36ff40a:root::.bucket.meta.testx%3amyfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56859b20 con 0x7fc170043bd0 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 20 rados_obj.operate() r=0 bl.length=371 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.242+0000 7fc179685980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-03-20T13:37:03.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5685df00 con 0x557f5681de30 2024-03-20T13:37:03.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56861540 con 0x557f56822090 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(66 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [create,call,writefull 0~352,setxattr (123)] v32'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc179685980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x7 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc179685980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc179685980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.246+0000 7fc179685980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94005400826624 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56860bd0 con 0x557f5681de30 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== watch-notify(notify (1) cookie 94005400621424 notify 137438953476 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x7fc16c0d0040 con 0x557f5681de30 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(67 notify.1 [notify cookie 94005400826624 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94005400621424 notifier 4556 bl.length()=701 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x7 2024-03-20T13:37:03.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc03c003ea0 con 0x557f5681de30 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== watch-notify(notify_complete (2) cookie 94005400826624 notify 137438953476 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc16c0b9070 con 0x557f5681de30 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_sources= new_sources= 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential sources added=[] removed=[] 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_dests= new_dests= 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential dests added=[] removed=[] 2024-03-20T13:37:03.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5685f780 con 0x7fc170043bd0 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f568608d0 con 0x7fc170043bd0 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94005400831024 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56860fd0 con 0x557f56827430 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 94005400634336 notify 137438953481 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7fc168039040 con 0x557f56827430 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94005400634336 notifier 4556 bl.length()=314 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:03.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc05affd640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc03c003ea0 con 0x557f56827430 2024-03-20T13:37:03.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [notify cookie 94005400831024 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== watch-notify(notify_complete (2) cookie 94005400831024 notify 137438953481 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f566efd00 con 0x557f56827430 2024-03-20T13:37:03.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-03-20T13:37:03.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-03-20T13:37:03.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.250+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94005400831024 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56860fd0 con 0x557f56822090 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== watch-notify(notify (1) cookie 94005400631200 notify 137438953500 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7fc17006a040 con 0x557f56822090 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc05a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94005400631200 notifier 4556 bl.length()=155 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc05a7fc640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fbfac0032c0 con 0x557f56822090 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(73 notify.4 [notify cookie 94005400831024 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== watch-notify(notify_complete (2) cookie 94005400831024 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f568132d0 con 0x557f56822090 2024-03-20T13:37:03.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f568608d0 con 0x557f5681de30 2024-03-20T13:37:03.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(75 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc179685980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 from cache 2024-03-20T13:37:03.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc179685980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:03.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:76 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94005400805328 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f568608d0 con 0x557f56822090 2024-03-20T13:37:03.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== watch-notify(notify (1) cookie 94005400613600 notify 137438953501 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x557f568132d0 con 0x557f56822090 2024-03-20T13:37:03.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.254+0000 7fc05affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94005400613600 notifier 4556 bl.length()=212 2024-03-20T13:37:03.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.258+0000 7fc05affd640 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc03c003ea0 con 0x557f56822090 2024-03-20T13:37:03.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.258+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(76 notify.0 [notify cookie 94005400805328 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.258+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.258+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== watch-notify(notify_complete (2) cookie 94005400805328 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f56812ea0 con 0x557f56822090 2024-03-20T13:37:03.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.258+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 8.d 8:b36ff40a:root::.bucket.meta.testx%3amyfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56860fd0 con 0x7fc170043bd0 2024-03-20T13:37:03.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.258+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call,delete] v32'2 uv2 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc02dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94005400638112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56860fd0 con 0x557f5681de30 2024-03-20T13:37:03.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94005400638112] v32'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94005400613600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f56860fd0 con 0x557f56822090 2024-03-20T13:37:03.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94005400613600] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc179685980 20 remove_watcher() i=0 2024-03-20T13:37:03.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc179685980 2 removed watcher, disabling cache 2024-03-20T13:37:03.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.262+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94005400621424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682b2e0 con 0x557f5681de30 2024-03-20T13:37:03.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94005400621424] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x557f5681de30 2024-03-20T13:37:03.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc179685980 20 remove_watcher() i=1 2024-03-20T13:37:03.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94005400623472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682b2e0 con 0x557f56822090 2024-03-20T13:37:03.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94005400623472] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc179685980 20 remove_watcher() i=2 2024-03-20T13:37:03.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94005400628496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682d970 con 0x7fc170043bd0 2024-03-20T13:37:03.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94005400628496] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc179685980 20 remove_watcher() i=3 2024-03-20T13:37:03.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.266+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94005400631200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682b2e0 con 0x557f56822090 2024-03-20T13:37:03.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc1779a1640 1 -- 172.21.15.123:0/2713395980 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94005400631200] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17000a4d0 con 0x557f56822090 2024-03-20T13:37:03.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc179685980 20 remove_watcher() i=4 2024-03-20T13:37:03.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94005400629552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682ed10 con 0x557f56827430 2024-03-20T13:37:03.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94005400629552] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc179685980 20 remove_watcher() i=5 2024-03-20T13:37:03.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94005400634336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682d970 con 0x557f56827430 2024-03-20T13:37:03.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc1771a0640 1 -- 172.21.15.123:0/2713395980 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94005400634336] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc168016070 con 0x557f56827430 2024-03-20T13:37:03.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc179685980 20 remove_watcher() i=6 2024-03-20T13:37:03.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.270+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94005400635888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f5682f7a0 con 0x7fc170043bd0 2024-03-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94005400635888] v32'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc16c0d5060 con 0x7fc170043bd0 2024-03-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 20 remove_watcher() i=7 2024-03-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f56822090 msgr2=0x557f568244c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f56822090 0x557f568244c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f5681de30 msgr2=0x557f568202f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f5681de30 0x557f568202f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc170043bd0 msgr2=0x7fc1700113d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc170043bd0 0x7fc1700113d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f56827430 msgr2=0x557f568298f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f56827430 0x557f568298f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0400342b0 msgr2=0x7fc040036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0400342b0 0x7fc040036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc168048e50 tx=0x7fc168033000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc17699f640 1 -- 172.21.15.123:0/2713395980 reap_dead start 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 msgr2=0x557f56812760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f56812760 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc170029c30 tx=0x7fc170049830 comp rx=0 tx=0).stop 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 shutdown_connections 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2713395980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f5680b8e0 0x557f56812760 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 >> 172.21.15.123:0/2713395980 conn(0x557f56807c20 msgr2=0x557f56805280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 shutdown_connections 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2713395980 wait complete. 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc050034300 msgr2=0x7fc0500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc050034300 0x7fc0500367c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x557f567eefc0 tx=0x7fc16800e4a0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 msgr2=0x557f567fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 0x557f567fedc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc170016cf0 tx=0x7fc17000d790 comp rx=0 tx=0).stop 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 shutdown_connections 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc050034300 0x7fc0500367c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/608731749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f567fe9a0 0x557f567fedc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 >> 172.21.15.123:0/608731749 conn(0x557f567f37b0 msgr2=0x557f567f42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 shutdown_connections 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/608731749 wait complete. 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f567ec0f0 msgr2=0x557f567ee4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f567ec0f0 0x557f567ee4e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f567e8f50 msgr2=0x557f567eb340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f567e8f50 0x557f567eb340 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc05c0342b0 msgr2=0x7fc05c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc05c0342b0 0x7fc05c036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0ae000 tx=0x7fc16c0a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 msgr2=0x557f566f12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f12d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc168002000 tx=0x7fc168000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 shutdown_connections 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f567ec0f0 0x557f567ee4e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f567e8f50 0x557f567eb340 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc05c0342b0 0x7fc05c036770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 --2- 172.21.15.123:0/2796643979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f566f52e0 0x557f566f12d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 >> 172.21.15.123:0/2796643979 conn(0x557f566eb6e0 msgr2=0x557f567d5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 shutdown_connections 2024-03-20T13:37:03.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.274+0000 7fc179685980 1 -- 172.21.15.123:0/2796643979 wait complete. 2024-03-20T13:37:03.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:37:03.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:37:03.290 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-03-20T13:37:03.369 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:03.370 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:03.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3c0353980 1 Processor -- start 2024-03-20T13:37:03.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3c0353980 1 -- start start 2024-03-20T13:37:03.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3c0353980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56010f2714e0 0x56010f2738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3c0353980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56010f1b94c0 con 0x56010f26b3d0 2024-03-20T13:37:03.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3c0353980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56010f1800f0 con 0x56010f2714e0 2024-03-20T13:37:03.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3bd66d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56010f2714e0 0x56010f2738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3bd66d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56010f2714e0 0x56010f2738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55298/0 (socket says 172.21.15.123:55298) 2024-03-20T13:37:03.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3bd66d640 1 -- 172.21.15.123:0/3440170963 learned_addr learned my addr 172.21.15.123:0/3440170963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3bde6e640 1 --1- 172.21.15.123:0/3440170963 >> v1:172.21.15.89:6789/0 conn(0x56010f26b3d0 0x56010f26b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59264/0 (socket says 172.21.15.123:59264) 2024-03-20T13:37:03.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3bd66d640 1 -- 172.21.15.123:0/3440170963 >> v1:172.21.15.89:6789/0 conn(0x56010f26b3d0 legacy=0x56010f26b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.366+0000 7fe3bd66d640 1 -- 172.21.15.123:0/3440170963 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010f274e20 con 0x56010f2714e0 2024-03-20T13:37:03.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/3440170963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f2738d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400a5c0 tx=0x7fe3b401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8880bae7550766a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3bce6c640 1 -- 172.21.15.123:0/3440170963 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b40aa470 con 0x56010f2714e0 2024-03-20T13:37:03.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3bce6c640 1 -- 172.21.15.123:0/3440170963 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b40aa5d0 con 0x56010f2714e0 2024-03-20T13:37:03.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3bce6c640 1 -- 172.21.15.123:0/3440170963 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b40aa890 con 0x56010f2714e0 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 -- 172.21.15.123:0/3440170963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 msgr2=0x56010f2738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 --2- 172.21.15.123:0/3440170963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f2738d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400a5c0 tx=0x7fe3b401b340 comp rx=0 tx=0).stop 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 -- 172.21.15.123:0/3440170963 shutdown_connections 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 --2- 172.21.15.123:0/3440170963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f2738d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 -- 172.21.15.123:0/3440170963 >> 172.21.15.123:0/3440170963 conn(0x56010f266e60 msgr2=0x56010f269280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 -- 172.21.15.123:0/3440170963 shutdown_connections 2024-03-20T13:37:03.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.370+0000 7fe3c0353980 1 -- 172.21.15.123:0/3440170963 wait complete. 2024-03-20T13:37:03.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3c0353980 1 Processor -- start 2024-03-20T13:37:03.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3c0353980 1 -- start start 2024-03-20T13:37:03.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3c0353980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 0x56010f356ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3c0353980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010f17d620 con 0x56010f26b3d0 2024-03-20T13:37:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3bde6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 0x56010f356ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3bde6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 0x56010f356ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55304/0 (socket says 172.21.15.123:55304) 2024-03-20T13:37:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1223062595 learned_addr learned my addr 172.21.15.123:0/1223062595 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1223062595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4005df0 con 0x56010f26b3d0 2024-03-20T13:37:03.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1223062595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 0x56010f356ea0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0001cc0 tx=0x7fe3b000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7ff810d6f24021 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe2abe07640 1 -- 172.21.15.123:0/1223062595 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b0014070 con 0x56010f26b3d0 2024-03-20T13:37:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe2abe07640 1 -- 172.21.15.123:0/1223062595 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b000f590 con 0x56010f26b3d0 2024-03-20T13:37:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.382+0000 7fe2abe07640 1 -- 172.21.15.123:0/1223062595 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b0007040 con 0x56010f26b3d0 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1223062595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 msgr2=0x56010f356ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1223062595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 0x56010f356ea0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0001cc0 tx=0x7fe3b000b610 comp rx=0 tx=0).stop 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1223062595 shutdown_connections 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1223062595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26b3d0 0x56010f356ea0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1223062595 >> 172.21.15.123:0/1223062595 conn(0x56010f266e60 msgr2=0x56010f352a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1223062595 shutdown_connections 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1223062595 wait complete. 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 Processor -- start 2024-03-20T13:37:03.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- start start 2024-03-20T13:37:03.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f35dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010f178e00 con 0x56010f2714e0 2024-03-20T13:37:03.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3bde6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f35dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3bde6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f35dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55310/0 (socket says 172.21.15.123:55310) 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1296253801 learned_addr learned my addr 172.21.15.123:0/1296253801 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010f1b94c0 con 0x56010f2714e0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f35dfe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0004000 tx=0x7fe3b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe2aa604640 1 -- 172.21.15.123:0/1296253801 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b0014030 con 0x56010f2714e0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe2aa604640 1 -- 172.21.15.123:0/1296253801 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b001c780 con 0x56010f2714e0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe2aa604640 1 -- 172.21.15.123:0/1296253801 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b001ca80 con 0x56010f2714e0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56010f35e520 con 0x56010f2714e0 2024-03-20T13:37:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56010f35e950 con 0x56010f2714e0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe2aa604640 1 -- 172.21.15.123:0/1296253801 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe3b001ccf0 con 0x56010f2714e0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe2aa604640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2a40342b0 0x7fe2a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe2aa604640 1 -- 172.21.15.123:0/1296253801 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe3b0006070 con 0x56010f2714e0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.386+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2a40342b0 0x7fe2a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f362c00 0x56010f364ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f365530 con 0x56010f362c00 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3be66f640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f362c00 0x56010f364ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2a40342b0 0x7fe2a4036770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40ae000 tx=0x7fe3b40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3be66f640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f362c00 0x56010f364ff0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3be66f640 1 -- 172.21.15.123:0/1296253801 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f362c00 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f365da0 0x56010f368190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3688b0 con 0x56010f365da0 2024-03-20T13:37:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f365da0 0x56010f368190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f365da0 0x56010f368190 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1296253801 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f365da0 2024-03-20T13:37:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f36a110 con 0x56010f365da0 2024-03-20T13:37:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1296253801 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f365da0 2024-03-20T13:37:03.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.390+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f369310 con 0x56010f365da0 2024-03-20T13:37:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1296253801 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f365da0 2024-03-20T13:37:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f369720 con 0x56010f362c00 2024-03-20T13:37:03.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3be66f640 1 -- 172.21.15.123:0/1296253801 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f362c00 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 Processor -- start 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 -- start start 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 0x56010f378bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010f111e30 con 0x56010f3787b0 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3be66f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 0x56010f378bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3be66f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 0x56010f378bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55326/0 (socket says 172.21.15.123:55326) 2024-03-20T13:37:03.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3be66f640 1 -- 172.21.15.123:0/3092227942 learned_addr learned my addr 172.21.15.123:0/3092227942 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3be66f640 1 -- 172.21.15.123:0/3092227942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010f379110 con 0x56010f3787b0 2024-03-20T13:37:03.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3be66f640 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 0x56010f378bd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8016cf0 tx=0x7fe3b800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe2a37fe640 1 -- 172.21.15.123:0/3092227942 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b8017660 con 0x56010f3787b0 2024-03-20T13:37:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56010f379360 con 0x56010f3787b0 2024-03-20T13:37:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56010f379eb0 con 0x56010f3787b0 2024-03-20T13:37:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe2a37fe640 1 -- 172.21.15.123:0/3092227942 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80177c0 con 0x56010f3787b0 2024-03-20T13:37:03.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe2a37fe640 1 -- 172.21.15.123:0/3092227942 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b8017a60 con 0x56010f3787b0 2024-03-20T13:37:03.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe2a37fe640 1 -- 172.21.15.123:0/3092227942 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe3b801d020 con 0x56010f3787b0 2024-03-20T13:37:03.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe2a37fe640 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2980342b0 0x7fe298036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe2a37fe640 1 -- 172.21.15.123:0/3092227942 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe3b804b600 con 0x56010f3787b0 2024-03-20T13:37:03.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.394+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2980342b0 0x7fe298036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 Processor -- start 2024-03-20T13:37:03.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- start start 2024-03-20T13:37:03.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2980342b0 0x7fe298036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56010f368e10 tx=0x7fe3b0049040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f26de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010f105790 con 0x56010f26d9e0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f26de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f26de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55330/0 (socket says 172.21.15.123:55330) 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 -- 172.21.15.123:0/2370254966 learned_addr learned my addr 172.21.15.123:0/2370254966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 -- 172.21.15.123:0/2370254966 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010f26c270 con 0x56010f26d9e0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 --2- 172.21.15.123:0/2370254966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f26de00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8015010 tx=0x7fe3b8049be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05d68942787af0f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe2a17fa640 1 -- 172.21.15.123:0/2370254966 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b8017c10 con 0x56010f26d9e0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe2a17fa640 1 -- 172.21.15.123:0/2370254966 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8017d70 con 0x56010f26d9e0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe2a17fa640 1 -- 172.21.15.123:0/2370254966 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b8011e00 con 0x56010f26d9e0 2024-03-20T13:37:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- 172.21.15.123:0/2370254966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 msgr2=0x56010f26de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 --2- 172.21.15.123:0/2370254966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f26de00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8015010 tx=0x7fe3b8049be0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- 172.21.15.123:0/2370254966 shutdown_connections 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 --2- 172.21.15.123:0/2370254966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f26de00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- 172.21.15.123:0/2370254966 >> 172.21.15.123:0/2370254966 conn(0x56010f381a70 msgr2=0x56010f37fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- 172.21.15.123:0/2370254966 shutdown_connections 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- 172.21.15.123:0/2370254966 wait complete. 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 Processor -- start 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- start start 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f392ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3c0353980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010f3930e0 con 0x56010f26d9e0 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f392ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f392ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55338/0 (socket says 172.21.15.123:55338) 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 learned_addr learned my addr 172.21.15.123:0/1869648034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010f379eb0 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.398+0000 7fe3be66f640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f392ba0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8015010 tx=0x7fe3b80498c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe28f7fe640 1 -- 172.21.15.123:0/1869648034 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b8031070 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56010f3932e0 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe28f7fe640 1 -- 172.21.15.123:0/1869648034 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8048130 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe28f7fe640 1 -- 172.21.15.123:0/1869648034 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3b80483d0 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56010f393710 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe28f7fe640 1 -- 172.21.15.123:0/1869648034 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe3b8014920 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe28f7fe640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2880342b0 0x7fe288036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe28f7fe640 1 -- 172.21.15.123:0/1869648034 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe3b8048920 con 0x56010f26d9e0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2880342b0 0x7fe288036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f39e2a0 0x56010f3a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a0eb0 con 0x56010f39e2a0 2024-03-20T13:37:03.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f39e2a0 0x56010f3a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2880342b0 0x7fe288036770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56010f35ed10 tx=0x7fe3b003a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f39e2a0 0x56010f3a0760 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 realm 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a12a0 con 0x56010f39e2a0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a1b20 con 0x56010f39e2a0 2024-03-20T13:37:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f3a2500 0x56010f3a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a50a0 con 0x56010f3a2500 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3be66f640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f3a2500 0x56010f3a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.402+0000 7fe3be66f640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f3a2500 0x56010f3a4930 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f3a2500 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a58a0 con 0x56010f3a2500 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f3a2500 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 20 searching for the correct realm 2024-03-20T13:37:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56010f3a78e0 0x56010f3a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56010f3a78e0 0x56010f3a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bde6e640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56010f3a78e0 0x56010f3a9da0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f3a2500 2024-03-20T13:37:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3be66f640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe3b803b390 0x7fe3b802a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x7fe3b803b390 2024-03-20T13:37:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe3b803b390 0x7fe3b802a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe3b803b390 0x7fe3b802a430 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x7fe3b803b390 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.406+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f3a2500 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b800a4d0 con 0x56010f3a2500 2024-03-20T13:37:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x7fe3b803b390 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x7fe3b803b390 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x7fe3b803b390 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe3b40b0020 con 0x7fe3b803b390 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.410+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40b0020 con 0x56010f39e2a0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x7fe3b803b390 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f39e2a0 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x7fe3b803b390 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x7fe3b803b390 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.414+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a78e0 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa470 con 0x56010f3a2500 2024-03-20T13:37:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a6e90 con 0x56010f39e2a0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a6280 con 0x56010f3a2500 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3a62a0 con 0x56010f39e2a0 2024-03-20T13:37:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 zone default found 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 4 Realm: () 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 zonegroup default 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aa8b0 con 0x7fe3b803b390 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3aca90 con 0x56010f3a78e0 2024-03-20T13:37:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3acdf0 con 0x56010f3a78e0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 started sync module instance, tier type = 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.418+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3ac060 con 0x56010f3a2500 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562550465600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3ac060 con 0x56010f3a2500 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3ad760 con 0x56010f39e2a0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562550469312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3adfb0 con 0x56010f39e2a0 2024-03-20T13:37:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3ae980 con 0x56010f3a2500 2024-03-20T13:37:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.422+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94562550465600] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94562550469312] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562550473856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3adb10 con 0x56010f3a2500 2024-03-20T13:37:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3af1d0 con 0x7fe3b803b390 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562550476080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3adb10 con 0x7fe3b803b390 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3afcc0 con 0x56010f3a2500 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94562550473856] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.426+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94562550476080] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562550478784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3afc80 con 0x56010f3a2500 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3af2c0 con 0x56010f3a78e0 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562550481008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b0930 con 0x56010f3a78e0 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b12a0 con 0x56010f3a78e0 2024-03-20T13:37:03.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94562550478784] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94562550481008] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562550484480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3abcd0 con 0x56010f3a78e0 2024-03-20T13:37:03.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b1220 con 0x7fe3b803b390 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562550486608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b1220 con 0x7fe3b803b390 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=0 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=1 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=2 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=3 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=4 2024-03-20T13:37:03.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=5 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94562550484480] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.430+0000 7fe3c0353980 20 add_watcher() i=6 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94562550486608] v32'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 20 add_watcher() i=7 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b0490 con 0x56010f39e2a0 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562550487664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b0490 con 0x56010f39e2a0 2024-03-20T13:37:03.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94562550487664] v32'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe26f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:03.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:03.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.434+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bd1b0 con 0x56010f3a2500 2024-03-20T13:37:03.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.438+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.438+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bd260 con 0x7fe3b803b390 2024-03-20T13:37:03.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.438+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.438+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bdb90 con 0x56010f3a78e0 2024-03-20T13:37:03.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.442+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.442+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bc570 con 0x56010f39e2a0 2024-03-20T13:37:03.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.442+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.442+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bc570 con 0x56010f3a2500 2024-03-20T13:37:03.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.446+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.446+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3be850 con 0x56010f3a78e0 2024-03-20T13:37:03.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.446+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.446+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bed80 con 0x56010f3a2500 2024-03-20T13:37:03.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.446+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.446+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bf220 con 0x56010f39e2a0 2024-03-20T13:37:03.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.450+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.450+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bb250 con 0x56010f3a2500 2024-03-20T13:37:03.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.450+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.450+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bb860 con 0x56010f3a2500 2024-03-20T13:37:03.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.454+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.454+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bb860 con 0x56010f3a2500 2024-03-20T13:37:03.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.454+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'40 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.454+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bb860 con 0x56010f3a78e0 2024-03-20T13:37:03.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.458+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.458+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.458+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.458+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f39e2a0 2024-03-20T13:37:03.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.458+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.462+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f39e2a0 2024-03-20T13:37:03.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.462+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.462+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.462+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.462+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.466+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'41 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.466+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a78e0 2024-03-20T13:37:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.470+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.470+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.470+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.470+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f39e2a0 2024-03-20T13:37:03.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.474+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.474+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.474+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.474+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.478+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.478+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a78e0 2024-03-20T13:37:03.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.478+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.478+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.478+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.478+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a78e0 2024-03-20T13:37:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.482+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.482+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a78e0 2024-03-20T13:37:03.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.482+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.482+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a78e0 2024-03-20T13:37:03.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.482+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.482+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.486+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.486+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f39e2a0 2024-03-20T13:37:03.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.486+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.486+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f3a2500 2024-03-20T13:37:03.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.490+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.490+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x56010f39e2a0 2024-03-20T13:37:03.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.490+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.490+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3bfd90 con 0x7fe3b803b390 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe26e7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 20 Filter name: none 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe1dffff640 20 reqs_thread_entry: start 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b9b80 con 0x56010f3a78e0 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 20 rados_obj.operate() r=0 bl.length=385 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3dc320 con 0x56010f39e2a0 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:37:03.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94562550519248 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3dc7c0 con 0x56010f3a2500 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== watch-notify(notify (1) cookie 94562550473856 notify 137438953502 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x56010f393710 con 0x56010f3a2500 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe2a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94562550473856 notifier 4563 bl.length()=170 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe2a17fa640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe280003d60 con 0x56010f3a2500 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(96 notify.2 [notify cookie 94562550519248 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== watch-notify(notify_complete (2) cookie 94562550519248 notify 137438953502 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56010f3932e0 con 0x56010f3a2500 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.494+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95d0 con 0x56010f3a78e0 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v32'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 10 removing email index: 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 10 removing user buckets index 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-03-20T13:37:03.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94562550519248 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3dc7c0 con 0x56010f3a2500 2024-03-20T13:37:03.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== watch-notify(notify (1) cookie 94562550478784 notify 137438953503 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x56010f3932e0 con 0x56010f3a2500 2024-03-20T13:37:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe2a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94562550478784 notifier 4563 bl.length()=175 2024-03-20T13:37:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe2a0ff9640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe1e80032c0 con 0x56010f3a2500 2024-03-20T13:37:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(99 notify.4 [notify cookie 94562550519248 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== watch-notify(notify_complete (2) cookie 94562550519248 notify 137438953503 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe3b806f040 con 0x56010f3a2500 2024-03-20T13:37:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95d0 con 0x56010f39e2a0 2024-03-20T13:37:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 10 removing user index: testx$tenanteduser 2024-03-20T13:37:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-03-20T13:37:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-03-20T13:37:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94562550522112 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95d0 con 0x7fe3b803b390 2024-03-20T13:37:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== watch-notify(notify (1) cookie 94562550476080 notify 137438953484 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x7fe3b40d0040 con 0x7fe3b803b390 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe2a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94562550476080 notifier 4563 bl.length()=167 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe2a17fa640 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe280003d60 con 0x7fe3b803b390 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.498+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(102 notify.3 [notify cookie 94562550522112 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.502+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.502+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== watch-notify(notify_complete (2) cookie 94562550522112 notify 137438953484 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe3b40b9070 con 0x7fe3b803b390 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.502+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f3a78e0 2024-03-20T13:37:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.502+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v32'10 uv10 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.502+0000 7fe26f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.502+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562550487664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f39e2a0 2024-03-20T13:37:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94562550487664] v32'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562550465600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f3a2500 2024-03-20T13:37:03.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94562550465600] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3c0353980 20 remove_watcher() i=0 2024-03-20T13:37:03.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3c0353980 2 removed watcher, disabling cache 2024-03-20T13:37:03.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562550469312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f39e2a0 2024-03-20T13:37:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94562550469312] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x56010f39e2a0 2024-03-20T13:37:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3c0353980 20 remove_watcher() i=1 2024-03-20T13:37:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.506+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562550473856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f3a2500 2024-03-20T13:37:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.510+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94562550473856] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.510+0000 7fe3c0353980 20 remove_watcher() i=2 2024-03-20T13:37:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.510+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562550476080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x7fe3b803b390 2024-03-20T13:37:03.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.510+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94562550476080] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.510+0000 7fe3c0353980 20 remove_watcher() i=3 2024-03-20T13:37:03.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.510+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562550478784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f3a2500 2024-03-20T13:37:03.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3be66f640 1 -- 172.21.15.123:0/1869648034 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94562550478784] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b8066040 con 0x56010f3a2500 2024-03-20T13:37:03.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 20 remove_watcher() i=4 2024-03-20T13:37:03.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562550481008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f3a78e0 2024-03-20T13:37:03.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94562550481008] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 20 remove_watcher() i=5 2024-03-20T13:37:03.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562550484480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x56010f3a78e0 2024-03-20T13:37:03.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3bde6e640 1 -- 172.21.15.123:0/1869648034 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94562550484480] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b0016070 con 0x56010f3a78e0 2024-03-20T13:37:03.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 20 remove_watcher() i=6 2024-03-20T13:37:03.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562550486608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56010f3b95b0 con 0x7fe3b803b390 2024-03-20T13:37:03.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94562550486608] v32'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3b40d5060 con 0x7fe3b803b390 2024-03-20T13:37:03.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 20 remove_watcher() i=7 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f3a2500 msgr2=0x56010f3a4930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f3a2500 0x56010f3a4930 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f39e2a0 msgr2=0x56010f3a0760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f39e2a0 0x56010f3a0760 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe3b803b390 msgr2=0x7fe3b802a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fe3b803b390 0x7fe3b802a430 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56010f3a78e0 msgr2=0x56010f3a9da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56010f3a78e0 0x56010f3a9da0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2880342b0 msgr2=0x7fe288036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2880342b0 0x7fe288036770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56010f35ed10 tx=0x7fe3b003a000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 msgr2=0x56010f392ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3bd66d640 1 -- 172.21.15.123:0/1869648034 reap_dead start 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f392ba0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8015010 tx=0x7fe3b80498c0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 shutdown_connections 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1869648034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f26d9e0 0x56010f392ba0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 >> 172.21.15.123:0/1869648034 conn(0x56010f381a70 msgr2=0x56010f37f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 shutdown_connections 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/1869648034 wait complete. 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2980342b0 msgr2=0x7fe298036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2980342b0 0x7fe298036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56010f368e10 tx=0x7fe3b0049040 comp rx=0 tx=0).stop 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 msgr2=0x56010f378bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.514+0000 7fe3c0353980 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 0x56010f378bd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8016cf0 tx=0x7fe3b800d790 comp rx=0 tx=0).stop 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 shutdown_connections 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2980342b0 0x7fe298036770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/3092227942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f3787b0 0x56010f378bd0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 >> 172.21.15.123:0/3092227942 conn(0x56010f36d5c0 msgr2=0x56010f36e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 shutdown_connections 2024-03-20T13:37:03.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/3092227942 wait complete. 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f365da0 msgr2=0x56010f368190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f365da0 0x56010f368190 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f362c00 msgr2=0x56010f364ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f362c00 0x56010f364ff0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2a40342b0 msgr2=0x7fe2a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2a40342b0 0x7fe2a4036770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40ae000 tx=0x7fe3b40a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 msgr2=0x56010f35dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f35dfe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0004000 tx=0x7fe3b0000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 shutdown_connections 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56010f365da0 0x56010f368190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56010f362c00 0x56010f364ff0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fe2a40342b0 0x7fe2a4036770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 --2- 172.21.15.123:0/1296253801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56010f2714e0 0x56010f35dfe0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 >> 172.21.15.123:0/1296253801 conn(0x56010f266e60 msgr2=0x56010f351540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 shutdown_connections 2024-03-20T13:37:03.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.518+0000 7fe3c0353980 1 -- 172.21.15.123:0/1296253801 wait complete. 2024-03-20T13:37:03.541 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-03-20T13:37:03.545 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-03-20T13:37:03.591 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:03.591 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-03-20T13:37:03.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-03-20T13:37:03.591 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-03-20T13:37:03.628 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:03.628 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e844b0980 1 Processor -- start 2024-03-20T13:37:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e844b0980 1 -- start start 2024-03-20T13:37:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e844b0980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55952350d150 0x55952350b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e844b0980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595234e34c0 con 0x55952350bc40 2024-03-20T13:37:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e844b0980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5595234aa0f0 con 0x55952350d150 2024-03-20T13:37:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e81fcb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55952350d150 0x55952350b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e817ca640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55952350bc40 0x55952359ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59272/0 (socket says 172.21.15.123:59272) 2024-03-20T13:37:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e817ca640 1 -- 172.21.15.123:0/3335382224 learned_addr learned my addr 172.21.15.123:0/3335382224 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3335382224 >> v1:172.21.15.89:6789/0 conn(0x55952350bc40 legacy=0x55952359ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.622+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3335382224 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952350c050 con 0x55952350d150 2024-03-20T13:37:03.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/3335382224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350d150 0x55952350b700 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400a480 tx=0x7f3e7401b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568326ae9eb5d947 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e80fc9640 1 -- 172.21.15.123:0/3335382224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740aa400 con 0x55952350d150 2024-03-20T13:37:03.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e80fc9640 1 -- 172.21.15.123:0/3335382224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e740a6050 con 0x55952350d150 2024-03-20T13:37:03.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e80fc9640 1 -- 172.21.15.123:0/3335382224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740aa6b0 con 0x55952350d150 2024-03-20T13:37:03.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 -- 172.21.15.123:0/3335382224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350d150 msgr2=0x55952350b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3335382224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350d150 0x55952350b700 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400a480 tx=0x7f3e7401b220 comp rx=0 tx=0).stop 2024-03-20T13:37:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 -- 172.21.15.123:0/3335382224 shutdown_connections 2024-03-20T13:37:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3335382224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350d150 0x55952350b700 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 -- 172.21.15.123:0/3335382224 >> 172.21.15.123:0/3335382224 conn(0x559523592820 msgr2=0x559523594c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 -- 172.21.15.123:0/3335382224 shutdown_connections 2024-03-20T13:37:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.626+0000 7f3e844b0980 1 -- 172.21.15.123:0/3335382224 wait complete. 2024-03-20T13:37:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 Processor -- start 2024-03-20T13:37:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- start start 2024-03-20T13:37:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x5595236835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595234a7620 con 0x55952350bc40 2024-03-20T13:37:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e81fcb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x5595236835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e81fcb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x5595236835c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55354/0 (socket says 172.21.15.123:55354) 2024-03-20T13:37:03.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3597092351 learned_addr learned my addr 172.21.15.123:0/3597092351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3597092351 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74005d30 con 0x55952350bc40 2024-03-20T13:37:03.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/3597092351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x5595236835c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3e740ad040 tx=0x7f3e74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7cd95893528160 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3d6fe07640 1 -- 172.21.15.123:0/3597092351 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740aa6f0 con 0x55952350bc40 2024-03-20T13:37:03.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3d6fe07640 1 -- 172.21.15.123:0/3597092351 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e740aa850 con 0x55952350bc40 2024-03-20T13:37:03.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3d6fe07640 1 -- 172.21.15.123:0/3597092351 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740aaaf0 con 0x55952350bc40 2024-03-20T13:37:03.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- 172.21.15.123:0/3597092351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 msgr2=0x5595236835c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3597092351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x5595236835c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3e740ad040 tx=0x7f3e74003030 comp rx=0 tx=0).stop 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- 172.21.15.123:0/3597092351 shutdown_connections 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3597092351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x5595236835c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- 172.21.15.123:0/3597092351 >> 172.21.15.123:0/3597092351 conn(0x559523592820 msgr2=0x55952367f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- 172.21.15.123:0/3597092351 shutdown_connections 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- 172.21.15.123:0/3597092351 wait complete. 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 Processor -- start 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- start start 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x55952368a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.642+0000 7f3e844b0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595234a2e00 con 0x55952350bc40 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e81fcb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x55952368a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e81fcb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x55952368a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55358/0 (socket says 172.21.15.123:55358) 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3384066120 learned_addr learned my addr 172.21.15.123:0/3384066120 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952350c050 con 0x55952350bc40 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x55952368a350 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3e74000c10 tx=0x7f3e74018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3d6e604640 1 -- 172.21.15.123:0/3384066120 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740b4ad0 con 0x55952350bc40 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3d6e604640 1 -- 172.21.15.123:0/3384066120 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e740b4c30 con 0x55952350bc40 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55952368a890 con 0x55952350bc40 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3d6e604640 1 -- 172.21.15.123:0/3384066120 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740c6470 con 0x55952350bc40 2024-03-20T13:37:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55952368ad20 con 0x55952350bc40 2024-03-20T13:37:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3d6e604640 1 -- 172.21.15.123:0/3384066120 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3e740c3070 con 0x55952350bc40 2024-03-20T13:37:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3d6e604640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d68034300 0x7f3d680367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3d6e604640 1 -- 172.21.15.123:0/3384066120 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3e740e3de0 con 0x55952350bc40 2024-03-20T13:37:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e817ca640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d68034300 0x7f3d680367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55952350d150 0x559523690f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236914c0 con 0x55952350d150 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e827cc640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55952350d150 0x559523690f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e817ca640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d68034300 0x7f3d680367c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3e78000f70 tx=0x7f3e780012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e827cc640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55952350d150 0x559523690f80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e827cc640 1 -- 172.21.15.123:0/3384066120 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x55952350d150 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559523691d30 0x559523694120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.646+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523694840 con 0x559523691d30 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559523691d30 0x559523694120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559523691d30 0x559523694120 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3384066120 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e740c2030 con 0x559523691d30 2024-03-20T13:37:03.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236960a0 con 0x559523691d30 2024-03-20T13:37:03.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3384066120 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3e740c2030 con 0x559523691d30 2024-03-20T13:37:03.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236951e0 con 0x559523691d30 2024-03-20T13:37:03.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e81fcb640 1 -- 172.21.15.123:0/3384066120 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e740c2030 con 0x559523691d30 2024-03-20T13:37:03.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236955f0 con 0x55952350d150 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e827cc640 1 -- 172.21.15.123:0/3384066120 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x55952350d150 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e844b0980 1 Processor -- start 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e844b0980 1 -- start start 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.650+0000 7f3e844b0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 0x5595236a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952343be30 con 0x5595236a47e0 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 0x5595236a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 0x5595236a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55370/0 (socket says 172.21.15.123:55370) 2024-03-20T13:37:03.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 -- 172.21.15.123:0/1428248446 learned_addr learned my addr 172.21.15.123:0/1428248446 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 -- 172.21.15.123:0/1428248446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595236a5140 con 0x5595236a47e0 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 0x5595236a4c00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c016cf0 tx=0x7f3e7c00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3d677fe640 1 -- 172.21.15.123:0/1428248446 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c017660 con 0x5595236a47e0 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595236a5390 con 0x5595236a47e0 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3d677fe640 1 -- 172.21.15.123:0/1428248446 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0177c0 con 0x5595236a47e0 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595236a5ee0 con 0x5595236a47e0 2024-03-20T13:37:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3d677fe640 1 -- 172.21.15.123:0/1428248446 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c017a60 con 0x5595236a47e0 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3d677fe640 1 -- 172.21.15.123:0/1428248446 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3e7c01d020 con 0x5595236a47e0 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3d677fe640 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d5c0342b0 0x7f3d5c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3d677fe640 1 -- 172.21.15.123:0/1428248446 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3e7c04b550 con 0x5595236a47e0 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d5c0342b0 0x7f3d5c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 Processor -- start 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 -- start start 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d5c0342b0 0x7f3d5c036770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x559523694ce0 tx=0x7f3e740bbc80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e844b0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952342f790 con 0x5595236b1730 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55380/0 (socket says 172.21.15.123:55380) 2024-03-20T13:37:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.654+0000 7f3e827cc640 1 -- 172.21.15.123:0/985222968 learned_addr learned my addr 172.21.15.123:0/985222968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 -- 172.21.15.123:0/985222968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595236b2120 con 0x5595236b1730 2024-03-20T13:37:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 --2- 172.21.15.123:0/985222968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b1b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c049970 tx=0x7f3e7c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0098b6c653e367 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3d657fa640 1 -- 172.21.15.123:0/985222968 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c020510 con 0x5595236b1730 2024-03-20T13:37:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3d657fa640 1 -- 172.21.15.123:0/985222968 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c040030 con 0x5595236b1730 2024-03-20T13:37:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3d657fa640 1 -- 172.21.15.123:0/985222968 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c017bc0 con 0x5595236b1730 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/985222968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 msgr2=0x5595236b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 --2- 172.21.15.123:0/985222968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b1b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c049970 tx=0x7f3e7c011ad0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/985222968 shutdown_connections 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 --2- 172.21.15.123:0/985222968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b1b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/985222968 >> 172.21.15.123:0/985222968 conn(0x5595236adac0 msgr2=0x5595236abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/985222968 shutdown_connections 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/985222968 wait complete. 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 Processor -- start 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- start start 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595236b8b30 con 0x5595236b1730 2024-03-20T13:37:03.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:55386/0 (socket says 172.21.15.123:55386) 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 learned_addr learned my addr 172.21.15.123:0/499379744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595236a5ee0 con 0x5595236b1730 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e827cc640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b85f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00dce0 tx=0x7f3e7c0498d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3d537fe640 1 -- 172.21.15.123:0/499379744 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c030070 con 0x5595236b1730 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595236b8d30 con 0x5595236b1730 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3d537fe640 1 -- 172.21.15.123:0/499379744 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0484a0 con 0x5595236b1730 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3d537fe640 1 -- 172.21.15.123:0/499379744 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c029580 con 0x5595236b1730 2024-03-20T13:37:03.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.658+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595236b9160 con 0x5595236b1730 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3d537fe640 1 -- 172.21.15.123:0/499379744 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3e7c0296e0 con 0x5595236b1730 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3d537fe640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d4c0342b0 0x7f3d4c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3d537fe640 1 -- 172.21.15.123:0/499379744 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3e7c037c90 con 0x5595236b1730 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d4c0342b0 0x7f3d4c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595236c3cf0 0x5595236c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236c6900 con 0x5595236c3cf0 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e817ca640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595236c3cf0 0x5595236c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d4c0342b0 0x7f3d4c036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3e740bbd30 tx=0x7f3e740db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e817ca640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595236c3cf0 0x5595236c61b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 realm 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236c3150 con 0x5595236c3cf0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236c7380 con 0x5595236c3cf0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595236c8110 0x5595236ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cabb0 con 0x5595236c8110 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e827cc640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595236c8110 0x5595236ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e827cc640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595236c8110 0x5595236ca500 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c8110 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 20 searching for the correct realm 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595236cd3b0 0x5595236cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.662+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cff40 con 0x5595236cd3b0 2024-03-20T13:37:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595236cd3b0 0x5595236cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e81fcb640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595236cd3b0 0x5595236cf870 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cff40 con 0x5595236c8110 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e827cc640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3e7c008ba0 0x7f3e7c04b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3e7c008ba0 0x7f3e7c04b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3e7c008ba0 0x7f3e7c04b8b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236cd3b0 2024-03-20T13:37:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c8110 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.666+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c8110 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c8110 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236cd3b0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c8110 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236cd3b0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.670+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236cd3b0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb3b0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x5595236cd3b0 2024-03-20T13:37:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x7f3e7c008ba0 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x5595236c8110 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x5595236c8110 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x5595236cd3b0 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x5595236c8110 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.674+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e7803c040 con 0x5595236c8110 2024-03-20T13:37:03.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:03.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:03.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:03.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:03.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cb7d0 con 0x5595236c3cf0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cbb80 con 0x5595236c8110 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236cbb80 con 0x5595236c3cf0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:03.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 zone default found 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 4 Realm: () 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 zonegroup default 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d0380 con 0x7f3e7c008ba0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d20c0 con 0x5595236cd3b0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d2470 con 0x5595236cd3b0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 started sync module instance, tier type = 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.678+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d19a0 con 0x5595236c8110 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94099032839424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d1d50 con 0x5595236c8110 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d31d0 con 0x5595236c3cf0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94099032845616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d36b0 con 0x5595236c3cf0 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d4180 con 0x5595236c8110 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94099032839424] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.682+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94099032845616] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94099032849504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d4140 con 0x5595236c8110 2024-03-20T13:37:03.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d32c0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94099032851760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d4df0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d5810 con 0x5595236c8110 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94099032851760] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94099032849504] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94099032855280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d4950 con 0x5595236c8110 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.686+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d6060 con 0x5595236cd3b0 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94099032857536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d4950 con 0x5595236cd3b0 2024-03-20T13:37:03.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d6e70 con 0x5595236cd3b0 2024-03-20T13:37:03.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94099032855280] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94099032857536] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94099032844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d64d0 con 0x5595236cd3b0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d7580 con 0x7f3e7c008ba0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94099032844432] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94099032862816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d7540 con 0x7f3e7c008ba0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=0 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=1 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=2 2024-03-20T13:37:03.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=3 2024-03-20T13:37:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=4 2024-03-20T13:37:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=5 2024-03-20T13:37:03.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=6 2024-03-20T13:37:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94099032862816] v32'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 20 add_watcher() i=7 2024-03-20T13:37:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:03.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.690+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236daab0 con 0x5595236c3cf0 2024-03-20T13:37:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94099032861136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236d7f90 con 0x5595236c3cf0 2024-03-20T13:37:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94099032861136] v32'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3d337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3e844b0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3e844b0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:03.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.694+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e30b0 con 0x5595236c8110 2024-03-20T13:37:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.698+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.698+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e3130 con 0x7f3e7c008ba0 2024-03-20T13:37:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.698+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.698+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e3590 con 0x5595236cd3b0 2024-03-20T13:37:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.698+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.698+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e3ac0 con 0x5595236c3cf0 2024-03-20T13:37:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.702+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.702+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e3ff0 con 0x5595236c8110 2024-03-20T13:37:03.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.702+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'42 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.702+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e4520 con 0x5595236cd3b0 2024-03-20T13:37:03.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.702+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.702+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e4a50 con 0x5595236c8110 2024-03-20T13:37:03.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.706+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.706+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e4f80 con 0x5595236c3cf0 2024-03-20T13:37:03.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.706+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.706+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e54b0 con 0x5595236c8110 2024-03-20T13:37:03.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.710+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.710+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e54b0 con 0x5595236c8110 2024-03-20T13:37:03.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.710+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.710+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e54b0 con 0x5595236c8110 2024-03-20T13:37:03.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.714+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'43 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.714+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e54b0 con 0x5595236cd3b0 2024-03-20T13:37:03.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.714+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.714+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e54b0 con 0x5595236c8110 2024-03-20T13:37:03.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.718+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.718+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e54b0 con 0x5595236c3cf0 2024-03-20T13:37:03.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.718+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.718+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c3cf0 2024-03-20T13:37:03.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.722+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.722+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.722+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.722+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.726+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'44 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.726+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236cd3b0 2024-03-20T13:37:03.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.726+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.726+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.730+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.730+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c3cf0 2024-03-20T13:37:03.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.730+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.730+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.734+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.734+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.734+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.734+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236cd3b0 2024-03-20T13:37:03.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.734+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.734+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.738+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.738+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236cd3b0 2024-03-20T13:37:03.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.742+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.742+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236cd3b0 2024-03-20T13:37:03.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.742+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.742+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236cd3b0 2024-03-20T13:37:03.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.742+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.742+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.746+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.746+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c3cf0 2024-03-20T13:37:03.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.746+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.746+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e5950 con 0x5595236c8110 2024-03-20T13:37:03.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.750+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.750+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e2ad0 con 0x5595236c3cf0 2024-03-20T13:37:03.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.750+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.750+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e2af0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3d327fc640 20 reqs_thread_entry: start 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 Filter name: none 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3ca3fff640 20 reqs_thread_entry: start 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595236e1540 con 0x7f3e7c008ba0 2024-03-20T13:37:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:03.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595237012b0 con 0x5595236c8110 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(95 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 get_obj_state: octx=0x5595236b1b10 obj=myfoo:four state=0x559523701b08 s->prefetch_data=0 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:96 3.38s0 3:1e458f66:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702d60 con 0x5595236cd3b0 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(96 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1_four [getxattrs out=847b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+863 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 10 manifest: total_size = 4 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.883738450162494618 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 get_obj_state: octx=0x5595236b1b10 obj=myfoo:four state=0x559523701b08 s->prefetch_data=0 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 prepare_atomic_modification: state is not atomic. state=0x559523701b08 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.754+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:97 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523707710 con 0x5595236cd3b0 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.758+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(97 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.758+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:98 3.38s0 3:1e458f66:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523707710 con 0x5595236cd3b0 2024-03-20T13:37:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.758+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(98 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1_four [call] v32'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.758+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:99 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523707cb0 con 0x5595236cd3b0 2024-03-20T13:37:03.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.762+0000 7f3d337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.762+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94099032861136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523707c90 con 0x5595236c3cf0 2024-03-20T13:37:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.762+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(99 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.762+0000 7f3d657fa640 20 handle_completion(): completion ok for obj=four 2024-03-20T13:37:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.762+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94099032861136] v32'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.762+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94099032839424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x5595236c8110 2024-03-20T13:37:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94099032839424] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 20 remove_watcher() i=0 2024-03-20T13:37:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 2 removed watcher, disabling cache 2024-03-20T13:37:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94099032845616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x5595236c3cf0 2024-03-20T13:37:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94099032845616] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x5595236c3cf0 2024-03-20T13:37:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 20 remove_watcher() i=1 2024-03-20T13:37:03.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94099032849504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x5595236c8110 2024-03-20T13:37:03.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94099032849504] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 20 remove_watcher() i=2 2024-03-20T13:37:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.766+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94099032851760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94099032851760] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e844b0980 20 remove_watcher() i=3 2024-03-20T13:37:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94099032855280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x5595236c8110 2024-03-20T13:37:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e827cc640 1 -- 172.21.15.123:0/499379744 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94099032855280] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7c00a4d0 con 0x5595236c8110 2024-03-20T13:37:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e844b0980 20 remove_watcher() i=4 2024-03-20T13:37:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94099032857536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x5595236cd3b0 2024-03-20T13:37:03.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94099032857536] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e844b0980 20 remove_watcher() i=5 2024-03-20T13:37:03.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.770+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94099032844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523702be0 con 0x5595236cd3b0 2024-03-20T13:37:03.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e81fcb640 1 -- 172.21.15.123:0/499379744 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94099032844432] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e740c2030 con 0x5595236cd3b0 2024-03-20T13:37:03.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 20 remove_watcher() i=6 2024-03-20T13:37:03.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94099032862816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559523707c90 con 0x7f3e7c008ba0 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94099032862816] v32'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e7800e5a0 con 0x7f3e7c008ba0 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 20 remove_watcher() i=7 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595236c8110 msgr2=0x5595236ca500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5595236c8110 0x5595236ca500 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595236c3cf0 msgr2=0x5595236c61b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5595236c3cf0 0x5595236c61b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3e7c008ba0 msgr2=0x7f3e7c04b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3e7c008ba0 0x7f3e7c04b8b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595236cd3b0 msgr2=0x5595236cf870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5595236cd3b0 0x5595236cf870 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d4c0342b0 msgr2=0x7f3d4c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d4c0342b0 0x7f3d4c036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3e740bbd30 tx=0x7f3e740db000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e817ca640 1 -- 172.21.15.123:0/499379744 reap_dead start 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 msgr2=0x5595236b85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b85f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00dce0 tx=0x7f3e7c0498d0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 shutdown_connections 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/499379744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236b1730 0x5595236b85f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 >> 172.21.15.123:0/499379744 conn(0x5595236adac0 msgr2=0x5595236ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 shutdown_connections 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/499379744 wait complete. 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d5c0342b0 msgr2=0x7f3d5c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d5c0342b0 0x7f3d5c036770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x559523694ce0 tx=0x7f3e740bbc80 comp rx=0 tx=0).stop 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 msgr2=0x5595236a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 0x5595236a4c00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c016cf0 tx=0x7f3e7c00d790 comp rx=0 tx=0).stop 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 shutdown_connections 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d5c0342b0 0x7f3d5c036770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/1428248446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595236a47e0 0x5595236a4c00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 >> 172.21.15.123:0/1428248446 conn(0x5595236995f0 msgr2=0x55952369a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 shutdown_connections 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/1428248446 wait complete. 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559523691d30 msgr2=0x559523694120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559523691d30 0x559523694120 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55952350d150 msgr2=0x559523690f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55952350d150 0x559523690f80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d68034300 msgr2=0x7f3d680367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d68034300 0x7f3d680367c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3e78000f70 tx=0x7f3e780012c0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 msgr2=0x55952368a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x55952368a350 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3e74000c10 tx=0x7f3e74018020 comp rx=0 tx=0).stop 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 shutdown_connections 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559523691d30 0x559523694120 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55952350d150 0x559523690f80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3d68034300 0x7f3d680367c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 --2- 172.21.15.123:0/3384066120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55952350bc40 0x55952368a350 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 >> 172.21.15.123:0/3384066120 conn(0x559523592820 msgr2=0x55952367dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 shutdown_connections 2024-03-20T13:37:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.774+0000 7f3e844b0980 1 -- 172.21.15.123:0/3384066120 wait complete. 2024-03-20T13:37:03.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:37:03.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:37:03.793 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-03-20T13:37:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46cfcf980 1 Processor -- start 2024-03-20T13:37:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46cfcf980 1 -- start start 2024-03-20T13:37:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46cfcf980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b1bc905350 0x55b1bc907740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46cfcf980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b1bc84e520 con 0x55b1bc900e40 2024-03-20T13:37:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46cfcf980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b1bc8150f0 con 0x55b1bc905350 2024-03-20T13:37:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46a2e9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b1bc905350 0x55b1bc907740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46a2e9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b1bc905350 0x55b1bc907740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33500/0 (socket says 172.21.15.123:33500) 2024-03-20T13:37:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3178001222 learned_addr learned my addr 172.21.15.123:0/3178001222 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3178001222 >> v1:172.21.15.89:6789/0 conn(0x55b1bc900e40 legacy=0x55b1bc901220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.866+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3178001222 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1bc908c90 con 0x55b1bc905350 2024-03-20T13:37:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/3178001222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc905350 0x55b1bc907740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb46000a5c0 tx=0x7fb46001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce46773baf654dc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb469ae8640 1 -- 172.21.15.123:0/3178001222 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4600aa470 con 0x55b1bc905350 2024-03-20T13:37:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb469ae8640 1 -- 172.21.15.123:0/3178001222 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4600aa5d0 con 0x55b1bc905350 2024-03-20T13:37:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb469ae8640 1 -- 172.21.15.123:0/3178001222 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4600aa890 con 0x55b1bc905350 2024-03-20T13:37:03.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3178001222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc905350 msgr2=0x55b1bc907740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3178001222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc905350 0x55b1bc907740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb46000a5c0 tx=0x7fb46001b340 comp rx=0 tx=0).stop 2024-03-20T13:37:03.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3178001222 shutdown_connections 2024-03-20T13:37:03.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3178001222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc905350 0x55b1bc907740 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3178001222 >> 172.21.15.123:0/3178001222 conn(0x55b1bc8fc710 msgr2=0x55b1bc8feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3178001222 shutdown_connections 2024-03-20T13:37:03.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.870+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3178001222 wait complete. 2024-03-20T13:37:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46cfcf980 1 Processor -- start 2024-03-20T13:37:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46cfcf980 1 -- start start 2024-03-20T13:37:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46cfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46cfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1bc812620 con 0x55b1bc900e40 2024-03-20T13:37:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46aaea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46aaea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33512/0 (socket says 172.21.15.123:33512) 2024-03-20T13:37:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46aaea640 1 -- 172.21.15.123:0/3714000171 learned_addr learned my addr 172.21.15.123:0/3714000171 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.882+0000 7fb46aaea640 1 -- 172.21.15.123:0/3714000171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb460005df0 con 0x55b1bc900e40 2024-03-20T13:37:03.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46aaea640 1 --2- 172.21.15.123:0/3714000171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9eae80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb45c006fb0 tx=0x7fb45c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea4093b4c247ec8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb358e09640 1 -- 172.21.15.123:0/3714000171 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45c00f640 con 0x55b1bc900e40 2024-03-20T13:37:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb358e09640 1 -- 172.21.15.123:0/3714000171 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c00f7c0 con 0x55b1bc900e40 2024-03-20T13:37:03.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb358e09640 1 -- 172.21.15.123:0/3714000171 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45c00fae0 con 0x55b1bc900e40 2024-03-20T13:37:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3714000171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 msgr2=0x55b1bc9eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3714000171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9eae80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb45c006fb0 tx=0x7fb45c001940 comp rx=0 tx=0).stop 2024-03-20T13:37:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3714000171 shutdown_connections 2024-03-20T13:37:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3714000171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9eae80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3714000171 >> 172.21.15.123:0/3714000171 conn(0x55b1bc8fc710 msgr2=0x55b1bc9e6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3714000171 shutdown_connections 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3714000171 wait complete. 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 Processor -- start 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- start start 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1bc80de00 con 0x55b1bc900e40 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46aaea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46aaea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33516/0 (socket says 172.21.15.123:33516) 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46aaea640 1 -- 172.21.15.123:0/4276830675 learned_addr learned my addr 172.21.15.123:0/4276830675 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46aaea640 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1bc84e520 con 0x55b1bc900e40 2024-03-20T13:37:03.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46aaea640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9f2e40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55b1bc9ebd10 tx=0x7fb45c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb357606640 1 -- 172.21.15.123:0/4276830675 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45c005450 con 0x55b1bc900e40 2024-03-20T13:37:03.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1bc9f3380 con 0x55b1bc900e40 2024-03-20T13:37:03.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb357606640 1 -- 172.21.15.123:0/4276830675 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c0055b0 con 0x55b1bc900e40 2024-03-20T13:37:03.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb357606640 1 -- 172.21.15.123:0/4276830675 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45c005890 con 0x55b1bc900e40 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.886+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1bc9f37b0 con 0x55b1bc900e40 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb357606640 1 -- 172.21.15.123:0/4276830675 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb45c0059f0 con 0x55b1bc900e40 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb357606640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3500342b0 0x7fb350036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb357606640 1 -- 172.21.15.123:0/4276830675 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb45c049270 con 0x55b1bc900e40 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3500342b0 0x7fb350036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bc9f7ab0 0x55b1bc9f9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bc9fa3e0 con 0x55b1bc9f7ab0 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bc9f7ab0 0x55b1bc9f9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3500342b0 0x7fb350036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb4600ae000 tx=0x7fb4600a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bc9f7ab0 0x55b1bc9f9ea0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46b2eb640 1 -- 172.21.15.123:0/4276830675 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4640083f0 con 0x55b1bc9f7ab0 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bc9fac50 0x55b1bc9fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bc9fd7a0 con 0x55b1bc9fac50 2024-03-20T13:37:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46aaea640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bc9fac50 0x55b1bc9fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46aaea640 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bc9fac50 0x55b1bc9fd070 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46aaea640 1 -- 172.21.15.123:0/4276830675 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bc9fac50 2024-03-20T13:37:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bc9fefe0 con 0x55b1bc9fac50 2024-03-20T13:37:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46aaea640 1 -- 172.21.15.123:0/4276830675 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bc9fac50 2024-03-20T13:37:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.890+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bc9fe1e0 con 0x55b1bc9fac50 2024-03-20T13:37:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46aaea640 1 -- 172.21.15.123:0/4276830675 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bc9fac50 2024-03-20T13:37:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bc9fe5f0 con 0x55b1bc9f7ab0 2024-03-20T13:37:03.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46b2eb640 1 -- 172.21.15.123:0/4276830675 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb4640083f0 con 0x55b1bc9f7ab0 2024-03-20T13:37:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 Processor -- start 2024-03-20T13:37:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 -- start start 2024-03-20T13:37:03.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 0x55b1bca0db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1bc7a6e30 con 0x55b1bca0d6e0 2024-03-20T13:37:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46b2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 0x55b1bca0db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46b2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 0x55b1bca0db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33526/0 (socket says 172.21.15.123:33526) 2024-03-20T13:37:03.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46b2eb640 1 -- 172.21.15.123:0/2076622671 learned_addr learned my addr 172.21.15.123:0/2076622671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46b2eb640 1 -- 172.21.15.123:0/2076622671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1bca0e040 con 0x55b1bca0d6e0 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 0x55b1bca0db00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb46400aae0 tx=0x7fb464008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb354e01640 1 -- 172.21.15.123:0/2076622671 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46401d070 con 0x55b1bca0d6e0 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1bca0e290 con 0x55b1bca0d6e0 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb354e01640 1 -- 172.21.15.123:0/2076622671 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464010040 con 0x55b1bca0d6e0 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1bca0ede0 con 0x55b1bca0d6e0 2024-03-20T13:37:03.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb354e01640 1 -- 172.21.15.123:0/2076622671 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb464007e50 con 0x55b1bca0d6e0 2024-03-20T13:37:03.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.894+0000 7fb354e01640 1 -- 172.21.15.123:0/2076622671 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb464018430 con 0x55b1bca0d6e0 2024-03-20T13:37:03.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb354e01640 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3440342b0 0x7fb344036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb354e01640 1 -- 172.21.15.123:0/2076622671 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb46404a600 con 0x55b1bca0d6e0 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46aaea640 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3440342b0 0x7fb344036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 Processor -- start 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- start start 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46aaea640 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3440342b0 0x7fb344036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55b1bc9fdce0 tx=0x7fb45c046040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bc9e9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1bc79a790 con 0x55b1bc9e92f0 2024-03-20T13:37:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bc9e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bc9e9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33542/0 (socket says 172.21.15.123:33542) 2024-03-20T13:37:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 -- 172.21.15.123:0/1818444738 learned_addr learned my addr 172.21.15.123:0/1818444738 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 -- 172.21.15.123:0/1818444738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1bc9e7b40 con 0x55b1bc9e92f0 2024-03-20T13:37:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/1818444738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bc9e9710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb464048a20 tx=0x7fb4640164f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d580e4b0acd9a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb34e7fc640 1 -- 172.21.15.123:0/1818444738 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb464047070 con 0x55b1bc9e92f0 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb34e7fc640 1 -- 172.21.15.123:0/1818444738 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464039220 con 0x55b1bc9e92f0 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb34e7fc640 1 -- 172.21.15.123:0/1818444738 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb464022410 con 0x55b1bc9e92f0 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- 172.21.15.123:0/1818444738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 msgr2=0x55b1bc9e9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/1818444738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bc9e9710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb464048a20 tx=0x7fb4640164f0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- 172.21.15.123:0/1818444738 shutdown_connections 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/1818444738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bc9e9710 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- 172.21.15.123:0/1818444738 >> 172.21.15.123:0/1818444738 conn(0x55b1bca16960 msgr2=0x55b1bca149c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- 172.21.15.123:0/1818444738 shutdown_connections 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- 172.21.15.123:0/1818444738 wait complete. 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 Processor -- start 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- start start 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bca23670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46cfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1bca23bb0 con 0x55b1bc9e92f0 2024-03-20T13:37:03.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bca23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bca23670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33552/0 (socket says 172.21.15.123:33552) 2024-03-20T13:37:03.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 learned_addr learned my addr 172.21.15.123:0/3948565815 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.898+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1bca0ede0 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bca23670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb464016970 tx=0x7fb464048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb34cff9640 1 -- 172.21.15.123:0/3948565815 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb464032030 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb34cff9640 1 -- 172.21.15.123:0/3948565815 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464021da0 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1bca23db0 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb34cff9640 1 -- 172.21.15.123:0/3948565815 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4640206a0 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1bca241e0 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb34cff9640 1 -- 172.21.15.123:0/3948565815 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb464035070 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb34cff9640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3340342b0 0x7fb334036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb34cff9640 1 -- 172.21.15.123:0/3948565815 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb464033070 con 0x55b1bc9e92f0 2024-03-20T13:37:03.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46aaea640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3340342b0 0x7fb334036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bca2ed50 0x55b1bca31210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca31960 con 0x55b1bca2ed50 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bca2ed50 0x55b1bca31210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46aaea640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3340342b0 0x7fb334036770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0495a0 tx=0x7fb45c032040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bca2ed50 0x55b1bca31210 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 realm 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca31d50 con 0x55b1bca2ed50 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:03.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca325a0 con 0x55b1bca2ed50 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bca32f80 0x55b1bca353b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca35b20 con 0x55b1bca32f80 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bca32f80 0x55b1bca353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.902+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bca32f80 0x55b1bca353b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca36370 con 0x55b1bca32f80 2024-03-20T13:37:03.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 20 searching for the correct realm 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b1bca38090 0x55b1bca3a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca38090 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46aaea640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b1bca38090 0x55b1bca3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46aaea640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b1bca38090 0x55b1bca3a480 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca32f80 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46b2eb640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb464020800 0x7fb46403a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x7fb464020800 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb464020800 0x7fb46403a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46a2e9640 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb464020800 0x7fb46403a270 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x7fb464020800 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca2ed50 2024-03-20T13:37:03.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.906+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca2ed50 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca38090 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca2ed50 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca32f80 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca32f80 2024-03-20T13:37:03.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca2ed50 2024-03-20T13:37:03.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x7fb464020800 2024-03-20T13:37:03.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x7fb464020800 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca2ed50 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x7fb464020800 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb4600b0020 con 0x7fb464020800 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca32f80 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca38090 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca2ed50 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.910+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3aa10 con 0x55b1bca32f80 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca38090 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600b0020 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca38090 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x7fb464020800 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca2ed50 2024-03-20T13:37:03.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x7fb464020800 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca38090 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x7fb464020800 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.914+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca32f80 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca32f80 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca38090 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca32f80 2024-03-20T13:37:03.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb464065040 con 0x55b1bca32f80 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca36ca0 con 0x55b1bca2ed50 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca37050 con 0x55b1bca32f80 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca37050 con 0x55b1bca2ed50 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 zone default found 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 4 Realm: () 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 zonegroup default 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3ae50 con 0x7fb464020800 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3d030 con 0x55b1bca38090 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.918+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3d390 con 0x55b1bca38090 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 20 started sync module instance, tier type = 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:03.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3c600 con 0x55b1bca32f80 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb46401f070 con 0x55b1bca32f80 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94221862422960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3c600 con 0x55b1bca32f80 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3dd00 con 0x55b1bca2ed50 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94221862426720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3e120 con 0x55b1bca2ed50 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.922+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3ebc0 con 0x55b1bca32f80 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94221862422960] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94221862426720] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94221862430368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3dc80 con 0x55b1bca32f80 2024-03-20T13:37:03.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3f410 con 0x7fb464020800 2024-03-20T13:37:03.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94221862432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3dc80 con 0x7fb464020800 2024-03-20T13:37:03.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3ff20 con 0x55b1bca32f80 2024-03-20T13:37:03.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94221862432624] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94221862430368] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.926+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94221862420832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3fee0 con 0x55b1bca32f80 2024-03-20T13:37:03.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca3f500 con 0x55b1bca38090 2024-03-20T13:37:03.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94221862437584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca40b90 con 0x55b1bca38090 2024-03-20T13:37:03.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca41500 con 0x55b1bca38090 2024-03-20T13:37:03.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94221862420832] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94221862437584] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94221862435328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca41500 con 0x55b1bca38090 2024-03-20T13:37:03.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca41d80 con 0x7fb464020800 2024-03-20T13:37:03.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94221862443232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca41d60 con 0x7fb464020800 2024-03-20T13:37:03.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=0 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=1 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=2 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=3 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=4 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=5 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94221862435328] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.930+0000 7fb46cfcf980 20 add_watcher() i=6 2024-03-20T13:37:03.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94221862443232] v32'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 add_watcher() i=7 2024-03-20T13:37:03.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:03.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca410f0 con 0x55b1bca2ed50 2024-03-20T13:37:03.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94221862441152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca42260 con 0x55b1bca2ed50 2024-03-20T13:37:03.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94221862441152] v32'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb3217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:03.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 5 note: GC not initialized 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb29bfff640 20 reqs_thread_entry: start 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 Filter name: none 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb299ffb640 20 reqs_thread_entry: start 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca67570 con 0x7fb464020800 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.934+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca67ac0 con 0x55b1bca32f80 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(63 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca67b00 con 0x7fb464020800 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:03.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca68f60 con 0x55b1bca32f80 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(65 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 4.26 4:648b71d5:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca688f0 con 0x55b1bca2ed50 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 4.17 4:ea60608e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca6d6c0 con 0x55b1bca38090 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 4.14 4:2b6b807a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca6ffd0 con 0x55b1bca38090 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 4.f 4:f12bebf7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca72980 con 0x55b1bca2ed50 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 4.6 4:63dad39e:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca751a0 con 0x55b1bca38090 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 4.3a 4:5c9c4310:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77b40 con 0x55b1bca38090 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 4.3b 4:de11697d:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca38090 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 4.35 4:ad3fb945:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca7cfc0 con 0x55b1bca2ed50 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 4.7 4:e13968f4:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca7fe10 con 0x55b1bca2ed50 2024-03-20T13:37:03.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 4.19 4:98befe71:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca82850 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 4.34 4:2d65569c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca85270 con 0x7fb464020800 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(66 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(73 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(74 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(67 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(68 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(70 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fb4600d5060 con 0x7fb464020800 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados->read ofs=0 len=0 2024-03-20T13:37:03.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 6.11 6:8f1457b9:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca38090 2024-03-20T13:37:03.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:03.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb3217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:03.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.938+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94221862441152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca2ed50 2024-03-20T13:37:03.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.942+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94221862441152] v32'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb4600d5060 con 0x55b1bca2ed50 2024-03-20T13:37:03.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.942+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94221862422960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca32f80 2024-03-20T13:37:03.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.942+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94221862422960] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.942+0000 7fb46cfcf980 20 remove_watcher() i=0 2024-03-20T13:37:03.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.942+0000 7fb46cfcf980 2 removed watcher, disabling cache 2024-03-20T13:37:03.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.942+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94221862426720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca2ed50 2024-03-20T13:37:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94221862426720] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600e3040 con 0x55b1bca2ed50 2024-03-20T13:37:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46cfcf980 20 remove_watcher() i=1 2024-03-20T13:37:03.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94221862430368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca32f80 2024-03-20T13:37:03.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94221862430368] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46cfcf980 20 remove_watcher() i=2 2024-03-20T13:37:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94221862432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x7fb464020800 2024-03-20T13:37:03.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94221862432624] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600e3040 con 0x7fb464020800 2024-03-20T13:37:03.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46cfcf980 20 remove_watcher() i=3 2024-03-20T13:37:03.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.946+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94221862420832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca32f80 2024-03-20T13:37:03.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46b2eb640 1 -- 172.21.15.123:0/3948565815 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94221862420832] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb464072040 con 0x55b1bca32f80 2024-03-20T13:37:03.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46cfcf980 20 remove_watcher() i=4 2024-03-20T13:37:03.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94221862437584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca38090 2024-03-20T13:37:03.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94221862437584] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46cfcf980 20 remove_watcher() i=5 2024-03-20T13:37:03.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94221862435328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x55b1bca38090 2024-03-20T13:37:03.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46aaea640 1 -- 172.21.15.123:0/3948565815 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94221862435328] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb45c023070 con 0x55b1bca38090 2024-03-20T13:37:03.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46cfcf980 20 remove_watcher() i=6 2024-03-20T13:37:03.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.950+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94221862443232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1bca77c40 con 0x7fb464020800 2024-03-20T13:37:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94221862443232] v32'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4600e3040 con 0x7fb464020800 2024-03-20T13:37:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 20 remove_watcher() i=7 2024-03-20T13:37:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bca32f80 msgr2=0x55b1bca353b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bca32f80 0x55b1bca353b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bca2ed50 msgr2=0x55b1bca31210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bca2ed50 0x55b1bca31210 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb464020800 msgr2=0x7fb46403a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fb464020800 0x7fb46403a270 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b1bca38090 msgr2=0x55b1bca3a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b1bca38090 0x55b1bca3a480 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3340342b0 msgr2=0x7fb334036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3340342b0 0x7fb334036770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0495a0 tx=0x7fb45c032040 comp rx=0 tx=0).stop 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 msgr2=0x55b1bca23670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bca23670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb464016970 tx=0x7fb464048980 comp rx=0 tx=0).stop 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46a2e9640 1 -- 172.21.15.123:0/3948565815 reap_dead start 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 shutdown_connections 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/3948565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc9e92f0 0x55b1bca23670 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 >> 172.21.15.123:0/3948565815 conn(0x55b1bca16960 msgr2=0x55b1bca13fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 shutdown_connections 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/3948565815 wait complete. 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3440342b0 msgr2=0x7fb344036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3440342b0 0x7fb344036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55b1bc9fdce0 tx=0x7fb45c046040 comp rx=0 tx=0).stop 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 msgr2=0x55b1bca0db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 0x55b1bca0db00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb46400aae0 tx=0x7fb464008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 shutdown_connections 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3440342b0 0x7fb344036770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/2076622671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bca0d6e0 0x55b1bca0db00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 >> 172.21.15.123:0/2076622671 conn(0x55b1bca024f0 msgr2=0x55b1bca03000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 shutdown_connections 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/2076622671 wait complete. 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bc9fac50 msgr2=0x55b1bc9fd070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bc9fac50 0x55b1bc9fd070 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bc9f7ab0 msgr2=0x55b1bc9f9ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bc9f7ab0 0x55b1bc9f9ea0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3500342b0 msgr2=0x7fb350036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3500342b0 0x7fb350036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb4600ae000 tx=0x7fb4600a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 msgr2=0x55b1bc9f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9f2e40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55b1bc9ebd10 tx=0x7fb45c000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 shutdown_connections 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b1bc9fac50 0x55b1bc9fd070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b1bc9f7ab0 0x55b1bc9f9ea0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb3500342b0 0x7fb350036770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 --2- 172.21.15.123:0/4276830675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1bc900e40 0x55b1bc9f2e40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 >> 172.21.15.123:0/4276830675 conn(0x55b1bc8fc710 msgr2=0x55b1bc9e9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 shutdown_connections 2024-03-20T13:37:03.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:03.954+0000 7fb46cfcf980 1 -- 172.21.15.123:0/4276830675 wait complete. 2024-03-20T13:37:03.969 INFO:teuthology.orchestra.run.smithi123.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8ee97edf-01dc-402c-a19d-759426cef768","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","marker":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:37:03.251296Z","creation_time":"2024-03-20T13:36:59.684227Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-03-20T13:37:03.969 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8ee97edf-01dc-402c-a19d-759426cef768', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'marker': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:37:03.251296Z', 'creation_time': '2024-03-20T13:36:59.684227Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-03-20T13:37:03.969 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-03-20T13:37:03.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-03-20T13:37:03.970 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-03-20T13:37:04.041 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:04.041 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:04.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.034+0000 7f8e81640980 1 Processor -- start 2024-03-20T13:37:04.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.034+0000 7f8e81640980 1 -- start start 2024-03-20T13:37:04.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e81640980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a24a884340 0x55a24a886730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e81640980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a24a7cc510 con 0x55a24a7f48a0 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e81640980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a24a7930f0 con 0x55a24a884340 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e95a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a24a884340 0x55a24a886730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7f15b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55a24a7f48a0 0x55a24a882c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:40702/0 (socket says 172.21.15.123:40702) 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1163123518 learned_addr learned my addr 172.21.15.123:0/1163123518 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1163123518 >> v1:172.21.15.89:6789/0 conn(0x55a24a7f48a0 legacy=0x55a24a882c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1163123518 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a24a887cb0 con 0x55a24a884340 2024-03-20T13:37:04.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1163123518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a884340 0x55a24a886730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800a480 tx=0x7f8e6801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44036b5468ea4ea4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e159640 1 -- 172.21.15.123:0/1163123518 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e680ab540 con 0x55a24a884340 2024-03-20T13:37:04.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e159640 1 -- 172.21.15.123:0/1163123518 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680ab6a0 con 0x55a24a884340 2024-03-20T13:37:04.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.038+0000 7f8e7e159640 1 -- 172.21.15.123:0/1163123518 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e680ab960 con 0x55a24a884340 2024-03-20T13:37:04.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 -- 172.21.15.123:0/1163123518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a884340 msgr2=0x55a24a886730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 --2- 172.21.15.123:0/1163123518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a884340 0x55a24a886730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800a480 tx=0x7f8e6801b280 comp rx=0 tx=0).stop 2024-03-20T13:37:04.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 -- 172.21.15.123:0/1163123518 shutdown_connections 2024-03-20T13:37:04.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 --2- 172.21.15.123:0/1163123518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a884340 0x55a24a886730 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 -- 172.21.15.123:0/1163123518 >> 172.21.15.123:0/1163123518 conn(0x55a24a87a700 msgr2=0x55a24a87cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 -- 172.21.15.123:0/1163123518 shutdown_connections 2024-03-20T13:37:04.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.042+0000 7f8e81640980 1 -- 172.21.15.123:0/1163123518 wait complete. 2024-03-20T13:37:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 Processor -- start 2024-03-20T13:37:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- start start 2024-03-20T13:37:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a969e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24a790620 con 0x55a24a7f48a0 2024-03-20T13:37:04.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e7f15b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a969e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e7f15b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a969e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33574/0 (socket says 172.21.15.123:33574) 2024-03-20T13:37:04.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e7f15b640 1 -- 172.21.15.123:0/605103509 learned_addr learned my addr 172.21.15.123:0/605103509 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e7f15b640 1 -- 172.21.15.123:0/605103509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68005d30 con 0x55a24a7f48a0 2024-03-20T13:37:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/605103509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a969e60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8e70001c00 tx=0x7f8e7000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fe7e628040af0d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8d6d60a640 1 -- 172.21.15.123:0/605103509 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e7000e690 con 0x55a24a7f48a0 2024-03-20T13:37:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8d6d60a640 1 -- 172.21.15.123:0/605103509 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7000e810 con 0x55a24a7f48a0 2024-03-20T13:37:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8d6d60a640 1 -- 172.21.15.123:0/605103509 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e7000eb30 con 0x55a24a7f48a0 2024-03-20T13:37:04.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- 172.21.15.123:0/605103509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 msgr2=0x55a24a969e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 --2- 172.21.15.123:0/605103509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a969e60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8e70001c00 tx=0x7f8e7000b6d0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- 172.21.15.123:0/605103509 shutdown_connections 2024-03-20T13:37:04.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 --2- 172.21.15.123:0/605103509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a969e60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- 172.21.15.123:0/605103509 >> 172.21.15.123:0/605103509 conn(0x55a24a87a700 msgr2=0x55a24a9659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- 172.21.15.123:0/605103509 shutdown_connections 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.054+0000 7f8e81640980 1 -- 172.21.15.123:0/605103509 wait complete. 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 Processor -- start 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 -- start start 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a970cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24a78be00 con 0x55a24a7f48a0 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f15b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a970cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f15b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a970cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33576/0 (socket says 172.21.15.123:33576) 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1218979676 learned_addr learned my addr 172.21.15.123:0/1218979676 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a24a7cc510 con 0x55a24a7f48a0 2024-03-20T13:37:04.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a970cb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x55a24a96acf0 tx=0x7f8e70000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8d6be07640 1 -- 172.21.15.123:0/1218979676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e7001f070 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a24a9711f0 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8d6be07640 1 -- 172.21.15.123:0/1218979676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70001410 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8d6be07640 1 -- 172.21.15.123:0/1218979676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e7001aa90 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a24a971620 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8d6be07640 1 -- 172.21.15.123:0/1218979676 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8e7000a040 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8d6be07640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d640342b0 0x7f8d64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8d6be07640 1 -- 172.21.15.123:0/1218979676 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8e70049fe0 con 0x55a24a7f48a0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d640342b0 0x7f8d64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a884340 0x55a24a977930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a977e70 con 0x55a24a884340 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a884340 0x55a24a977930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d640342b0 0x7f8d64036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e680ad000 tx=0x7f8e680a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.058+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a884340 0x55a24a977930 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1218979676 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a884340 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9786e0 0x55a24a97ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a97b230 con 0x55a24a9786e0 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9786e0 0x55a24a97ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9786e0 0x55a24a97ab00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1218979676 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9786e0 2024-03-20T13:37:04.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a97ca70 con 0x55a24a9786e0 2024-03-20T13:37:04.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1218979676 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9786e0 2024-03-20T13:37:04.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a97bbb0 con 0x55a24a9786e0 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1218979676 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9786e0 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a97bfc0 con 0x55a24a884340 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1218979676 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a884340 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 Processor -- start 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 -- start start 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 0x55a24a98b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.062+0000 7f8e81640980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24a724e30 con 0x55a24a98b180 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 0x55a24a98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 0x55a24a98b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33590/0 (socket says 172.21.15.123:33590) 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1216251527 learned_addr learned my addr 172.21.15.123:0/1216251527 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1216251527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a24a98bae0 con 0x55a24a98b180 2024-03-20T13:37:04.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 0x55a24a98b5a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e78016cf0 tx=0x7f8e7800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8d69602640 1 -- 172.21.15.123:0/1216251527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e78017660 con 0x55a24a98b180 2024-03-20T13:37:04.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a24a98bd30 con 0x55a24a98b180 2024-03-20T13:37:04.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a24a98c880 con 0x55a24a98b180 2024-03-20T13:37:04.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8d69602640 1 -- 172.21.15.123:0/1216251527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e780177c0 con 0x55a24a98b180 2024-03-20T13:37:04.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8d69602640 1 -- 172.21.15.123:0/1216251527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e78017a60 con 0x55a24a98b180 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8d69602640 1 -- 172.21.15.123:0/1216251527 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8e7801d020 con 0x55a24a98b180 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8d69602640 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d580342b0 0x7f8d58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8d69602640 1 -- 172.21.15.123:0/1216251527 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8e7804b600 con 0x55a24a98b180 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d580342b0 0x7f8d58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e81640980 1 Processor -- start 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d580342b0 0x7f8d58036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55a24a97b6b0 tx=0x7f8e70023cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e81640980 1 -- start start 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e81640980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a9984f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e81640980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24a718790 con 0x55a24a9980d0 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a9984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a9984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33594/0 (socket says 172.21.15.123:33594) 2024-03-20T13:37:04.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.066+0000 7f8e7f95c640 1 -- 172.21.15.123:0/752825398 learned_addr learned my addr 172.21.15.123:0/752825398 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 -- 172.21.15.123:0/752825398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a24a998ac0 con 0x55a24a9980d0 2024-03-20T13:37:04.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/752825398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a9984f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8e78015010 tx=0x7f8e78049be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae1a17bbadc85aa server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d62ffd640 1 -- 172.21.15.123:0/752825398 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e78017c10 con 0x55a24a9980d0 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d62ffd640 1 -- 172.21.15.123:0/752825398 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e78017d70 con 0x55a24a9980d0 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d62ffd640 1 -- 172.21.15.123:0/752825398 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e78011e00 con 0x55a24a9980d0 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/752825398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 msgr2=0x55a24a9984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 --2- 172.21.15.123:0/752825398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a9984f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8e78015010 tx=0x7f8e78049be0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/752825398 shutdown_connections 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 --2- 172.21.15.123:0/752825398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a9984f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/752825398 >> 172.21.15.123:0/752825398 conn(0x55a24a994410 msgr2=0x55a24a9924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/752825398 shutdown_connections 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/752825398 wait complete. 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 Processor -- start 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- start start 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a99ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24a99f450 con 0x55a24a9980d0 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a99ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a99ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33608/0 (socket says 172.21.15.123:33608) 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 learned_addr learned my addr 172.21.15.123:0/1410443211 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a24a98c880 con 0x55a24a9980d0 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a99ef10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800dce0 tx=0x7f8e780498c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d617fa640 1 -- 172.21.15.123:0/1410443211 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e78031070 con 0x55a24a9980d0 2024-03-20T13:37:04.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a24a99f650 con 0x55a24a9980d0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d617fa640 1 -- 172.21.15.123:0/1410443211 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e780296d0 con 0x55a24a9980d0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a24a99fa80 con 0x55a24a9980d0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d617fa640 1 -- 172.21.15.123:0/1410443211 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e78048340 con 0x55a24a9980d0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.070+0000 7f8d617fa640 1 -- 172.21.15.123:0/1410443211 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8e78014920 con 0x55a24a9980d0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8d617fa640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d48034260 0x7f8d48036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8d617fa640 1 -- 172.21.15.123:0/1410443211 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8e78049550 con 0x55a24a9980d0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d48034260 0x7f8d48036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a9aa5e0 0x55a24a9aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ad1d0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a9aa5e0 0x55a24a9aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d48034260 0x7f8d48036720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e70048690 tx=0x7f8e70035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a9aa5e0 0x55a24a9aca80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e680abc30 con 0x55a24a9aa5e0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 realm 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ad5c0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e680abc30 con 0x55a24a9aa5e0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ade10 con 0x55a24a9aa5e0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e680abc30 con 0x55a24a9aa5e0 2024-03-20T13:37:04.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9ae7f0 0x55a24a9b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1390 con 0x55a24a9ae7f0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9ae7f0 0x55a24a9b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9ae7f0 0x55a24a9b0c20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 20 searching for the correct realm 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a24a9b3900 0x55a24a9b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b6280 con 0x55a24a9b3900 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.074+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a24a9b3900 0x55a24a9b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f15b640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a24a9b3900 0x55a24a9b5cf0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b6280 con 0x55a24a9ae7f0 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f95c640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8e78055040 0x7f8e78043830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8e78055040 0x7f8e78043830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8e78055040 0x7f8e78043830 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680abc30 con 0x7f8e78055040 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.078+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7800a4d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x7f8e78055040 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8e680c8040 con 0x7f8e78055040 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680c8040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.082+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.086+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b23e0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b2790 con 0x55a24a9ae7f0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b2790 con 0x55a24a9aa5e0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 zone default found 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 4 Realm: () 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:04.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 zonegroup default 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b3010 con 0x7f8e78055040 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b8540 con 0x55a24a9b3900 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b88a0 con 0x55a24a9b3900 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 started sync module instance, tier type = 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.090+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b7b10 con 0x55a24a9ae7f0 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94155524767424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b7b10 con 0x55a24a9ae7f0 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b9210 con 0x55a24a9aa5e0 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94155524771184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b9190 con 0x55a24a9aa5e0 2024-03-20T13:37:04.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ba100 con 0x55a24a9ae7f0 2024-03-20T13:37:04.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94155524767424] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94155524771184] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94155524773312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ba0c0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.094+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ba950 con 0x7f8e78055040 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94155524777136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9ba0c0 con 0x7f8e78055040 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb420 con 0x55a24a9ae7f0 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94155524777136] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94155524773312] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94155524774912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb420 con 0x55a24a9ae7f0 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94155524779792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bc020 con 0x55a24a9b3900 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bc9f0 con 0x55a24a9b3900 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.098+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94155524774912] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94155524779792] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94155524785392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bbb80 con 0x55a24a9b3900 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bd240 con 0x7f8e78055040 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94155524787616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bd660 con 0x7f8e78055040 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94155524785392] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=0 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=1 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=2 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=3 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=4 2024-03-20T13:37:04.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=5 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=6 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94155524787616] v32'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 20 add_watcher() i=7 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9c0690 con 0x55a24a9aa5e0 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.102+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94155524788672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bda80 con 0x55a24a9aa5e0 2024-03-20T13:37:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94155524788672] v32'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e81640980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:04.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e81640980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e81640980 5 note: GC not initialized 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8d34fe1640 20 reqs_thread_entry: start 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e81640980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e81640980 20 Filter name: none 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8cae7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9e1ab0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b3010 con 0x55a24a9aa5e0 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'5 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b3010 con 0x55a24a9ae7f0 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x7f8e78055040 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.106+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b1be0 con 0x55a24a9b3900 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'28 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8e7000dc90 con 0x55a24a9b3900 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.110+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.114+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb7d0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'44 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9b3900 2024-03-20T13:37:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9b3900 2024-03-20T13:37:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9b3900 2024-03-20T13:37:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8e7005b070 con 0x55a24a9b3900 2024-03-20T13:37:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.118+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9aa5e0 2024-03-20T13:37:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x7f8e78055040 2024-03-20T13:37:04.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8e7807a040 con 0x55a24a9b3900 2024-03-20T13:37:04.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8e700650e0 con 0x55a24a9b3900 2024-03-20T13:37:04.127 INFO:teuthology.orchestra.run.smithi123.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-03-20T13:37:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.122+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94155524788672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b3010 con 0x55a24a9aa5e0 2024-03-20T13:37:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94155524788672] v32'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94155524767424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9bb780 con 0x55a24a9ae7f0 2024-03-20T13:37:04.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94155524767424] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e81640980 20 remove_watcher() i=0 2024-03-20T13:37:04.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e81640980 2 removed watcher, disabling cache 2024-03-20T13:37:04.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94155524771184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b7ec0 con 0x55a24a9aa5e0 2024-03-20T13:37:04.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94155524771184] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x55a24a9aa5e0 2024-03-20T13:37:04.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e81640980 20 remove_watcher() i=1 2024-03-20T13:37:04.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.126+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94155524773312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b7ec0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.130+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94155524773312] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.130+0000 7f8e81640980 20 remove_watcher() i=2 2024-03-20T13:37:04.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.130+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94155524777136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b95c0 con 0x7f8e78055040 2024-03-20T13:37:04.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.130+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94155524777136] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.130+0000 7f8e81640980 20 remove_watcher() i=3 2024-03-20T13:37:04.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.130+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94155524774912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b7ec0 con 0x55a24a9ae7f0 2024-03-20T13:37:04.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e7f95c640 1 -- 172.21.15.123:0/1410443211 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94155524774912] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e78064040 con 0x55a24a9ae7f0 2024-03-20T13:37:04.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 20 remove_watcher() i=4 2024-03-20T13:37:04.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94155524779792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b95c0 con 0x55a24a9b3900 2024-03-20T13:37:04.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94155524779792] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e700650e0 con 0x55a24a9b3900 2024-03-20T13:37:04.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 20 remove_watcher() i=5 2024-03-20T13:37:04.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94155524785392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b9c00 con 0x55a24a9b3900 2024-03-20T13:37:04.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e7f15b640 1 -- 172.21.15.123:0/1410443211 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94155524785392] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e700650e0 con 0x55a24a9b3900 2024-03-20T13:37:04.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 20 remove_watcher() i=6 2024-03-20T13:37:04.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94155524787616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a24a9b7ec0 con 0x7f8e78055040 2024-03-20T13:37:04.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94155524787616] v32'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8e680d5060 con 0x7f8e78055040 2024-03-20T13:37:04.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.134+0000 7f8e81640980 20 remove_watcher() i=7 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9ae7f0 msgr2=0x55a24a9b0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9ae7f0 0x55a24a9b0c20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a9aa5e0 msgr2=0x55a24a9aca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a9aa5e0 0x55a24a9aca80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8e78055040 msgr2=0x7f8e78043830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f8e78055040 0x7f8e78043830 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a24a9b3900 msgr2=0x55a24a9b5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a24a9b3900 0x55a24a9b5cf0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d48034260 msgr2=0x7f8d48036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d48034260 0x7f8d48036720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e70048690 tx=0x7f8e70035000 comp rx=0 tx=0).stop 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 msgr2=0x55a24a99ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e7e95a640 1 -- 172.21.15.123:0/1410443211 reap_dead start 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a99ef10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800dce0 tx=0x7f8e780498c0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 shutdown_connections 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1410443211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a9980d0 0x55a24a99ef10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 >> 172.21.15.123:0/1410443211 conn(0x55a24a994410 msgr2=0x55a24a991ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 shutdown_connections 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1410443211 wait complete. 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d580342b0 msgr2=0x7f8d58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d580342b0 0x7f8d58036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55a24a97b6b0 tx=0x7f8e70023cd0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 msgr2=0x55a24a98b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 0x55a24a98b5a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e78016cf0 tx=0x7f8e7800d790 comp rx=0 tx=0).stop 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 shutdown_connections 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d580342b0 0x7f8d58036770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1216251527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a98b180 0x55a24a98b5a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 >> 172.21.15.123:0/1216251527 conn(0x55a24a97ff90 msgr2=0x55a24a980aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 shutdown_connections 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1216251527 wait complete. 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9786e0 msgr2=0x55a24a97ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9786e0 0x55a24a97ab00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a884340 msgr2=0x55a24a977930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a884340 0x55a24a977930 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d640342b0 msgr2=0x7f8d64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d640342b0 0x7f8d64036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e680ad000 tx=0x7f8e680a5040 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 msgr2=0x55a24a970cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a970cb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x55a24a96acf0 tx=0x7f8e70000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 shutdown_connections 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a24a9786e0 0x55a24a97ab00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a24a884340 0x55a24a977930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8d640342b0 0x7f8d64036770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 --2- 172.21.15.123:0/1218979676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a24a7f48a0 0x55a24a970cb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 >> 172.21.15.123:0/1218979676 conn(0x55a24a87a700 msgr2=0x55a24a964500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 shutdown_connections 2024-03-20T13:37:04.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.138+0000 7f8e81640980 1 -- 172.21.15.123:0/1218979676 wait complete. 2024-03-20T13:37:04.153 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-03-20T13:37:04.153 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-03-20T13:37:04.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-03-20T13:37:04.153 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-03-20T13:37:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fb0ec6980 1 Processor -- start 2024-03-20T13:37:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fb0ec6980 1 -- start start 2024-03-20T13:37:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fb0ec6980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556a9ca2a710 0x556a9ca2cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fb0ec6980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556a9c970520 con 0x556a9c998070 2024-03-20T13:37:04.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fb0ec6980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x556a9c9370f0 con 0x556a9ca2a710 2024-03-20T13:37:04.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae1e0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556a9ca2a710 0x556a9ca2cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae9e1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x556a9c998070 0x556a9ca28ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:40710/0 (socket says 172.21.15.123:40710) 2024-03-20T13:37:04.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae1e0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556a9ca2a710 0x556a9ca2cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33610/0 (socket says 172.21.15.123:33610) 2024-03-20T13:37:04.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae1e0640 1 -- 172.21.15.123:0/687164921 learned_addr learned my addr 172.21.15.123:0/687164921 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae1e0640 1 -- 172.21.15.123:0/687164921 >> v1:172.21.15.89:6789/0 conn(0x556a9c998070 legacy=0x556a9ca28ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae1e0640 1 -- 172.21.15.123:0/687164921 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9ca2e050 con 0x556a9ca2a710 2024-03-20T13:37:04.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/687164921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9ca2a710 0x556a9ca2cb00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800a5c0 tx=0x7f6f9801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c285d248b77b80 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fad9df640 1 -- 172.21.15.123:0/687164921 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f980aa470 con 0x556a9ca2a710 2024-03-20T13:37:04.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fad9df640 1 -- 172.21.15.123:0/687164921 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f980aa5d0 con 0x556a9ca2a710 2024-03-20T13:37:04.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.222+0000 7f6fad9df640 1 -- 172.21.15.123:0/687164921 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f980aa890 con 0x556a9ca2a710 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/687164921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9ca2a710 msgr2=0x556a9ca2cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/687164921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9ca2a710 0x556a9ca2cb00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800a5c0 tx=0x7f6f9801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/687164921 shutdown_connections 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/687164921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9ca2a710 0x556a9ca2cb00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/687164921 >> 172.21.15.123:0/687164921 conn(0x556a9ca1e6d0 msgr2=0x556a9ca20af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/687164921 shutdown_connections 2024-03-20T13:37:04.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.226+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/687164921 wait complete. 2024-03-20T13:37:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 Processor -- start 2024-03-20T13:37:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- start start 2024-03-20T13:37:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb10170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9c934620 con 0x556a9c998070 2024-03-20T13:37:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fae9e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb10170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fae9e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb10170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33620/0 (socket says 172.21.15.123:33620) 2024-03-20T13:37:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fae9e1640 1 -- 172.21.15.123:0/2671667881 learned_addr learned my addr 172.21.15.123:0/2671667881 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fae9e1640 1 -- 172.21.15.123:0/2671667881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98005df0 con 0x556a9c998070 2024-03-20T13:37:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/2671667881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb10170 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0001cc0 tx=0x7f6fa000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cd0034485e4d56 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6e9ce09640 1 -- 172.21.15.123:0/2671667881 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa0014070 con 0x556a9c998070 2024-03-20T13:37:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6e9ce09640 1 -- 172.21.15.123:0/2671667881 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000f590 con 0x556a9c998070 2024-03-20T13:37:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6e9ce09640 1 -- 172.21.15.123:0/2671667881 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa0007040 con 0x556a9c998070 2024-03-20T13:37:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2671667881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 msgr2=0x556a9cb10170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/2671667881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb10170 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0001cc0 tx=0x7f6fa000b610 comp rx=0 tx=0).stop 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2671667881 shutdown_connections 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/2671667881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb10170 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2671667881 >> 172.21.15.123:0/2671667881 conn(0x556a9ca1e6d0 msgr2=0x556a9cb0bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2671667881 shutdown_connections 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.238+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2671667881 wait complete. 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 Processor -- start 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 -- start start 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb17210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9c92fe00 con 0x556a9c998070 2024-03-20T13:37:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae9e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb17210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae9e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb17210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33636/0 (socket says 172.21.15.123:33636) 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae9e1640 1 -- 172.21.15.123:0/3098071979 learned_addr learned my addr 172.21.15.123:0/3098071979 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae9e1640 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9c970520 con 0x556a9c998070 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb17210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x556a9cb10f20 tx=0x7f6fa0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6e9b606640 1 -- 172.21.15.123:0/3098071979 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa0014030 con 0x556a9c998070 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a9cb17750 con 0x556a9c998070 2024-03-20T13:37:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6e9b606640 1 -- 172.21.15.123:0/3098071979 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa001c840 con 0x556a9c998070 2024-03-20T13:37:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6e9b606640 1 -- 172.21.15.123:0/3098071979 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa001cb40 con 0x556a9c998070 2024-03-20T13:37:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a9cb17b80 con 0x556a9c998070 2024-03-20T13:37:04.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6e9b606640 1 -- 172.21.15.123:0/3098071979 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fa001cca0 con 0x556a9c998070 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6e9b606640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e940342b0 0x7f6e94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6e9b606640 1 -- 172.21.15.123:0/3098071979 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6fa0006070 con 0x556a9c998070 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e940342b0 0x7f6e94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9ca2a710 0x556a9cb1de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb1e380 con 0x556a9ca2a710 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9ca2a710 0x556a9cb1de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e940342b0 0x7f6e94036770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f980ae000 tx=0x7f6f980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.242+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9ca2a710 0x556a9cb1de40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6faf1e2640 1 -- 172.21.15.123:0/3098071979 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9ca2a710 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb1ebf0 0x556a9cb20fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb216a0 con 0x556a9cb1ebf0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb1ebf0 0x556a9cb20fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb1ebf0 0x556a9cb20fe0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fae9e1640 1 -- 172.21.15.123:0/3098071979 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb1ebf0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb22ee0 con 0x556a9cb1ebf0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fae9e1640 1 -- 172.21.15.123:0/3098071979 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb1ebf0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb220e0 con 0x556a9cb1ebf0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fae9e1640 1 -- 172.21.15.123:0/3098071979 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb1ebf0 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb224f0 con 0x556a9ca2a710 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6faf1e2640 1 -- 172.21.15.123:0/3098071979 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9ca2a710 2024-03-20T13:37:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 Processor -- start 2024-03-20T13:37:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 -- start start 2024-03-20T13:37:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 0x556a9cb31980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.246+0000 7f6fb0ec6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9c8c8e30 con 0x556a9cb31560 2024-03-20T13:37:04.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6faf1e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 0x556a9cb31980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6faf1e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 0x556a9cb31980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33638/0 (socket says 172.21.15.123:33638) 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6faf1e2640 1 -- 172.21.15.123:0/2356091533 learned_addr learned my addr 172.21.15.123:0/2356091533 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6faf1e2640 1 -- 172.21.15.123:0/2356091533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9cb31ec0 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 0x556a9cb31980 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8016cf0 tx=0x7f6fa800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6e98e01640 1 -- 172.21.15.123:0/2356091533 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8017660 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6e98e01640 1 -- 172.21.15.123:0/2356091533 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80177c0 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a9cb32110 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6e98e01640 1 -- 172.21.15.123:0/2356091533 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8017a60 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a9cb32c60 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6e98e01640 1 -- 172.21.15.123:0/2356091533 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fa801d020 con 0x556a9cb31560 2024-03-20T13:37:04.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6e98e01640 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e880342b0 0x7f6e88036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6e98e01640 1 -- 172.21.15.123:0/2356091533 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6fa804b1b0 con 0x556a9cb31560 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e880342b0 0x7f6e88036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fb0ec6980 1 Processor -- start 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fb0ec6980 1 -- start start 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e880342b0 0x7f6e88036770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x556a9cb21be0 tx=0x7f6fa0018e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fb0ec6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb3e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6fb0ec6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9c8bc790 con 0x556a9cb3e500 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.250+0000 7f6faf1e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb3e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb3e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33646/0 (socket says 172.21.15.123:33646) 2024-03-20T13:37:04.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 -- 172.21.15.123:0/767513963 learned_addr learned my addr 172.21.15.123:0/767513963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 -- 172.21.15.123:0/767513963 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9cb3eef0 con 0x556a9cb3e500 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/767513963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb3e920 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80495a0 tx=0x7f6fa8014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292420a96128daff server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6e927fc640 1 -- 172.21.15.123:0/767513963 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa803b070 con 0x556a9cb3e500 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6e927fc640 1 -- 172.21.15.123:0/767513963 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80481d0 con 0x556a9cb3e500 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6e927fc640 1 -- 172.21.15.123:0/767513963 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa803b300 con 0x556a9cb3e500 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/767513963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 msgr2=0x556a9cb3e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/767513963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb3e920 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80495a0 tx=0x7f6fa8014740 comp rx=0 tx=0).stop 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/767513963 shutdown_connections 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/767513963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb3e920 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/767513963 >> 172.21.15.123:0/767513963 conn(0x556a9cb3a840 msgr2=0x556a9cb388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/767513963 shutdown_connections 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/767513963 wait complete. 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 Processor -- start 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- start start 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9cb458e0 con 0x556a9cb3e500 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33648/0 (socket says 172.21.15.123:33648) 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 learned_addr learned my addr 172.21.15.123:0/1697781608 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a9cb32c60 con 0x556a9cb3e500 2024-03-20T13:37:04.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb453a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6fa803a040 tx=0x7f6fa8049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6e90ff9640 1 -- 172.21.15.123:0/1697781608 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa801fac0 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a9cb45ae0 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6e90ff9640 1 -- 172.21.15.123:0/1697781608 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa801fc20 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6e90ff9640 1 -- 172.21.15.123:0/1697781608 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fa80113d0 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.254+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a9cb45f70 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6e90ff9640 1 -- 172.21.15.123:0/1697781608 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6fa8011640 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6e90ff9640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e780342b0 0x7f6e78036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6e90ff9640 1 -- 172.21.15.123:0/1697781608 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6fa8035cb0 con 0x556a9cb3e500 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e780342b0 0x7f6e78036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9cb50b30 0x556a9cb52ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb53740 con 0x556a9cb50b30 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9cb50b30 0x556a9cb52ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e780342b0 0x7f6e78036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0013fd0 tx=0x7f6fa0031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9cb50b30 0x556a9cb52ff0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 realm 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb53b30 con 0x556a9cb50b30 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb543b0 con 0x556a9cb50b30 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb54d90 0x556a9cb571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb57930 con 0x556a9cb54d90 2024-03-20T13:37:04.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb54d90 0x556a9cb571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb54d90 0x556a9cb571c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.258+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fb0ec6980 20 searching for the correct realm 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a9cb5a130 0x556a9cb5c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5ccc0 con 0x556a9cb5a130 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a9cb5a130 0x556a9cb5c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae9e1640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a9cb5a130 0x556a9cb5c5f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5ccc0 con 0x556a9cb54d90 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6faf1e2640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6fa8034070 0x7f6fa8038170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x7f6fa8034070 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6fa8034070 0x7f6fa8038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6fa8034070 0x7f6fa8038170 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x7f6fa8034070 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb5a130 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.262+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x7f6fa8034070 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x7f6fa8034070 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x7f6fa8034070 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6f980b0020 con 0x7f6fa8034070 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb5a130 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb5a130 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.266+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980b0020 con 0x556a9cb50b30 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb5a130 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x7f6fa8034070 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb50b30 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x7f6fa8034070 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb5a130 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x7f6fa8034070 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb5a130 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.270+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58130 con 0x556a9cb54d90 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58550 con 0x556a9cb50b30 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58900 con 0x556a9cb54d90 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb58900 con 0x556a9cb50b30 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 zone default found 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 4 Realm: () 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 zonegroup default 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x7f6fa8034070 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5efd0 con 0x556a9cb5a130 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5f330 con 0x556a9cb5a130 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 started sync module instance, tier type = 2024-03-20T13:37:04.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:04.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.274+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5e5a0 con 0x556a9cb54d90 2024-03-20T13:37:04.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93916384061824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5e5a0 con 0x556a9cb54d90 2024-03-20T13:37:04.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5fca0 con 0x556a9cb50b30 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93916384065536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb5fc20 con 0x556a9cb50b30 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb60b60 con 0x556a9cb54d90 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93916384061824] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.278+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93916384065536] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93916384067664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb60b20 con 0x556a9cb54d90 2024-03-20T13:37:04.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb613b0 con 0x7f6fa8034070 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93916384071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb60b20 con 0x7f6fa8034070 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb61f00 con 0x556a9cb54d90 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93916384067664] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93916384071440] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93916384072496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb61f00 con 0x556a9cb54d90 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.282+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb622b0 con 0x556a9cb5a130 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93916384069216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb62b00 con 0x556a9cb5a130 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb63520 con 0x556a9cb5a130 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93916384072496] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93916384069216] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93916384079872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb62660 con 0x556a9cb5a130 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb63d70 con 0x7f6fa8034070 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93916384079872] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93916384074272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb62660 con 0x7f6fa8034070 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=0 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=1 2024-03-20T13:37:04.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=2 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=3 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=4 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=5 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=6 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93916384074272] v32'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 20 add_watcher() i=7 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.286+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb66e60 con 0x556a9cb50b30 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93916384082128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb64340 con 0x556a9cb50b30 2024-03-20T13:37:04.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93916384082128] v32'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6e657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 5 note: GC not initialized 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6ddffff640 20 reqs_thread_entry: start 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 Filter name: none 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6dddffb640 20 reqs_thread_entry: start 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb88dd0 con 0x556a9cb50b30 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb8b2f0 con 0x7f6fa8034070 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 disabling bucket name=myfoo 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb892d0 con 0x7f6fa8034070 2024-03-20T13:37:04.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.290+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb8bb90 con 0x556a9cb54d90 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:04.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb931e0 con 0x556a9cb54d90 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.294+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 93916384247872 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb8d580 con 0x556a9cb50b30 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== watch-notify(notify (1) cookie 93916384065536 notify 137438953477 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f6f980d0040 con 0x556a9cb50b30 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93916384065536 notifier 4591 bl.length()=725 2024-03-20T13:37:04.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(67 notify.1 [notify cookie 93916384247872 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6e74003ea0 con 0x556a9cb50b30 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== watch-notify(notify_complete (2) cookie 93916384247872 notify 137438953477 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6f980b9070 con 0x556a9cb50b30 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_sources= new_sources= 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential sources added=[] removed=[] 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_dests= new_dests= 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential dests added=[] removed=[] 2024-03-20T13:37:04.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb8d550 con 0x556a9cb50b30 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v32'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93916384248528 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb91e30 con 0x556a9cb54d90 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify (1) cookie 93916384072496 notify 137438953504 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x556a9cb45f70 con 0x556a9cb54d90 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 93916384072496 notifier 4591 bl.length()=533 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6e927fc640 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6e74004200 con 0x556a9cb54d90 2024-03-20T13:37:04.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 notify.4 [notify cookie 93916384248528 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.298+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== watch-notify(notify_complete (2) cookie 93916384248528 notify 137438953504 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6fa804f020 con 0x556a9cb54d90 2024-03-20T13:37:04.314 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:04.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.302+0000 7f6e657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.302+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93916384082128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb66de0 con 0x556a9cb50b30 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.302+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93916384082128] v32'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.302+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93916384061824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb638d0 con 0x556a9cb54d90 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.302+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93916384061824] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 20 remove_watcher() i=0 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 2 removed watcher, disabling cache 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93916384065536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x556a9cb50b30 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93916384065536] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x556a9cb50b30 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 20 remove_watcher() i=1 2024-03-20T13:37:04.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93916384067664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x556a9cb54d90 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93916384067664] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 20 remove_watcher() i=2 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.306+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93916384071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x7f6fa8034070 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93916384071440] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fb0ec6980 20 remove_watcher() i=3 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93916384072496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x556a9cb54d90 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6faf1e2640 1 -- 172.21.15.123:0/1697781608 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93916384072496] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa800a4d0 con 0x556a9cb54d90 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fb0ec6980 20 remove_watcher() i=4 2024-03-20T13:37:04.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93916384069216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x556a9cb5a130 2024-03-20T13:37:04.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93916384069216] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fb0ec6980 20 remove_watcher() i=5 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.310+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93916384079872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x556a9cb5a130 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fae9e1640 1 -- 172.21.15.123:0/1697781608 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93916384079872] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6fa0016070 con 0x556a9cb5a130 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 20 remove_watcher() i=6 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93916384074272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556a9cb59180 con 0x7f6fa8034070 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93916384074272] v32'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f980d5060 con 0x7f6fa8034070 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 20 remove_watcher() i=7 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb54d90 msgr2=0x556a9cb571c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb54d90 0x556a9cb571c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9cb50b30 msgr2=0x556a9cb52ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9cb50b30 0x556a9cb52ff0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6fa8034070 msgr2=0x7f6fa8038170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6fa8034070 0x7f6fa8038170 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a9cb5a130 msgr2=0x556a9cb5c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a9cb5a130 0x556a9cb5c5f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e780342b0 msgr2=0x7f6e78036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e780342b0 0x7f6e78036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0013fd0 tx=0x7f6fa0031000 comp rx=0 tx=0).stop 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 msgr2=0x556a9cb453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fae1e0640 1 -- 172.21.15.123:0/1697781608 reap_dead start 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb453a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6fa803a040 tx=0x7f6fa8049530 comp rx=0 tx=0).stop 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 shutdown_connections 2024-03-20T13:37:04.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/1697781608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb3e500 0x556a9cb453a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 >> 172.21.15.123:0/1697781608 conn(0x556a9cb3a840 msgr2=0x556a9cb37ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 shutdown_connections 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/1697781608 wait complete. 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e880342b0 msgr2=0x7f6e88036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e880342b0 0x7f6e88036770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x556a9cb21be0 tx=0x7f6fa0018e50 comp rx=0 tx=0).stop 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 msgr2=0x556a9cb31980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 0x556a9cb31980 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8016cf0 tx=0x7f6fa800d790 comp rx=0 tx=0).stop 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 shutdown_connections 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e880342b0 0x7f6e88036770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/2356091533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9cb31560 0x556a9cb31980 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 >> 172.21.15.123:0/2356091533 conn(0x556a9cb26370 msgr2=0x556a9cb26e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 shutdown_connections 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/2356091533 wait complete. 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb1ebf0 msgr2=0x556a9cb20fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb1ebf0 0x556a9cb20fe0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9ca2a710 msgr2=0x556a9cb1de40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9ca2a710 0x556a9cb1de40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e940342b0 msgr2=0x7f6e94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e940342b0 0x7f6e94036770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f980ae000 tx=0x7f6f980a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 msgr2=0x556a9cb17210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb17210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x556a9cb10f20 tx=0x7f6fa0000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 shutdown_connections 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a9cb1ebf0 0x556a9cb20fe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a9ca2a710 0x556a9cb1de40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f6e940342b0 0x7f6e94036770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 --2- 172.21.15.123:0/3098071979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a9c998070 0x556a9cb17210 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 >> 172.21.15.123:0/3098071979 conn(0x556a9ca1e6d0 msgr2=0x556a9cb0a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 shutdown_connections 2024-03-20T13:37:04.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.314+0000 7f6fb0ec6980 1 -- 172.21.15.123:0/3098071979 wait complete. 2024-03-20T13:37:04.330 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:04.332 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-03-20T13:37:04.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-03-20T13:37:04.333 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-03-20T13:37:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:04.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.394+0000 7fcf1041c980 1 Processor -- start 2024-03-20T13:37:04.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.394+0000 7fcf1041c980 1 -- start start 2024-03-20T13:37:04.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.394+0000 7fcf1041c980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c91873f630 0x55c918741a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.394+0000 7fcf1041c980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c918685520 con 0x55c91873b130 2024-03-20T13:37:04.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.394+0000 7fcf1041c980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c91864c0f0 con 0x55c91873f630 2024-03-20T13:37:04.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0d736640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c91873f630 0x55c918741a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0d736640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c91873f630 0x55c918741a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33660/0 (socket says 172.21.15.123:33660) 2024-03-20T13:37:04.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0d736640 1 -- 172.21.15.123:0/966713605 learned_addr learned my addr 172.21.15.123:0/966713605 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0df37640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55c91873b130 0x55c91873b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:40724/0 (socket says 172.21.15.123:40724) 2024-03-20T13:37:04.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0d736640 1 -- 172.21.15.123:0/966713605 >> v1:172.21.15.89:6789/0 conn(0x55c91873b130 legacy=0x55c91873b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0d736640 1 -- 172.21.15.123:0/966713605 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c918742f70 con 0x55c91873f630 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0d736640 1 --2- 172.21.15.123:0/966713605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873f630 0x55c918741a20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400a5c0 tx=0x7fcf0401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75568cfbb52b7573 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0cf35640 1 -- 172.21.15.123:0/966713605 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf040aa470 con 0x55c91873f630 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0cf35640 1 -- 172.21.15.123:0/966713605 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf040aa5d0 con 0x55c91873f630 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf0cf35640 1 -- 172.21.15.123:0/966713605 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf040aa890 con 0x55c91873f630 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 -- 172.21.15.123:0/966713605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873f630 msgr2=0x55c918741a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 --2- 172.21.15.123:0/966713605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873f630 0x55c918741a20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400a5c0 tx=0x7fcf0401b340 comp rx=0 tx=0).stop 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 -- 172.21.15.123:0/966713605 shutdown_connections 2024-03-20T13:37:04.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 --2- 172.21.15.123:0/966713605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873f630 0x55c918741a20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 -- 172.21.15.123:0/966713605 >> 172.21.15.123:0/966713605 conn(0x55c9186ae850 msgr2=0x55c9186aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 -- 172.21.15.123:0/966713605 shutdown_connections 2024-03-20T13:37:04.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.398+0000 7fcf1041c980 1 -- 172.21.15.123:0/966713605 wait complete. 2024-03-20T13:37:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 Processor -- start 2024-03-20T13:37:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- start start 2024-03-20T13:37:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c918824fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c918649620 con 0x55c91873b130 2024-03-20T13:37:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf0df37640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c918824fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf0df37640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c918824fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33664/0 (socket says 172.21.15.123:33664) 2024-03-20T13:37:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf0df37640 1 -- 172.21.15.123:0/474039338 learned_addr learned my addr 172.21.15.123:0/474039338 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf0df37640 1 -- 172.21.15.123:0/474039338 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04005df0 con 0x55c91873b130 2024-03-20T13:37:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf0df37640 1 --2- 172.21.15.123:0/474039338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c918824fe0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcf00006fb0 tx=0x7fcf00001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16da57e6567277 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcdfbe07640 1 -- 172.21.15.123:0/474039338 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf00013420 con 0x55c91873b130 2024-03-20T13:37:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcdfbe07640 1 -- 172.21.15.123:0/474039338 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00013580 con 0x55c91873b130 2024-03-20T13:37:04.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcdfbe07640 1 -- 172.21.15.123:0/474039338 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf00013860 con 0x55c91873b130 2024-03-20T13:37:04.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- 172.21.15.123:0/474039338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 msgr2=0x55c918824fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 --2- 172.21.15.123:0/474039338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c918824fe0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcf00006fb0 tx=0x7fcf00001940 comp rx=0 tx=0).stop 2024-03-20T13:37:04.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- 172.21.15.123:0/474039338 shutdown_connections 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 --2- 172.21.15.123:0/474039338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c918824fe0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- 172.21.15.123:0/474039338 >> 172.21.15.123:0/474039338 conn(0x55c9186ae850 msgr2=0x55c918820b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- 172.21.15.123:0/474039338 shutdown_connections 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- 172.21.15.123:0/474039338 wait complete. 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 Processor -- start 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- start start 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c91882be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.414+0000 7fcf1041c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c918644e00 con 0x55c91873b130 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0df37640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c91882be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0df37640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c91882be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33672/0 (socket says 172.21.15.123:33672) 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0df37640 1 -- 172.21.15.123:0/309529169 learned_addr learned my addr 172.21.15.123:0/309529169 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0df37640 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c918685520 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0df37640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c91882be30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55c918825e70 tx=0x7fcf00000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcdfa604640 1 -- 172.21.15.123:0/309529169 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf000037a0 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c91882c370 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcdfa604640 1 -- 172.21.15.123:0/309529169 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00003900 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcdfa604640 1 -- 172.21.15.123:0/309529169 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf00003ba0 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c91882c7a0 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcdfa604640 1 -- 172.21.15.123:0/309529169 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcf00028460 con 0x55c91873b130 2024-03-20T13:37:04.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcdfa604640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdf40342b0 0x7fcdf4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcdfa604640 1 -- 172.21.15.123:0/309529169 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcf00049550 con 0x55c91873b130 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0d736640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdf40342b0 0x7fcdf4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c91873f630 0x55c918832ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918832ff0 con 0x55c91873f630 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0e738640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c91873f630 0x55c918832ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0d736640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdf40342b0 0x7fcdf4036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcf040ae000 tx=0x7fcf040a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0e738640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c91873f630 0x55c918832ab0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf0e738640 1 -- 172.21.15.123:0/309529169 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf080083f0 con 0x55c91873f630 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c918833860 0x55c918835c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.418+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188363c0 con 0x55c918833860 2024-03-20T13:37:04.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0df37640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c918833860 0x55c918835c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0df37640 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c918833860 0x55c918835c50 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0df37640 1 -- 172.21.15.123:0/309529169 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcf00024020 con 0x55c918833860 2024-03-20T13:37:04.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918837c20 con 0x55c918833860 2024-03-20T13:37:04.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0df37640 1 -- 172.21.15.123:0/309529169 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fcf00024020 con 0x55c918833860 2024-03-20T13:37:04.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918836e20 con 0x55c918833860 2024-03-20T13:37:04.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0df37640 1 -- 172.21.15.123:0/309529169 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcf00024020 con 0x55c918833860 2024-03-20T13:37:04.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918837230 con 0x55c91873f630 2024-03-20T13:37:04.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0e738640 1 -- 172.21.15.123:0/309529169 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcf080083f0 con 0x55c91873f630 2024-03-20T13:37:04.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 Processor -- start 2024-03-20T13:37:04.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 -- start start 2024-03-20T13:37:04.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 0x55c918846760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf1041c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9185dde30 con 0x55c918846340 2024-03-20T13:37:04.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0e738640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 0x55c918846760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0e738640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 0x55c918846760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33688/0 (socket says 172.21.15.123:33688) 2024-03-20T13:37:04.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.422+0000 7fcf0e738640 1 -- 172.21.15.123:0/3587495970 learned_addr learned my addr 172.21.15.123:0/3587495970 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0e738640 1 -- 172.21.15.123:0/3587495970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c918846ca0 con 0x55c918846340 2024-03-20T13:37:04.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0e738640 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 0x55c918846760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800aae0 tx=0x7fcf08008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcdf37fe640 1 -- 172.21.15.123:0/3587495970 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf0801d070 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcdf37fe640 1 -- 172.21.15.123:0/3587495970 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08010040 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c918846ef0 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcdf37fe640 1 -- 172.21.15.123:0/3587495970 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf08007e70 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c918847a40 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcdf37fe640 1 -- 172.21.15.123:0/3587495970 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcf08018430 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcdf37fe640 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcde80342b0 0x7fcde8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcdf37fe640 1 -- 172.21.15.123:0/3587495970 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcf0804a600 con 0x55c918846340 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0df37640 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcde80342b0 0x7fcde8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf1041c980 1 Processor -- start 2024-03-20T13:37:04.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf1041c980 1 -- start start 2024-03-20T13:37:04.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0df37640 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcde80342b0 0x7fcde8036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55c918836920 tx=0x7fcf000134c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf1041c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c9188536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf1041c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9185d1790 con 0x55c9188532c0 2024-03-20T13:37:04.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0e738640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c9188536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0e738640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c9188536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33690/0 (socket says 172.21.15.123:33690) 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0e738640 1 -- 172.21.15.123:0/3362720163 learned_addr learned my addr 172.21.15.123:0/3362720163 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.426+0000 7fcf0e738640 1 -- 172.21.15.123:0/3362720163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c918853cb0 con 0x55c9188532c0 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf0e738640 1 --2- 172.21.15.123:0/3362720163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c9188536e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf080489f0 tx=0x7fcf08048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f728ca3b5435fb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcdf17fa640 1 -- 172.21.15.123:0/3362720163 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf08047070 con 0x55c9188532c0 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcdf17fa640 1 -- 172.21.15.123:0/3362720163 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08022410 con 0x55c9188532c0 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcdf17fa640 1 -- 172.21.15.123:0/3362720163 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf08016330 con 0x55c9188532c0 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/3362720163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 msgr2=0x55c9188536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 --2- 172.21.15.123:0/3362720163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c9188536e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf080489f0 tx=0x7fcf08048f00 comp rx=0 tx=0).stop 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/3362720163 shutdown_connections 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 --2- 172.21.15.123:0/3362720163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c9188536e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/3362720163 >> 172.21.15.123:0/3362720163 conn(0x55c91884f600 msgr2=0x55c91884d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/3362720163 shutdown_connections 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/3362720163 wait complete. 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 Processor -- start 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- start start 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c91885e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c91885ea60 con 0x55c9188532c0 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf0e738640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c91885e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf0e738640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c91885e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33698/0 (socket says 172.21.15.123:33698) 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 learned_addr learned my addr 172.21.15.123:0/1940661882 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c918847a40 con 0x55c9188532c0 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf0e738640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c91885e520 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcf08020890 tx=0x7fcf08048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcddf7fe640 1 -- 172.21.15.123:0/1940661882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf08022580 con 0x55c9188532c0 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c91885ec60 con 0x55c9188532c0 2024-03-20T13:37:04.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcddf7fe640 1 -- 172.21.15.123:0/1940661882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08018730 con 0x55c9188532c0 2024-03-20T13:37:04.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcddf7fe640 1 -- 172.21.15.123:0/1940661882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf080189d0 con 0x55c9188532c0 2024-03-20T13:37:04.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c91885f0f0 con 0x55c9188532c0 2024-03-20T13:37:04.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcddf7fe640 1 -- 172.21.15.123:0/1940661882 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcf0803a920 con 0x55c9188532c0 2024-03-20T13:37:04.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcddf7fe640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdd80342b0 0x7fcdd8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.430+0000 7fcddf7fe640 1 -- 172.21.15.123:0/1940661882 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcf08037c60 con 0x55c9188532c0 2024-03-20T13:37:04.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0df37640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdd80342b0 0x7fcdd8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c918869c80 0x55c91886c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91886c890 con 0x55c918869c80 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0d736640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c918869c80 0x55c91886c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0df37640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdd80342b0 0x7fcdd8036770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf00049880 tx=0x7fcf00038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0d736640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c918869c80 0x55c91886c140 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 realm 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91886cc80 con 0x55c918869c80 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91886d4d0 con 0x55c918869c80 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c91886deb0 0x55c918870300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918870a70 con 0x55c91886deb0 2024-03-20T13:37:04.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0e738640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c91886deb0 0x55c918870300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0e738640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c91886deb0 0x55c918870300 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcf08033070 con 0x55c91886deb0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918871270 con 0x55c91886deb0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fcf08033070 con 0x55c91886deb0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 20 searching for the correct realm 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c918873270 0x55c918875730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.434+0000 7fcf0df37640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c918873270 0x55c918875730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0df37640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c918873270 0x55c918875730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf08033070 con 0x55c91886deb0 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fcf08036020 0x7fcf080166c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x7fcf08036020 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fcf08036020 0x7fcf080166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fcf08036020 0x7fcf080166c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x7fcf08036020 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf08033070 con 0x55c91886deb0 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf08033070 con 0x55c91886deb0 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.438+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x7fcf08036020 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x7fcf08036020 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x7fcf08036020 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcf040b0020 con 0x7fcf08036020 2024-03-20T13:37:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040b0020 con 0x55c918869c80 2024-03-20T13:37:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.442+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x7fcf08036020 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918869c80 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x7fcf08036020 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x7fcf08036020 2024-03-20T13:37:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c918873270 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.446+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918875e00 con 0x55c91886deb0 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918871b30 con 0x55c918869c80 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918871ee0 con 0x55c91886deb0 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918871ee0 con 0x55c918869c80 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 zone default found 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 4 Realm: () 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:04.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 zonegroup default 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x7fcf08036020 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918878420 con 0x55c918873270 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918878780 con 0x55c918873270 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 started sync module instance, tier type = 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.450+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188779f0 con 0x55c91886deb0 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94322188320160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188779f0 con 0x55c91886deb0 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188790f0 con 0x55c918869c80 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94322188323920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918879070 con 0x55c918869c80 2024-03-20T13:37:04.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887a000 con 0x55c91886deb0 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94322188320160] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94322188323920] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94322188326048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918879fc0 con 0x55c91886deb0 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.454+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887a850 con 0x7fcf08036020 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94322188329904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918879fc0 con 0x7fcf08036020 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887b320 con 0x55c91886deb0 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94322188329904] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94322188326048] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94322188327648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887b320 con 0x55c91886deb0 2024-03-20T13:37:04.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887b710 con 0x55c918873270 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94322188330960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887bf60 con 0x55c918873270 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.458+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887c910 con 0x55c918873270 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94322188327648] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94322188332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887ccc0 con 0x55c918873270 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887d670 con 0x7fcf08036020 2024-03-20T13:37:04.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94322188330960] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94322188332608] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94322188338224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887d190 con 0x7fcf08036020 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=0 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=1 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=2 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=3 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=4 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=5 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=6 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94322188338224] v32'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 20 add_watcher() i=7 2024-03-20T13:37:04.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:04.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887d600 con 0x55c918869c80 2024-03-20T13:37:04.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.462+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94322188335808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887db40 con 0x55c918869c80 2024-03-20T13:37:04.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94322188335808] v32'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcdbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 5 note: GC not initialized 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcdbe7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 Filter name: none 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcd2ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188a2520 con 0x55c918869c80 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188a4a40 con 0x7fcf08036020 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 enabling bucket name=myfoo 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188a2a20 con 0x7fcf08036020 2024-03-20T13:37:04.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:04.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-03-20T13:37:04.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:04.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 : miss 2024-03-20T13:37:04.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:04.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.466+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188a52c0 con 0x55c91886deb0 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 2024-03-20T13:37:04.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 8.12 8:4f1e4000:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188ac910 con 0x55c91886deb0 2024-03-20T13:37:04.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:04.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1, ofs0, ns] 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94322188506992 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188a6cb0 con 0x55c918869c80 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== watch-notify(notify (1) cookie 94322188323920 notify 137438953478 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7fcf040d0040 con 0x55c918869c80 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcdf17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94322188323920 notifier 4598 bl.length()=725 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcdf17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 info.flags=0x17 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcdf17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1 to cache LRU end 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcdf17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(67 notify.1 [notify cookie 94322188506992 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcdf17fa640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcdd0003ea0 con 0x55c918869c80 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.470+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== watch-notify(notify_complete (2) cookie 94322188506992 notify 137438953478 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcf040b9070 con 0x55c918869c80 2024-03-20T13:37:04.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_sources= new_sources= 2024-03-20T13:37:04.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential sources added=[] removed=[] 2024-03-20T13:37:04.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): orig_dests= new_dests= 2024-03-20T13:37:04.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 20 handle_bi_update(): bucket=:myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1]): potential dests added=[] removed=[] 2024-03-20T13:37:04.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188a6c60 con 0x55c918869c80 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v32'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94322188507648 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c9188ab560 con 0x55c91886deb0 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== watch-notify(notify (1) cookie 94322188327648 notify 137438953505 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55c91885f0f0 con 0x55c91886deb0 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcdf17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94322188327648 notifier 4598 bl.length()=533 2024-03-20T13:37:04.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcdf17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:04.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcdf17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:04.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcdf17fa640 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fcdd0004200 con 0x55c91886deb0 2024-03-20T13:37:04.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 notify.4 [notify cookie 94322188507648 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== watch-notify(notify_complete (2) cookie 94322188507648 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcf08066040 con 0x55c91886deb0 2024-03-20T13:37:04.482 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:04.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcdbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:04.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.474+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94322188335808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918894680 con 0x55c918869c80 2024-03-20T13:37:04.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.478+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94322188335808] v32'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.478+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94322188320160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c91887bac0 con 0x55c91886deb0 2024-03-20T13:37:04.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.478+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94322188320160] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.478+0000 7fcf1041c980 20 remove_watcher() i=0 2024-03-20T13:37:04.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.478+0000 7fcf1041c980 2 removed watcher, disabling cache 2024-03-20T13:37:04.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.478+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94322188323920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x55c918869c80 2024-03-20T13:37:04.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94322188323920] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x55c918869c80 2024-03-20T13:37:04.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf1041c980 20 remove_watcher() i=1 2024-03-20T13:37:04.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94322188326048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x55c91886deb0 2024-03-20T13:37:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94322188326048] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf1041c980 20 remove_watcher() i=2 2024-03-20T13:37:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94322188329904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x7fcf08036020 2024-03-20T13:37:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94322188329904] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf1041c980 20 remove_watcher() i=3 2024-03-20T13:37:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.482+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94322188327648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x55c91886deb0 2024-03-20T13:37:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf0e738640 1 -- 172.21.15.123:0/1940661882 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94322188327648] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf0805d040 con 0x55c91886deb0 2024-03-20T13:37:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf1041c980 20 remove_watcher() i=4 2024-03-20T13:37:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94322188330960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x55c918873270 2024-03-20T13:37:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94322188330960] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf1041c980 20 remove_watcher() i=5 2024-03-20T13:37:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94322188332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x55c918873270 2024-03-20T13:37:04.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf0df37640 1 -- 172.21.15.123:0/1940661882 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94322188332608] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf00024020 con 0x55c918873270 2024-03-20T13:37:04.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf1041c980 20 remove_watcher() i=6 2024-03-20T13:37:04.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.486+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94322188338224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c918876240 con 0x7fcf08036020 2024-03-20T13:37:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94322188338224] v32'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf040d5060 con 0x7fcf08036020 2024-03-20T13:37:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 20 remove_watcher() i=7 2024-03-20T13:37:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c91886deb0 msgr2=0x55c918870300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c91886deb0 0x55c918870300 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c918869c80 msgr2=0x55c91886c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c918869c80 0x55c91886c140 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fcf08036020 msgr2=0x7fcf080166c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fcf08036020 0x7fcf080166c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c918873270 msgr2=0x55c918875730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55c918873270 0x55c918875730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdd80342b0 msgr2=0x7fcdd8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdd80342b0 0x7fcdd8036770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf00049880 tx=0x7fcf00038000 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 msgr2=0x55c91885e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf0d736640 1 -- 172.21.15.123:0/1940661882 reap_dead start 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c91885e520 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcf08020890 tx=0x7fcf08048980 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 shutdown_connections 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/1940661882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9188532c0 0x55c91885e520 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 >> 172.21.15.123:0/1940661882 conn(0x55c91884f600 msgr2=0x55c91884cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 shutdown_connections 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/1940661882 wait complete. 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcde80342b0 msgr2=0x7fcde8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcde80342b0 0x7fcde8036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55c918836920 tx=0x7fcf000134c0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 msgr2=0x55c918846760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 0x55c918846760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800aae0 tx=0x7fcf08008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 shutdown_connections 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcde80342b0 0x7fcde8036770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/3587495970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c918846340 0x55c918846760 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 >> 172.21.15.123:0/3587495970 conn(0x55c91883b150 msgr2=0x55c91883bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 shutdown_connections 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/3587495970 wait complete. 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c918833860 msgr2=0x55c918835c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c918833860 0x55c918835c50 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c91873f630 msgr2=0x55c918832ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c91873f630 0x55c918832ab0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdf40342b0 msgr2=0x7fcdf4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdf40342b0 0x7fcdf4036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcf040ae000 tx=0x7fcf040a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 msgr2=0x55c91882be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c91882be30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55c918825e70 tx=0x7fcf00000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 shutdown_connections 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55c918833860 0x55c918835c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55c91873f630 0x55c918832ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fcdf40342b0 0x7fcdf4036770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 --2- 172.21.15.123:0/309529169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c91873b130 0x55c91882be30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 >> 172.21.15.123:0/309529169 conn(0x55c9186ae850 msgr2=0x55c91881f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 shutdown_connections 2024-03-20T13:37:04.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:04.490+0000 7fcf1041c980 1 -- 172.21.15.123:0/309529169 wait complete. 2024-03-20T13:37:04.505 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:04.513 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:37:04.855 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-03-20T13:37:04.870 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:19.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-03-20T13:37:19.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-03-20T13:37:19.871 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-03-20T13:37:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:19.909 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:19.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8eab5980 1 Processor -- start 2024-03-20T13:37:19.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8eab5980 1 -- start start 2024-03-20T13:37:19.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8eab5980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55fbae830070 0x55fbae8c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8eab5980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fbae808520 con 0x55fbae8c1530 2024-03-20T13:37:19.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8eab5980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbae7cf0f0 con 0x55fbae830070 2024-03-20T13:37:19.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8c5d0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55fbae830070 0x55fbae8c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8bdcf640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55fbae8c1530 0x55fbae8c3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33212/0 (socket says 172.21.15.123:33212) 2024-03-20T13:37:19.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/3906191381 learned_addr learned my addr 172.21.15.123:0/3906191381 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:19.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/3906191381 >> v1:172.21.15.89:6789/0 conn(0x55fbae8c1530 legacy=0x55fbae8c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:19.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.906+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/3906191381 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbae8c6050 con 0x55fbae830070 2024-03-20T13:37:19.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/3906191381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae8c0ff0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a480 tx=0x7f2b7c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475599bf6c6cbfa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8b5ce640 1 -- 172.21.15.123:0/3906191381 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0ab540 con 0x55fbae830070 2024-03-20T13:37:19.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8b5ce640 1 -- 172.21.15.123:0/3906191381 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0ab6a0 con 0x55fbae830070 2024-03-20T13:37:19.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8b5ce640 1 -- 172.21.15.123:0/3906191381 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0ab960 con 0x55fbae830070 2024-03-20T13:37:19.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3906191381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 msgr2=0x55fbae8c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:19.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/3906191381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae8c0ff0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a480 tx=0x7f2b7c01b280 comp rx=0 tx=0).stop 2024-03-20T13:37:19.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3906191381 shutdown_connections 2024-03-20T13:37:19.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/3906191381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae8c0ff0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:19.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3906191381 >> 172.21.15.123:0/3906191381 conn(0x55fbae8b66d0 msgr2=0x55fbae8b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:19.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3906191381 shutdown_connections 2024-03-20T13:37:19.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.910+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3906191381 wait complete. 2024-03-20T13:37:19.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8eab5980 1 Processor -- start 2024-03-20T13:37:19.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8eab5980 1 -- start start 2024-03-20T13:37:19.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8eab5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8eab5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbae7cc620 con 0x55fbae830070 2024-03-20T13:37:19.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8c5d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8c5d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36166/0 (socket says 172.21.15.123:36166) 2024-03-20T13:37:19.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/3188489556 learned_addr learned my addr 172.21.15.123:0/3188489556 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:19.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/3188489556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c005d30 con 0x55fbae830070 2024-03-20T13:37:19.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/3188489556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9a81d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c018eb0 tx=0x7f2b7c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49423812100e22 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2a7a60c640 1 -- 172.21.15.123:0/3188489556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0ab810 con 0x55fbae830070 2024-03-20T13:37:19.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2a7a60c640 1 -- 172.21.15.123:0/3188489556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0ab970 con 0x55fbae830070 2024-03-20T13:37:19.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.926+0000 7f2a7a60c640 1 -- 172.21.15.123:0/3188489556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0abc30 con 0x55fbae830070 2024-03-20T13:37:19.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3188489556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 msgr2=0x55fbae9a81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/3188489556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9a81d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c018eb0 tx=0x7f2b7c003030 comp rx=0 tx=0).stop 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3188489556 shutdown_connections 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/3188489556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9a81d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3188489556 >> 172.21.15.123:0/3188489556 conn(0x55fbae8b66d0 msgr2=0x55fbae9a3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3188489556 shutdown_connections 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/3188489556 wait complete. 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 Processor -- start 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- start start 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbae7c7e00 con 0x55fbae830070 2024-03-20T13:37:19.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8c5d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8c5d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36174/0 (socket says 172.21.15.123:36174) 2024-03-20T13:37:19.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/4268426952 learned_addr learned my addr 172.21.15.123:0/4268426952 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbae8c6050 con 0x55fbae830070 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9af000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c01b2c0 tx=0x7f2b7c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2a78e09640 1 -- 172.21.15.123:0/4268426952 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0c3070 con 0x55fbae830070 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbae9af540 con 0x55fbae830070 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2a78e09640 1 -- 172.21.15.123:0/4268426952 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0b5540 con 0x55fbae830070 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2a78e09640 1 -- 172.21.15.123:0/4268426952 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0b57e0 con 0x55fbae830070 2024-03-20T13:37:19.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbae9af910 con 0x55fbae830070 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.930+0000 7f2a78e09640 1 -- 172.21.15.123:0/4268426952 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b7c0b2070 con 0x55fbae830070 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2a78e09640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a740342b0 0x7f2a74036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2a78e09640 1 -- 172.21.15.123:0/4268426952 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2b7c0e3f80 con 0x55fbae830070 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8bdcf640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a740342b0 0x7f2a74036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae8c1530 0x55fbae9b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9b61c0 con 0x55fbae8c1530 2024-03-20T13:37:19.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae8c1530 0x55fbae9b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8bdcf640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a740342b0 0x7f2a74036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2b74000f70 tx=0x7f2b740012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae8c1530 0x55fbae9b5c80 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/4268426952 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae8c1530 2024-03-20T13:37:19.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9b6a30 0x55fbae9b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9b94e0 con 0x55fbae9b6a30 2024-03-20T13:37:19.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9b6a30 0x55fbae9b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9b6a30 0x55fbae9b8e20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/4268426952 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9b6a30 2024-03-20T13:37:19.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9bad20 con 0x55fbae9b6a30 2024-03-20T13:37:19.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/4268426952 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9b6a30 2024-03-20T13:37:19.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.934+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9b9e60 con 0x55fbae9b6a30 2024-03-20T13:37:19.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/4268426952 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9b6a30 2024-03-20T13:37:19.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9ba270 con 0x55fbae8c1530 2024-03-20T13:37:19.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/4268426952 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae8c1530 2024-03-20T13:37:19.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 Processor -- start 2024-03-20T13:37:19.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 -- start start 2024-03-20T13:37:19.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 0x55fbae9c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbae760e30 con 0x55fbae9c9430 2024-03-20T13:37:19.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8cdd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 0x55fbae9c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8cdd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 0x55fbae9c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36180/0 (socket says 172.21.15.123:36180) 2024-03-20T13:37:19.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/1974566098 learned_addr learned my addr 172.21.15.123:0/1974566098 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:19.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/1974566098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbae9c9d90 con 0x55fbae9c9430 2024-03-20T13:37:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 0x55fbae9c9850 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400b010 tx=0x7f2b8400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2a71ffb640 1 -- 172.21.15.123:0/1974566098 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b84017660 con 0x55fbae9c9430 2024-03-20T13:37:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2a71ffb640 1 -- 172.21.15.123:0/1974566098 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840177c0 con 0x55fbae9c9430 2024-03-20T13:37:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbae9c9fe0 con 0x55fbae9c9430 2024-03-20T13:37:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2a71ffb640 1 -- 172.21.15.123:0/1974566098 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b84017aa0 con 0x55fbae9c9430 2024-03-20T13:37:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.938+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbae9cab30 con 0x55fbae9c9430 2024-03-20T13:37:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2a71ffb640 1 -- 172.21.15.123:0/1974566098 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b8401d020 con 0x55fbae9c9430 2024-03-20T13:37:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2a71ffb640 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a640342b0 0x7f2a64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2a71ffb640 1 -- 172.21.15.123:0/1974566098 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2b8404b2e0 con 0x55fbae9c9430 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a640342b0 0x7f2a64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 Processor -- start 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- start start 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a640342b0 0x7f2a64036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55fbae9b9960 tx=0x7f2b7c0cff80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbae754790 con 0x55fbae9d6380 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8cdd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8cdd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9d67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36192/0 (socket says 172.21.15.123:36192) 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/206598759 learned_addr learned my addr 172.21.15.123:0/206598759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/206598759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbae9d6d70 con 0x55fbae9d6380 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/206598759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9d67a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2b840495a0 tx=0x7f2b84049820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8138d1b7edbfd5a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2a6b7fe640 1 -- 172.21.15.123:0/206598759 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8404b0d0 con 0x55fbae9d6380 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2a6b7fe640 1 -- 172.21.15.123:0/206598759 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8403b180 con 0x55fbae9d6380 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2a6b7fe640 1 -- 172.21.15.123:0/206598759 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b84017c50 con 0x55fbae9d6380 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- 172.21.15.123:0/206598759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 msgr2=0x55fbae9d67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/206598759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9d67a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2b840495a0 tx=0x7f2b84049820 comp rx=0 tx=0).stop 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- 172.21.15.123:0/206598759 shutdown_connections 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/206598759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9d67a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- 172.21.15.123:0/206598759 >> 172.21.15.123:0/206598759 conn(0x55fbae9d2710 msgr2=0x55fbae9d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- 172.21.15.123:0/206598759 shutdown_connections 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- 172.21.15.123:0/206598759 wait complete. 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 Processor -- start 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- start start 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9dd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.942+0000 7f2b8eab5980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbae9dd790 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8cdd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8cdd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9dd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36204/0 (socket says 172.21.15.123:36204) 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 learned_addr learned my addr 172.21.15.123:0/2749851732 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbae9cab30 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9dd250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2b84028e30 tx=0x7f2b84049500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2a69ffb640 1 -- 172.21.15.123:0/2749851732 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8401fec0 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbae9dd990 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2a69ffb640 1 -- 172.21.15.123:0/2749851732 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8403b2f0 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2a69ffb640 1 -- 172.21.15.123:0/2749851732 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8404b0d0 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbae9dddc0 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2a69ffb640 1 -- 172.21.15.123:0/2749851732 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b840118b0 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2a69ffb640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a5c034260 0x7f2a5c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2a69ffb640 1 -- 172.21.15.123:0/2749851732 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2b840182a0 con 0x55fbae9d6380 2024-03-20T13:37:19.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a5c034260 0x7f2a5c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae9e8890 0x55fbae9ead50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9eb4a0 con 0x55fbae9e8890 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8bdcf640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae9e8890 0x55fbae9ead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a5c034260 0x7f2a5c036720 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c01bb20 tx=0x7f2b7c0df000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.946+0000 7f2b8bdcf640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae9e8890 0x55fbae9ead50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 realm 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9e7cf0 con 0x55fbae9e8890 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9ebf20 con 0x55fbae9e8890 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9eccb0 0x55fbae9ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9ef720 con 0x55fbae9eccb0 2024-03-20T13:37:19.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9eccb0 0x55fbae9ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9eccb0 0x55fbae9ef0a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9eff70 con 0x55fbae9eccb0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 20 searching for the correct realm 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55fbae9f1c90 0x55fbae9f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9f1c90 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55fbae9f1c90 0x55fbae9f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8c5d0640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55fbae9f1c90 0x55fbae9f4080 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.950+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9eccb0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8cdd1640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2b8402ca80 0x7f2b8402b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x7f2b8402ca80 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2b8402ca80 0x7f2b8402b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:19.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2b8402ca80 0x7f2b8402b9b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9f1c90 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9eccb0 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.954+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9eccb0 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x7f2b8402ca80 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x7f2b8402ca80 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9eccb0 2024-03-20T13:37:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9f1c90 2024-03-20T13:37:19.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9eccb0 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.958+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9f1c90 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9f1c90 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x7f2b8402ca80 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x55fbae9e8890 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4610 con 0x7f2b8402ca80 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x55fbae9f1c90 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x7f2b8402ca80 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x55fbae9eccb0 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.962+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x55fbae9eccb0 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x55fbae9f1c90 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x55fbae9eccb0 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f2b7403c040 con 0x55fbae9eccb0 2024-03-20T13:37:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f08d0 con 0x55fbae9e8890 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f0cb0 con 0x55fbae9eccb0 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f0cb0 con 0x55fbae9e8890 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 zone default found 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 4 Realm: () 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 zonegroup default 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f4a30 con 0x7f2b8402ca80 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.966+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f6c10 con 0x55fbae9f1c90 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 rados->read ofs=0 len=0 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f6f70 con 0x55fbae9f1c90 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 started sync module instance, tier type = 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f6190 con 0x55fbae9eccb0 2024-03-20T13:37:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539454834048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f6190 con 0x55fbae9eccb0 2024-03-20T13:37:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.970+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f7970 con 0x55fbae9e8890 2024-03-20T13:37:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539454837904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f78b0 con 0x55fbae9e8890 2024-03-20T13:37:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f8870 con 0x55fbae9eccb0 2024-03-20T13:37:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539454834048] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539454837904] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539454840096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f8870 con 0x55fbae9eccb0 2024-03-20T13:37:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f84d0 con 0x7f2b8402ca80 2024-03-20T13:37:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539454843936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f84d0 con 0x7f2b8402ca80 2024-03-20T13:37:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.974+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f9c20 con 0x55fbae9eccb0 2024-03-20T13:37:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539454840096] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539454843936] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539454844992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f9be0 con 0x55fbae9eccb0 2024-03-20T13:37:19.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9f9fd0 con 0x55fbae9f1c90 2024-03-20T13:37:19.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539454831856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fa820 con 0x55fbae9f1c90 2024-03-20T13:37:19.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.978+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fb1d0 con 0x55fbae9f1c90 2024-03-20T13:37:19.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539454844992] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539454831856] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539454849920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9facf0 con 0x55fbae9f1c90 2024-03-20T13:37:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fbb90 con 0x7f2b8402ca80 2024-03-20T13:37:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539454849920] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539454846720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fbb90 con 0x7f2b8402ca80 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=0 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=1 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=2 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=3 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=4 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=5 2024-03-20T13:37:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=6 2024-03-20T13:37:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539454846720] v34'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 20 add_watcher() i=7 2024-03-20T13:37:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.982+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9feed0 con 0x55fbae9e8890 2024-03-20T13:37:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539454855264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fc120 con 0x55fbae9e8890 2024-03-20T13:37:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539454855264] v34'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2b8eab5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2b8eab5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.986+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea073e0 con 0x55fbae9eccb0 2024-03-20T13:37:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.990+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.990+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea073e0 con 0x7f2b8402ca80 2024-03-20T13:37:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.990+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.990+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea075b0 con 0x55fbae9f1c90 2024-03-20T13:37:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.994+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.994+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fdd60 con 0x55fbae9e8890 2024-03-20T13:37:19.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.994+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.994+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbae9fe2b0 con 0x55fbae9eccb0 2024-03-20T13:37:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.994+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'45 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.994+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea072e0 con 0x55fbae9f1c90 2024-03-20T13:37:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.998+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.998+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea08af0 con 0x55fbae9eccb0 2024-03-20T13:37:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.998+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:19.998+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea09020 con 0x55fbae9e8890 2024-03-20T13:37:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.002+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.002+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea09550 con 0x55fbae9eccb0 2024-03-20T13:37:20.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.002+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.002+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea09550 con 0x55fbae9eccb0 2024-03-20T13:37:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.002+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.002+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea09550 con 0x55fbae9eccb0 2024-03-20T13:37:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.006+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'46 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.006+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea09550 con 0x55fbae9f1c90 2024-03-20T13:37:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.006+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.006+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea099f0 con 0x55fbae9eccb0 2024-03-20T13:37:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.010+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.010+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea099f0 con 0x55fbae9e8890 2024-03-20T13:37:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.010+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.010+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea099f0 con 0x55fbae9e8890 2024-03-20T13:37:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.010+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.014+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea099f0 con 0x55fbae9eccb0 2024-03-20T13:37:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.014+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.014+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea099f0 con 0x55fbae9eccb0 2024-03-20T13:37:20.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.014+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'47 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.014+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea099f0 con 0x55fbae9f1c90 2024-03-20T13:37:20.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.018+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.018+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea05620 con 0x55fbae9eccb0 2024-03-20T13:37:20.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.018+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.018+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea05620 con 0x55fbae9e8890 2024-03-20T13:37:20.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.022+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.022+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea05620 con 0x55fbae9eccb0 2024-03-20T13:37:20.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.022+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.022+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9eccb0 2024-03-20T13:37:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.026+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.026+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9f1c90 2024-03-20T13:37:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.026+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.026+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9eccb0 2024-03-20T13:37:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.030+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.030+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9f1c90 2024-03-20T13:37:20.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.030+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.030+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9f1c90 2024-03-20T13:37:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.034+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.034+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9f1c90 2024-03-20T13:37:20.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.034+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.034+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9eccb0 2024-03-20T13:37:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.038+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.038+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9e8890 2024-03-20T13:37:20.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.038+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.038+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9eccb0 2024-03-20T13:37:20.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x55fbae9e8890 2024-03-20T13:37:20.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04f20 con 0x7f2b8402ca80 2024-03-20T13:37:20.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2a417e2640 20 reqs_thread_entry: start 2024-03-20T13:37:20.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8eab5980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f2b8eab5980 20 Filter name: none 2024-03-20T13:37:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.042+0000 7f29b2ffd640 20 reqs_thread_entry: start 2024-03-20T13:37:20.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x7f2b8402ca80 2024-03-20T13:37:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x7f2b8402ca80 2024-03-20T13:37:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x7f2b8402ca80 2024-03-20T13:37:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.046+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9f1c90 2024-03-20T13:37:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04420 con 0x55fbae9f1c90 2024-03-20T13:37:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.050+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.054+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.058+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.062+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9f1c90 2024-03-20T13:37:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.066+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.070+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.074+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9e8890 2024-03-20T13:37:20.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9e8890 2024-03-20T13:37:20.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.078+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea24a20 con 0x55fbae9eccb0 2024-03-20T13:37:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 69 ==== osd_op_reply(159 gc.21 [call out=1700b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+1700 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.082+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.086+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9f1c90 2024-03-20T13:37:20.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.090+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.094+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9eccb0 2024-03-20T13:37:20.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.098+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x55fbae9e8890 2024-03-20T13:37:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x7f2b8402ca80 2024-03-20T13:37:20.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x7f2b8402ca80 2024-03-20T13:37:20.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea048c0 con 0x7f2b8402ca80 2024-03-20T13:37:20.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.102+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.106+0000 7f2a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:20.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.106+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539454855264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea046e0 con 0x55fbae9e8890 2024-03-20T13:37:20.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.106+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94539454855264] v34'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.106+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539454834048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x55fbae9eccb0 2024-03-20T13:37:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.110+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94539454834048] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.110+0000 7f2b8eab5980 20 remove_watcher() i=0 2024-03-20T13:37:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.110+0000 7f2b8eab5980 2 removed watcher, disabling cache 2024-03-20T13:37:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.110+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539454837904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x55fbae9e8890 2024-03-20T13:37:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.114+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.1 v2:172.21.15.123:6800/3706732118 49 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94539454837904] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x55fbae9e8890 2024-03-20T13:37:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.114+0000 7f2b8eab5980 20 remove_watcher() i=1 2024-03-20T13:37:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.114+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539454840096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x55fbae9eccb0 2024-03-20T13:37:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.114+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94539454840096] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.114+0000 7f2b8eab5980 20 remove_watcher() i=2 2024-03-20T13:37:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.114+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539454843936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x7f2b8402ca80 2024-03-20T13:37:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.118+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94539454843936] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.118+0000 7f2b8eab5980 20 remove_watcher() i=3 2024-03-20T13:37:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.118+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539454844992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x55fbae9eccb0 2024-03-20T13:37:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.118+0000 7f2b8cdd1640 1 -- 172.21.15.123:0/2749851732 <== osd.0 v2:172.21.15.89:6800/854515999 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94539454844992] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8400a4d0 con 0x55fbae9eccb0 2024-03-20T13:37:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.118+0000 7f2b8eab5980 20 remove_watcher() i=4 2024-03-20T13:37:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.118+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539454831856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x55fbae9f1c90 2024-03-20T13:37:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.122+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94539454831856] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.122+0000 7f2b8eab5980 20 remove_watcher() i=5 2024-03-20T13:37:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.122+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539454849920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x55fbae9f1c90 2024-03-20T13:37:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.122+0000 7f2b8c5d0640 1 -- 172.21.15.123:0/2749851732 <== osd.3 v2:172.21.15.123:6816/3519650013 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94539454849920] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0cd070 con 0x55fbae9f1c90 2024-03-20T13:37:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.122+0000 7f2b8eab5980 20 remove_watcher() i=6 2024-03-20T13:37:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.122+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539454846720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fbaea04d70 con 0x7f2b8402ca80 2024-03-20T13:37:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94539454846720] v34'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7400e5a0 con 0x7f2b8402ca80 2024-03-20T13:37:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 20 remove_watcher() i=7 2024-03-20T13:37:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9eccb0 msgr2=0x55fbae9ef0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9eccb0 0x55fbae9ef0a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae9e8890 msgr2=0x55fbae9ead50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae9e8890 0x55fbae9ead50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2b8402ca80 msgr2=0x7f2b8402b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2b8402ca80 0x7f2b8402b9b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55fbae9f1c90 msgr2=0x55fbae9f4080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55fbae9f1c90 0x55fbae9f4080 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a5c034260 msgr2=0x7f2a5c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a5c034260 0x7f2a5c036720 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c01bb20 tx=0x7f2b7c0df000 comp rx=0 tx=0).stop 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8bdcf640 1 -- 172.21.15.123:0/2749851732 reap_dead start 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 msgr2=0x55fbae9dd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9dd250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2b84028e30 tx=0x7f2b84049500 comp rx=0 tx=0).stop 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 shutdown_connections 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/2749851732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9d6380 0x55fbae9dd250 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 >> 172.21.15.123:0/2749851732 conn(0x55fbae9d2710 msgr2=0x55fbae9cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 shutdown_connections 2024-03-20T13:37:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/2749851732 wait complete. 2024-03-20T13:37:20.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a640342b0 msgr2=0x7f2a64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a640342b0 0x7f2a64036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55fbae9b9960 tx=0x7f2b7c0cff80 comp rx=0 tx=0).stop 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 msgr2=0x55fbae9c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 0x55fbae9c9850 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400b010 tx=0x7f2b8400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 shutdown_connections 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a640342b0 0x7f2a64036770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/1974566098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae9c9430 0x55fbae9c9850 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 >> 172.21.15.123:0/1974566098 conn(0x55fbae9be240 msgr2=0x55fbae9bed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 shutdown_connections 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.126+0000 7f2b8eab5980 1 -- 172.21.15.123:0/1974566098 wait complete. 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9b6a30 msgr2=0x55fbae9b8e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9b6a30 0x55fbae9b8e20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae8c1530 msgr2=0x55fbae9b5c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae8c1530 0x55fbae9b5c80 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a740342b0 msgr2=0x7f2a74036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a740342b0 0x7f2a74036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2b74000f70 tx=0x7f2b740012c0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 msgr2=0x55fbae9af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9af000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c01b2c0 tx=0x7f2b7c018020 comp rx=0 tx=0).stop 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 shutdown_connections 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55fbae9b6a30 0x55fbae9b8e20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55fbae8c1530 0x55fbae9b5c80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2a740342b0 0x7f2a74036770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 --2- 172.21.15.123:0/4268426952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fbae830070 0x55fbae9af000 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 >> 172.21.15.123:0/4268426952 conn(0x55fbae8b66d0 msgr2=0x55fbae9a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 shutdown_connections 2024-03-20T13:37:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.130+0000 7f2b8eab5980 1 -- 172.21.15.123:0/4268426952 wait complete. 2024-03-20T13:37:20.148 INFO:teuthology.orchestra.run.smithi123.stdout:[{"tag":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.264115497229476378\u0000","time":"2024-03-20T13:37:19.871488+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_7","key":"","instance":""}]}] 2024-03-20T13:37:20.148 DEBUG:tasks.util.rgw: json result: [{'tag': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.264115497229476378\x00', 'time': '2024-03-20T13:37:19.871488+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_7', 'key': '', 'instance': ''}]}] 2024-03-20T13:37:20.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-03-20T13:37:20.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-03-20T13:37:20.148 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-03-20T13:37:20.224 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:20.224 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:20.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.218+0000 7f5f13ea2980 1 Processor -- start 2024-03-20T13:37:20.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.218+0000 7f5f13ea2980 1 -- start start 2024-03-20T13:37:20.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.218+0000 7f5f13ea2980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56529afec120 0x56529afec500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.218+0000 7f5f13ea2980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56529af36510 con 0x56529afeca40 2024-03-20T13:37:20.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.218+0000 7f5f13ea2980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56529aefd0f0 con 0x56529afec120 2024-03-20T13:37:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f119bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56529afec120 0x56529afec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f119bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56529afec120 0x56529afec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36210/0 (socket says 172.21.15.123:36210) 2024-03-20T13:37:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f119bd640 1 -- 172.21.15.123:0/1134582087 learned_addr learned my addr 172.21.15.123:0/1134582087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f111bc640 1 --1- 172.21.15.123:0/1134582087 >> v1:172.21.15.89:6789/0 conn(0x56529afeca40 0x56529afed3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33226/0 (socket says 172.21.15.123:33226) 2024-03-20T13:37:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f119bd640 1 -- 172.21.15.123:0/1134582087 >> v1:172.21.15.89:6789/0 conn(0x56529afeca40 legacy=0x56529afed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f119bd640 1 -- 172.21.15.123:0/1134582087 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56529afedc20 con 0x56529afec120 2024-03-20T13:37:20.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f119bd640 1 --2- 172.21.15.123:0/1134582087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529afec500 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00a4e0 tx=0x7f5f0c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95045d6acf132654 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f109bb640 1 -- 172.21.15.123:0/1134582087 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0c0aa540 con 0x56529afec120 2024-03-20T13:37:20.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f109bb640 1 -- 172.21.15.123:0/1134582087 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c0a6070 con 0x56529afec120 2024-03-20T13:37:20.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.222+0000 7f5f109bb640 1 -- 172.21.15.123:0/1134582087 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0c0aa850 con 0x56529afec120 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1134582087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 msgr2=0x56529afec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/1134582087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529afec500 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00a4e0 tx=0x7f5f0c01b090 comp rx=0 tx=0).stop 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1134582087 shutdown_connections 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/1134582087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529afec500 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1134582087 >> 172.21.15.123:0/1134582087 conn(0x56529af5f840 msgr2=0x56529af5fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1134582087 shutdown_connections 2024-03-20T13:37:20.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.226+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1134582087 wait complete. 2024-03-20T13:37:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.238+0000 7f5f13ea2980 1 Processor -- start 2024-03-20T13:37:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.238+0000 7f5f13ea2980 1 -- start start 2024-03-20T13:37:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.238+0000 7f5f13ea2980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0d65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.238+0000 7f5f13ea2980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529aefa620 con 0x56529afec120 2024-03-20T13:37:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0d65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0d65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36224/0 (socket says 172.21.15.123:36224) 2024-03-20T13:37:20.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 -- 172.21.15.123:0/1773550292 learned_addr learned my addr 172.21.15.123:0/1773550292 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 -- 172.21.15.123:0/1773550292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c00a1c0 con 0x56529afec120 2024-03-20T13:37:20.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 --2- 172.21.15.123:0/1773550292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0d65f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c018cc0 tx=0x7f5f0c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3106aa88967f7c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5dffe07640 1 -- 172.21.15.123:0/1773550292 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0c0aa700 con 0x56529afec120 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5dffe07640 1 -- 172.21.15.123:0/1773550292 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c0aa860 con 0x56529afec120 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5dffe07640 1 -- 172.21.15.123:0/1773550292 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0c0aab20 con 0x56529afec120 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1773550292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 msgr2=0x56529b0d65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/1773550292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0d65f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c018cc0 tx=0x7f5f0c0033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1773550292 shutdown_connections 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/1773550292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0d65f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1773550292 >> 172.21.15.123:0/1773550292 conn(0x56529af5f840 msgr2=0x56529b0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1773550292 shutdown_connections 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1773550292 wait complete. 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 Processor -- start 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- start start 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0dd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f13ea2980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529aef5e00 con 0x56529afec120 2024-03-20T13:37:20.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0dd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36232/0 (socket says 172.21.15.123:36232) 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 -- 172.21.15.123:0/3760276917 learned_addr learned my addr 172.21.15.123:0/3760276917 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.242+0000 7f5f119bd640 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56529afedc20 con 0x56529afec120 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0dd360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000f90 tx=0x7f5f0c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5dfe604640 1 -- 172.21.15.123:0/3760276917 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0c0c4070 con 0x56529afec120 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5dfe604640 1 -- 172.21.15.123:0/3760276917 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c0b5650 con 0x56529afec120 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56529b0dd8a0 con 0x56529afec120 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5dfe604640 1 -- 172.21.15.123:0/3760276917 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0c0b58f0 con 0x56529afec120 2024-03-20T13:37:20.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56529b0ddcd0 con 0x56529afec120 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5dfe604640 1 -- 172.21.15.123:0/3760276917 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5f0c0a8070 con 0x56529afec120 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5dfe604640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5df80342b0 0x7f5df8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5dfe604640 1 -- 172.21.15.123:0/3760276917 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5f0c0e3b30 con 0x56529afec120 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f111bc640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5df80342b0 0x7f5df8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529afeca40 0x56529b0e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b0e4520 con 0x56529afeca40 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f121be640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529afeca40 0x56529b0e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f111bc640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5df80342b0 0x7f5df8036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5f08000f70 tx=0x7f5f08001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f121be640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529afeca40 0x56529b0e3fe0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f121be640 1 -- 172.21.15.123:0/3760276917 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f040083f0 con 0x56529afeca40 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b0e4d90 0x56529b0e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b0e7830 con 0x56529b0e4d90 2024-03-20T13:37:20.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b0e4d90 0x56529b0e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.246+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b0e4d90 0x56529b0e7180 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f119bd640 1 -- 172.21.15.123:0/3760276917 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5f0c0d2c70 con 0x56529b0e4d90 2024-03-20T13:37:20.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b0e9090 con 0x56529b0e4d90 2024-03-20T13:37:20.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f119bd640 1 -- 172.21.15.123:0/3760276917 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5f0c0d2c70 con 0x56529b0e4d90 2024-03-20T13:37:20.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b0e81a0 con 0x56529b0e4d90 2024-03-20T13:37:20.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f119bd640 1 -- 172.21.15.123:0/3760276917 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f0c0d2c70 con 0x56529b0e4d90 2024-03-20T13:37:20.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b0e8550 con 0x56529afeca40 2024-03-20T13:37:20.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f121be640 1 -- 172.21.15.123:0/3760276917 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5f040083f0 con 0x56529afeca40 2024-03-20T13:37:20.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 Processor -- start 2024-03-20T13:37:20.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 -- start start 2024-03-20T13:37:20.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 0x56529b0f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f13ea2980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529ae8ee30 con 0x56529b0f77b0 2024-03-20T13:37:20.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f121be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 0x56529b0f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f121be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 0x56529b0f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36246/0 (socket says 172.21.15.123:36246) 2024-03-20T13:37:20.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f121be640 1 -- 172.21.15.123:0/168043568 learned_addr learned my addr 172.21.15.123:0/168043568 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.250+0000 7f5f121be640 1 -- 172.21.15.123:0/168043568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56529b0f8110 con 0x56529b0f77b0 2024-03-20T13:37:20.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f121be640 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 0x56529b0f7bd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400aab0 tx=0x7f5f0400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5df77fe640 1 -- 172.21.15.123:0/168043568 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f0401d070 con 0x56529b0f77b0 2024-03-20T13:37:20.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5df77fe640 1 -- 172.21.15.123:0/168043568 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04010040 con 0x56529b0f77b0 2024-03-20T13:37:20.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56529b0f8360 con 0x56529b0f77b0 2024-03-20T13:37:20.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5df77fe640 1 -- 172.21.15.123:0/168043568 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f04007e70 con 0x56529b0f77b0 2024-03-20T13:37:20.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56529b0f8eb0 con 0x56529b0f77b0 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5df77fe640 1 -- 172.21.15.123:0/168043568 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5f04018430 con 0x56529b0f77b0 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5df77fe640 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5dec034300 0x7f5dec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5df77fe640 1 -- 172.21.15.123:0/168043568 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5f0404a690 con 0x56529b0f77b0 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f119bd640 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5dec034300 0x7f5dec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f13ea2980 1 Processor -- start 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f13ea2980 1 -- start start 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f119bd640 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5dec034300 0x7f5dec0367c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x56529b0e7ca0 tx=0x7f5f0c0dc040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f13ea2980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f13ea2980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529ae82790 con 0x56529b104760 2024-03-20T13:37:20.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f121be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f121be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36248/0 (socket says 172.21.15.123:36248) 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f121be640 1 -- 172.21.15.123:0/1782910361 learned_addr learned my addr 172.21.15.123:0/1782910361 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.254+0000 7f5f121be640 1 -- 172.21.15.123:0/1782910361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56529b105150 con 0x56529b104760 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f121be640 1 --2- 172.21.15.123:0/1782910361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b104b80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5f04048920 tx=0x7f5f04020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1093cc726c580341 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5df57fa640 1 -- 172.21.15.123:0/1782910361 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f04047070 con 0x56529b104760 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5df57fa640 1 -- 172.21.15.123:0/1782910361 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04021530 con 0x56529b104760 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5df57fa640 1 -- 172.21.15.123:0/1782910361 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f04022410 con 0x56529b104760 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1782910361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 msgr2=0x56529b104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/1782910361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b104b80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5f04048920 tx=0x7f5f04020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1782910361 shutdown_connections 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/1782910361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b104b80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1782910361 >> 172.21.15.123:0/1782910361 conn(0x56529b100af0 msgr2=0x56529b0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1782910361 shutdown_connections 2024-03-20T13:37:20.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/1782910361 wait complete. 2024-03-20T13:37:20.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 Processor -- start 2024-03-20T13:37:20.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- start start 2024-03-20T13:37:20.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b10b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529b10bb70 con 0x56529b104760 2024-03-20T13:37:20.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f121be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b10b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f121be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b10b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36260/0 (socket says 172.21.15.123:36260) 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 learned_addr learned my addr 172.21.15.123:0/3176194349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56529b0f8eb0 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f121be640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b10b630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f04048920 tx=0x7f5f040488b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5de37fe640 1 -- 172.21.15.123:0/3176194349 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f04016540 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56529b10bd70 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5de37fe640 1 -- 172.21.15.123:0/3176194349 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04020900 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5de37fe640 1 -- 172.21.15.123:0/3176194349 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f04018810 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.258+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56529b10c200 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5de37fe640 1 -- 172.21.15.123:0/3176194349 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5f04018970 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5de37fe640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ddc034300 0x7f5ddc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5de37fe640 1 -- 172.21.15.123:0/3176194349 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5f04043070 con 0x56529b104760 2024-03-20T13:37:20.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ddc034300 0x7f5ddc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529b116d20 0x56529b1191e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b119930 con 0x56529b116d20 2024-03-20T13:37:20.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f111bc640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529b116d20 0x56529b1191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ddc034300 0x7f5ddc0367c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0aaf80 tx=0x7f5f0c0e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f111bc640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529b116d20 0x56529b1191e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 realm 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b116180 con 0x56529b116d20 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b11a3b0 con 0x56529b116d20 2024-03-20T13:37:20.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b11b140 0x56529b11d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b11dbb0 con 0x56529b11b140 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f121be640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b11b140 0x56529b11d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.262+0000 7f5f121be640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b11b140 0x56529b11d530 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b11e3b0 con 0x56529b11b140 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:20.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 20 searching for the correct realm 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56529b120410 0x56529b1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b120410 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56529b120410 0x56529b1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f119bd640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56529b120410 0x56529b1228d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b11b140 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f121be640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5f04036070 0x7f5f0403d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x7f5f04036070 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f111bc640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5f04036070 0x7f5f0403d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f111bc640 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5f04036070 0x7f5f0403d120 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.266+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b120410 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b11b140 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b11b140 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x7f5f04036070 2024-03-20T13:37:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b122fa0 con 0x56529b116d20 2024-03-20T13:37:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x7f5f04036070 2024-03-20T13:37:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b11b140 2024-03-20T13:37:20.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.270+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b120410 2024-03-20T13:37:20.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b116d20 2024-03-20T13:37:20.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b11b140 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b120410 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b116d20 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b116d20 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b116d20 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b120410 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x7f5f04036070 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b116d20 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x7f5f04036070 2024-03-20T13:37:20.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b120410 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x7f5f04036070 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.274+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b11b140 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b11b140 2024-03-20T13:37:20.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b120410 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b11b140 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f5f0802d080 con 0x56529b11b140 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:20.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b11f9a0 con 0x56529b116d20 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b11e920 con 0x56529b11b140 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.278+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b11f210 con 0x56529b116d20 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:20.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 zone default found 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 4 Realm: () 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 zonegroup default 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b123880 con 0x7f5f04036070 2024-03-20T13:37:20.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b123500 con 0x56529b120410 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b125b60 con 0x56529b120410 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 started sync module instance, tier type = 2024-03-20T13:37:20.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:20.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b125030 con 0x56529b11b140 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94912788976608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b125030 con 0x56529b11b140 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.282+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b126590 con 0x56529b116d20 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94912788979952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b126de0 con 0x56529b116d20 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1277e0 con 0x56529b11b140 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94912788976608] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94912788979952] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94912788984544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b126940 con 0x56529b11b140 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b128030 con 0x7f5f04036070 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94912788986768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b126940 con 0x7f5f04036070 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.286+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b128b40 con 0x56529b11b140 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94912788984544] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94912788986768] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94912788989472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b128b00 con 0x56529b11b140 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b128120 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94912788991728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b128b00 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b129dc0 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.290+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94912788989472] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94912788991728] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94912788992784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b129920 con 0x56529b120410 2024-03-20T13:37:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b12a610 con 0x7f5f04036070 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94912788992784] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94912788974480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b129920 con 0x7f5f04036070 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=0 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=1 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=2 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=3 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=4 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=5 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=6 2024-03-20T13:37:20.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94912788974480] v34'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 20 add_watcher() i=7 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b12d7c0 con 0x56529b116d20 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.294+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94912788996464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b12ab40 con 0x56529b116d20 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.298+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94912788996464] v34'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.298+0000 7f5dc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.298+0000 7f5f13ea2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.298+0000 7f5f13ea2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:20.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.298+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b135d10 con 0x56529b11b140 2024-03-20T13:37:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.302+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.302+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1361b0 con 0x7f5f04036070 2024-03-20T13:37:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.302+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.302+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1361b0 con 0x56529b120410 2024-03-20T13:37:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.302+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.302+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1366e0 con 0x56529b116d20 2024-03-20T13:37:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.306+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.306+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b136c10 con 0x56529b11b140 2024-03-20T13:37:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.306+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'48 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.306+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b137140 con 0x56529b120410 2024-03-20T13:37:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.310+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.310+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b137670 con 0x56529b11b140 2024-03-20T13:37:20.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.310+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.310+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b137ba0 con 0x56529b116d20 2024-03-20T13:37:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.314+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.314+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b138040 con 0x56529b11b140 2024-03-20T13:37:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.314+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.314+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b137ce0 con 0x56529b11b140 2024-03-20T13:37:20.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.318+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.318+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b137ce0 con 0x56529b11b140 2024-03-20T13:37:20.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.318+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'49 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.318+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b137ce0 con 0x56529b120410 2024-03-20T13:37:20.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.318+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.318+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b138210 con 0x56529b11b140 2024-03-20T13:37:20.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.322+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.322+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1386b0 con 0x56529b116d20 2024-03-20T13:37:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.322+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.322+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1386b0 con 0x56529b116d20 2024-03-20T13:37:20.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.326+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.326+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1386b0 con 0x56529b11b140 2024-03-20T13:37:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.326+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.326+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1386b0 con 0x56529b11b140 2024-03-20T13:37:20.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.330+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'50 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.330+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1386b0 con 0x56529b120410 2024-03-20T13:37:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.330+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.330+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1384a0 con 0x56529b11b140 2024-03-20T13:37:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.334+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.334+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1384a0 con 0x56529b116d20 2024-03-20T13:37:20.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.334+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.334+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b11b140 2024-03-20T13:37:20.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.338+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.338+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b11b140 2024-03-20T13:37:20.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.342+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.342+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b120410 2024-03-20T13:37:20.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.342+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.342+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b11b140 2024-03-20T13:37:20.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.342+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.346+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b120410 2024-03-20T13:37:20.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.346+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.346+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b120410 2024-03-20T13:37:20.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.346+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.346+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b120410 2024-03-20T13:37:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.350+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.350+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b11b140 2024-03-20T13:37:20.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.354+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.354+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b116d20 2024-03-20T13:37:20.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.354+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.354+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b11b140 2024-03-20T13:37:20.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.354+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.354+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x56529b116d20 2024-03-20T13:37:20.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1383e0 con 0x7f5f04036070 2024-03-20T13:37:20.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5dc27fc640 20 reqs_thread_entry: start 2024-03-20T13:37:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f13ea2980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f13ea2980 20 Filter name: none 2024-03-20T13:37:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5d33fff640 20 reqs_thread_entry: start 2024-03-20T13:37:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-03-20T13:37:20.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.358+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(94 gc.3 [call] v34'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(95 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b116d20 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(96 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(97 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(98 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.362+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:99 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(99 gc.3 [call] v34'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-03-20T13:37:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(100 gc.4 [call] v34'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(101 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.366+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:102 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(102 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:103 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(103 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:104 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(104 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.370+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:105 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(105 gc.4 [call] v34'52 uv52 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-03-20T13:37:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:106 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(106 gc.5 [call] v34'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:107 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(107 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:108 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b120410 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(108 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(110 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.374+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(111 gc.5 [call] v34'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-03-20T13:37:20.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(112 gc.6 [call] v34'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== osd_op_reply(113 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.378+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== osd_op_reply(114 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:115 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(115 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:116 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(116 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.382+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:117 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.386+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== osd_op_reply(117 gc.6 [call] v34'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.386+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-03-20T13:37:20.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.386+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:118 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.386+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(118 gc.7 [call] v34'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.386+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:119 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.386+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(119 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:120 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(120 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:121 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(121 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:122 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== osd_op_reply(122 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:123 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(123 gc.7 [call] v34'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-03-20T13:37:20.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.390+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:124 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== osd_op_reply(124 gc.8 [call] v34'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:125 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(125 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:126 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== osd_op_reply(126 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:127 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 49 ==== osd_op_reply(127 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:128 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 50 ==== osd_op_reply(128 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.394+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:129 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.398+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 51 ==== osd_op_reply(129 gc.8 [call] v34'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.398+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-03-20T13:37:20.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.398+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:130 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 52 ==== osd_op_reply(130 gc.9 [call] v34'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:131 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 53 ==== osd_op_reply(131 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:132 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 54 ==== osd_op_reply(132 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:133 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.402+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 55 ==== osd_op_reply(133 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.406+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.406+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:134 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.406+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 56 ==== osd_op_reply(134 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.406+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.406+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:135 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.410+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 57 ==== osd_op_reply(135 gc.9 [call] v34'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.410+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-03-20T13:37:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.410+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:136 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.410+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 58 ==== osd_op_reply(136 gc.10 [call] v34'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.410+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:137 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.410+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 59 ==== osd_op_reply(137 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:138 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 60 ==== osd_op_reply(138 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:139 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 61 ==== osd_op_reply(139 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:140 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 62 ==== osd_op_reply(140 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.414+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:141 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 63 ==== osd_op_reply(141 gc.10 [call] v34'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-03-20T13:37:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:142 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(142 gc.11 [call] v34'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:143 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(143 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.418+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:144 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b120410 2024-03-20T13:37:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(144 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:145 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(145 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:146 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(146 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:147 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(147 gc.11 [call] v34'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-03-20T13:37:20.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.422+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.426+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 64 ==== osd_op_reply(148 gc.12 [call] v34'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.426+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.426+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 65 ==== osd_op_reply(149 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.426+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.426+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:150 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 66 ==== osd_op_reply(150 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:151 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 67 ==== osd_op_reply(151 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:152 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 68 ==== osd_op_reply(152 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.430+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:153 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.434+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 69 ==== osd_op_reply(153 gc.12 [call] v34'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.434+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-03-20T13:37:20.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.434+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== osd_op_reply(154 gc.13 [call] v34'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== osd_op_reply(155 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:156 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b116d20 2024-03-20T13:37:20.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(156 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:157 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(157 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:158 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== osd_op_reply(158 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.438+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:159 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.442+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(159 gc.13 [call] v34'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.442+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-03-20T13:37:20.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.442+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(160 gc.14 [call] v34'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(161 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:162 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b116d20 2024-03-20T13:37:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(162 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:163 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(163 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:164 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 49 ==== osd_op_reply(164 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.446+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:165 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.450+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 50 ==== osd_op_reply(165 gc.14 [call] v34'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.450+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-03-20T13:37:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.450+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 70 ==== osd_op_reply(166 gc.15 [call] v34'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 71 ==== osd_op_reply(167 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:168 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 72 ==== osd_op_reply(168 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.454+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:169 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.458+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 73 ==== osd_op_reply(169 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.458+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.458+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:170 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.458+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 74 ==== osd_op_reply(170 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.458+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.458+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:171 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.462+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 75 ==== osd_op_reply(171 gc.15 [call] v34'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.462+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-03-20T13:37:20.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.462+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.462+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 76 ==== osd_op_reply(172 gc.16 [call] v34'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.462+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 77 ==== osd_op_reply(173 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:174 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 78 ==== osd_op_reply(174 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:175 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 79 ==== osd_op_reply(175 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:176 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 80 ==== osd_op_reply(176 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.466+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:177 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.470+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 81 ==== osd_op_reply(177 gc.16 [call] v34'56 uv56 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.470+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-03-20T13:37:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.470+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== osd_op_reply(178 gc.17 [call] v34'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(179 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:180 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b120410 2024-03-20T13:37:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(180 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:181 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(181 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.474+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:182 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.478+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== osd_op_reply(182 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.478+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.478+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:183 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b120410 2024-03-20T13:37:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.478+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(183 gc.17 [call] v34'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.478+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-03-20T13:37:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.478+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.482+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 82 ==== osd_op_reply(184 gc.18 [call] v34'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.482+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.482+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 83 ==== osd_op_reply(185 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.482+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.482+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:186 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 84 ==== osd_op_reply(186 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:187 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 85 ==== osd_op_reply(187 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:188 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 86 ==== osd_op_reply(188 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.486+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:189 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.490+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 87 ==== osd_op_reply(189 gc.18 [call] v34'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.490+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-03-20T13:37:20.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.490+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 51 ==== osd_op_reply(190 gc.19 [call] v34'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 52 ==== osd_op_reply(191 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:192 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b116d20 2024-03-20T13:37:20.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 53 ==== osd_op_reply(192 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:193 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 54 ==== osd_op_reply(193 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.494+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:194 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.498+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 55 ==== osd_op_reply(194 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.498+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.498+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:195 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b116d20 2024-03-20T13:37:20.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.498+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 56 ==== osd_op_reply(195 gc.19 [call] v34'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.498+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-03-20T13:37:20.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.498+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 88 ==== osd_op_reply(196 gc.20 [call] v34'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 89 ==== osd_op_reply(197 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:198 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 90 ==== osd_op_reply(198 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.502+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:199 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.506+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 91 ==== osd_op_reply(199 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.506+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.506+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:200 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.506+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 92 ==== osd_op_reply(200 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.506+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.506+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:201 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.510+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 93 ==== osd_op_reply(201 gc.20 [call] v34'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.510+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-03-20T13:37:20.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.510+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.510+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 94 ==== osd_op_reply(202 gc.21 [call] v34'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.510+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 95 ==== osd_op_reply(203 gc.21 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:204 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1343b0 con 0x56529b11b140 2024-03-20T13:37:20.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 96 ==== osd_op_reply(204 gc.21 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:205 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 97 ==== osd_op_reply(205 gc.21 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:206 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1353c0 con 0x56529b11b140 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 98 ==== osd_op_reply(206 gc.21 [call out=1700b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+1700 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 20 garbage collection: RGWGC::process iterating over entry tag='0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.264115497229476378', time=2024-03-20T13:37:19.871488+0000, chain.objs.size()=7 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_1 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:207 3.8s0 3:11d37589:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1330a0 con 0x56529b120410 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_2 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:208 3.23s0 3:c7a49c40:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b156a60 con 0x7f5f04036070 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_3 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:209 3.21s0 3:85051371:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_4 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:210 3.38s0 3:1fff16dd:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b15bd50 con 0x56529b120410 2024-03-20T13:37:20.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_5 2024-03-20T13:37:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:211 3.1bs0 3:d817755f:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b15e570 con 0x56529b120410 2024-03-20T13:37:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_6 2024-03-20T13:37:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:212 3.38s0 3:1f8387a8:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_7 2024-03-20T13:37:20.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.514+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:213 3.fs0 3:f0ff6b19:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b15bd50 con 0x56529b11b140 2024-03-20T13:37:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.522+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== osd_op_reply(211 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_5 [call] v34'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.522+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== osd_op_reply(210 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_4 [call] v34'5 uv5 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.526+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 42 ==== osd_op_reply(207 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_1 [call] v34'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.526+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(208 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_2 [call] v34'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.526+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 99 ==== osd_op_reply(213 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_7 [call] v34'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.526+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(209 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_3 [call] v34'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.526+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 43 ==== osd_op_reply(212 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.1__shadow_.eL7tI7GX7UuUxm8c3ykzVIWVBAr-OXH_6 [call] v34'6 uv6 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.530+0000 7f5f13ea2980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-20T13:37:20.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.530+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:214 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.534+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 100 ==== osd_op_reply(214 gc.21 [call] v34'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.534+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:215 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.538+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 101 ==== osd_op_reply(215 gc.21 [call] v34'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.538+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-03-20T13:37:20.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.538+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:216 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.538+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 44 ==== osd_op_reply(216 gc.22 [call] v34'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:217 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 45 ==== osd_op_reply(217 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:218 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 46 ==== osd_op_reply(218 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:219 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 47 ==== osd_op_reply(219 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:220 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 48 ==== osd_op_reply(220 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.542+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:221 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.546+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 49 ==== osd_op_reply(221 gc.22 [call] v34'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.546+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-03-20T13:37:20.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.546+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:222 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 102 ==== osd_op_reply(222 gc.23 [call] v34'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:223 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 103 ==== osd_op_reply(223 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:224 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 104 ==== osd_op_reply(224 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:225 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 105 ==== osd_op_reply(225 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:226 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 106 ==== osd_op_reply(226 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.550+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:227 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.554+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 107 ==== osd_op_reply(227 gc.23 [call] v34'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.554+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-03-20T13:37:20.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.554+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:228 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 50 ==== osd_op_reply(228 gc.24 [call] v34'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:229 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 51 ==== osd_op_reply(229 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:230 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 52 ==== osd_op_reply(230 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.558+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:231 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 53 ==== osd_op_reply(231 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:232 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 54 ==== osd_op_reply(232 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:233 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 55 ==== osd_op_reply(233 gc.24 [call] v34'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.562+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-03-20T13:37:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.566+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:234 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.566+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 56 ==== osd_op_reply(234 gc.25 [call] v34'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.566+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:235 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.566+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 57 ==== osd_op_reply(235 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.566+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.566+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:236 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 58 ==== osd_op_reply(236 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:237 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 59 ==== osd_op_reply(237 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:238 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 60 ==== osd_op_reply(238 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.570+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:239 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.574+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 61 ==== osd_op_reply(239 gc.25 [call] v34'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.574+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-03-20T13:37:20.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.574+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:240 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.574+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 62 ==== osd_op_reply(240 gc.26 [call] v34'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.574+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:241 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 63 ==== osd_op_reply(241 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:242 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 64 ==== osd_op_reply(242 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:243 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 65 ==== osd_op_reply(243 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:244 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 66 ==== osd_op_reply(244 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.578+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:245 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.582+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 67 ==== osd_op_reply(245 gc.26 [call] v34'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.582+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-03-20T13:37:20.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.582+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:246 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 108 ==== osd_op_reply(246 gc.27 [call] v34'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:247 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 109 ==== osd_op_reply(247 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:248 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 110 ==== osd_op_reply(248 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:249 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 111 ==== osd_op_reply(249 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:250 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 112 ==== osd_op_reply(250 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.586+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:251 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.590+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 113 ==== osd_op_reply(251 gc.27 [call] v34'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.590+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-03-20T13:37:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.590+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:252 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 57 ==== osd_op_reply(252 gc.28 [call] v34'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:253 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 58 ==== osd_op_reply(253 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:254 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 59 ==== osd_op_reply(254 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.594+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:255 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 60 ==== osd_op_reply(255 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:256 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 61 ==== osd_op_reply(256 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:257 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 62 ==== osd_op_reply(257 gc.28 [call] v34'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-03-20T13:37:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.598+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:258 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.602+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 114 ==== osd_op_reply(258 gc.29 [call] v34'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.602+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:259 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.602+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 115 ==== osd_op_reply(259 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.602+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.602+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:260 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 116 ==== osd_op_reply(260 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:261 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 117 ==== osd_op_reply(261 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:262 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 118 ==== osd_op_reply(262 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.606+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:263 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.610+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 119 ==== osd_op_reply(263 gc.29 [call] v34'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.610+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-03-20T13:37:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.610+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:264 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 63 ==== osd_op_reply(264 gc.30 [call] v34'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:265 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 64 ==== osd_op_reply(265 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:266 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 65 ==== osd_op_reply(266 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:267 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 66 ==== osd_op_reply(267 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:268 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 67 ==== osd_op_reply(268 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.614+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:269 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.618+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 68 ==== osd_op_reply(269 gc.30 [call] v34'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.618+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-03-20T13:37:20.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.618+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:270 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(270 gc.31 [call] v34'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:271 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(271 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:272 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(272 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:273 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(273 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:274 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(274 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.622+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:275 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.626+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(275 gc.31 [call] v34'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.626+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-03-20T13:37:20.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.626+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:276 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 120 ==== osd_op_reply(276 gc.0 [call] v34'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:277 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 121 ==== osd_op_reply(277 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:278 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 122 ==== osd_op_reply(278 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.630+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:279 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.634+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 123 ==== osd_op_reply(279 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.634+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.634+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:280 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.634+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 124 ==== osd_op_reply(280 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.634+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.634+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:281 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.638+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 125 ==== osd_op_reply(281 gc.0 [call] v34'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.638+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-03-20T13:37:20.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.638+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:282 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 22 ==== osd_op_reply(282 gc.1 [call] v34'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:283 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 23 ==== osd_op_reply(283 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:284 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 24 ==== osd_op_reply(284 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:285 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 25 ==== osd_op_reply(285 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:286 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 26 ==== osd_op_reply(286 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.642+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:287 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.646+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 27 ==== osd_op_reply(287 gc.1 [call] v34'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.646+0000 7f5f13ea2980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-03-20T13:37:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.646+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:288 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 68 ==== osd_op_reply(288 gc.2 [call] v34'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:289 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 69 ==== osd_op_reply(289 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:290 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 70 ==== osd_op_reply(290 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:291 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 71 ==== osd_op_reply(291 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:37:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:292 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 72 ==== osd_op_reply(292 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:37:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.650+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:293 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.654+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 73 ==== osd_op_reply(293 gc.2 [call] v34'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.658+0000 7f5dc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:20.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.658+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94912788996464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.658+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 69 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94912788996464] v34'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.658+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94912788976608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.662+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 126 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94912788976608] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.662+0000 7f5f13ea2980 20 remove_watcher() i=0 2024-03-20T13:37:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.662+0000 7f5f13ea2980 2 removed watcher, disabling cache 2024-03-20T13:37:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.662+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94912788979952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b116d20 2024-03-20T13:37:20.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.666+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.1 v2:172.21.15.123:6800/3706732118 70 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94912788979952] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x56529b116d20 2024-03-20T13:37:20.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.666+0000 7f5f13ea2980 20 remove_watcher() i=1 2024-03-20T13:37:20.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.666+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94912788984544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.666+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 127 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94912788984544] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.666+0000 7f5f13ea2980 20 remove_watcher() i=2 2024-03-20T13:37:20.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.666+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94912788986768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.670+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 28 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94912788986768] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.670+0000 7f5f13ea2980 20 remove_watcher() i=3 2024-03-20T13:37:20.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.670+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94912788989472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b11b140 2024-03-20T13:37:20.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.674+0000 7f5f121be640 1 -- 172.21.15.123:0/3176194349 <== osd.0 v2:172.21.15.89:6800/854515999 128 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94912788989472] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0401f070 con 0x56529b11b140 2024-03-20T13:37:20.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.674+0000 7f5f13ea2980 20 remove_watcher() i=4 2024-03-20T13:37:20.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.674+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94912788991728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.674+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 74 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94912788991728] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.674+0000 7f5f13ea2980 20 remove_watcher() i=5 2024-03-20T13:37:20.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.674+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94912788992784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x56529b120410 2024-03-20T13:37:20.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f119bd640 1 -- 172.21.15.123:0/3176194349 <== osd.3 v2:172.21.15.123:6816/3519650013 75 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94912788992784] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0c0ee040 con 0x56529b120410 2024-03-20T13:37:20.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 20 remove_watcher() i=6 2024-03-20T13:37:20.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94912788974480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56529b1592e0 con 0x7f5f04036070 2024-03-20T13:37:20.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 <== osd.2 v2:172.21.15.123:6803/1251286685 29 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94912788974480] v34'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f0800f620 con 0x7f5f04036070 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 20 remove_watcher() i=7 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b11b140 msgr2=0x56529b11d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b11b140 0x56529b11d530 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529b116d20 msgr2=0x56529b1191e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529b116d20 0x56529b1191e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5f04036070 msgr2=0x7f5f0403d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5f04036070 0x7f5f0403d120 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56529b120410 msgr2=0x56529b1228d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56529b120410 0x56529b1228d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ddc034300 msgr2=0x7f5ddc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5ddc034300 0x7f5ddc0367c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0aaf80 tx=0x7f5f0c0e0000 comp rx=0 tx=0).stop 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 msgr2=0x56529b10b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f111bc640 1 -- 172.21.15.123:0/3176194349 reap_dead start 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b10b630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f04048920 tx=0x7f5f040488b0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 shutdown_connections 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3176194349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b104760 0x56529b10b630 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 >> 172.21.15.123:0/3176194349 conn(0x56529b100af0 msgr2=0x56529b0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 shutdown_connections 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.678+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3176194349 wait complete. 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5dec034300 msgr2=0x7f5dec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5dec034300 0x7f5dec0367c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x56529b0e7ca0 tx=0x7f5f0c0dc040 comp rx=0 tx=0).stop 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 msgr2=0x56529b0f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 0x56529b0f7bd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400aab0 tx=0x7f5f0400af70 comp rx=0 tx=0).stop 2024-03-20T13:37:20.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 shutdown_connections 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5dec034300 0x7f5dec0367c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/168043568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529b0f77b0 0x56529b0f7bd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 >> 172.21.15.123:0/168043568 conn(0x56529b0ec5c0 msgr2=0x56529b0ed0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 shutdown_connections 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/168043568 wait complete. 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b0e4d90 msgr2=0x56529b0e7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b0e4d90 0x56529b0e7180 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529afeca40 msgr2=0x56529b0e3fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529afeca40 0x56529b0e3fe0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5df80342b0 msgr2=0x7f5df8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5df80342b0 0x7f5df8036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5f08000f70 tx=0x7f5f08001380 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 msgr2=0x56529b0dd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0dd360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000f90 tx=0x7f5f0c017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 shutdown_connections 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56529b0e4d90 0x56529b0e7180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56529afeca40 0x56529b0e3fe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5df80342b0 0x7f5df8036770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 --2- 172.21.15.123:0/3760276917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56529afec120 0x56529b0dd360 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 >> 172.21.15.123:0/3760276917 conn(0x56529af5f840 msgr2=0x56529b0d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 shutdown_connections 2024-03-20T13:37:20.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.682+0000 7f5f13ea2980 1 -- 172.21.15.123:0/3760276917 wait complete. 2024-03-20T13:37:20.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-03-20T13:37:20.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-03-20T13:37:20.707 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-03-20T13:37:20.789 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:20.789 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:20.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1e659980 1 Processor -- start 2024-03-20T13:37:20.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1e659980 1 -- start start 2024-03-20T13:37:20.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1e659980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5654a57a2630 0x5654a57a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1e659980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5654a56e8520 con 0x5654a579e130 2024-03-20T13:37:20.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1e659980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5654a56af0f0 con 0x5654a57a2630 2024-03-20T13:37:20.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1b973640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5654a57a2630 0x5654a57a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1b973640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5654a57a2630 0x5654a57a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36262/0 (socket says 172.21.15.123:36262) 2024-03-20T13:37:20.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1b973640 1 -- 172.21.15.123:0/802080416 learned_addr learned my addr 172.21.15.123:0/802080416 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1b973640 1 -- 172.21.15.123:0/802080416 >> v1:172.21.15.89:6789/0 conn(0x5654a579e130 legacy=0x5654a579e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.786+0000 7f4b1b973640 1 -- 172.21.15.123:0/802080416 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a57a5f70 con 0x5654a57a2630 2024-03-20T13:37:20.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1b973640 1 --2- 172.21.15.123:0/802080416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a57a2630 0x5654a57a4a20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a5c0 tx=0x7f4b1001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1464041f133c03b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1b172640 1 -- 172.21.15.123:0/802080416 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b100aa470 con 0x5654a57a2630 2024-03-20T13:37:20.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1b172640 1 -- 172.21.15.123:0/802080416 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b100aa5d0 con 0x5654a57a2630 2024-03-20T13:37:20.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1b172640 1 -- 172.21.15.123:0/802080416 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b100aa890 con 0x5654a57a2630 2024-03-20T13:37:20.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 -- 172.21.15.123:0/802080416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a57a2630 msgr2=0x5654a57a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 --2- 172.21.15.123:0/802080416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a57a2630 0x5654a57a4a20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a5c0 tx=0x7f4b1001b340 comp rx=0 tx=0).stop 2024-03-20T13:37:20.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 -- 172.21.15.123:0/802080416 shutdown_connections 2024-03-20T13:37:20.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 --2- 172.21.15.123:0/802080416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a57a2630 0x5654a57a4a20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 -- 172.21.15.123:0/802080416 >> 172.21.15.123:0/802080416 conn(0x5654a5711850 msgr2=0x5654a5711c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 -- 172.21.15.123:0/802080416 shutdown_connections 2024-03-20T13:37:20.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.790+0000 7f4b1e659980 1 -- 172.21.15.123:0/802080416 wait complete. 2024-03-20T13:37:20.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 Processor -- start 2024-03-20T13:37:20.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- start start 2024-03-20T13:37:20.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a5888070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a56ac620 con 0x5654a579e130 2024-03-20T13:37:20.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1c174640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a5888070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1c174640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a5888070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36264/0 (socket says 172.21.15.123:36264) 2024-03-20T13:37:20.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1c174640 1 -- 172.21.15.123:0/4061300291 learned_addr learned my addr 172.21.15.123:0/4061300291 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1c174640 1 -- 172.21.15.123:0/4061300291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10005df0 con 0x5654a579e130 2024-03-20T13:37:20.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1c174640 1 --2- 172.21.15.123:0/4061300291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a5888070 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c001d10 tx=0x7f4b0c00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca79e2f6e6656dd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4a0a60c640 1 -- 172.21.15.123:0/4061300291 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c014070 con 0x5654a579e130 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4a0a60c640 1 -- 172.21.15.123:0/4061300291 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00f560 con 0x5654a579e130 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4a0a60c640 1 -- 172.21.15.123:0/4061300291 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c00f840 con 0x5654a579e130 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- 172.21.15.123:0/4061300291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 msgr2=0x5654a5888070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 --2- 172.21.15.123:0/4061300291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a5888070 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c001d10 tx=0x7f4b0c00b5c0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- 172.21.15.123:0/4061300291 shutdown_connections 2024-03-20T13:37:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 --2- 172.21.15.123:0/4061300291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a5888070 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- 172.21.15.123:0/4061300291 >> 172.21.15.123:0/4061300291 conn(0x5654a5711850 msgr2=0x5654a5883c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- 172.21.15.123:0/4061300291 shutdown_connections 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.806+0000 7f4b1e659980 1 -- 172.21.15.123:0/4061300291 wait complete. 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 Processor -- start 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 -- start start 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a588eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a56a7e00 con 0x5654a579e130 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1c174640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a588eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1c174640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a588eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36266/0 (socket says 172.21.15.123:36266) 2024-03-20T13:37:20.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1c174640 1 -- 172.21.15.123:0/3436357520 learned_addr learned my addr 172.21.15.123:0/3436357520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1c174640 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a56e8520 con 0x5654a579e130 2024-03-20T13:37:20.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1c174640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a588eec0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x5654a5888f00 tx=0x7f4b0c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4a08e09640 1 -- 172.21.15.123:0/3436357520 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c014050 con 0x5654a579e130 2024-03-20T13:37:20.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4a08e09640 1 -- 172.21.15.123:0/3436357520 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c001520 con 0x5654a579e130 2024-03-20T13:37:20.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654a588f400 con 0x5654a579e130 2024-03-20T13:37:20.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4a08e09640 1 -- 172.21.15.123:0/3436357520 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0c01bad0 con 0x5654a579e130 2024-03-20T13:37:20.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654a588f890 con 0x5654a579e130 2024-03-20T13:37:20.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4a08e09640 1 -- 172.21.15.123:0/3436357520 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b0c022020 con 0x5654a579e130 2024-03-20T13:37:20.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4a08e09640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a040342b0 0x7f4a04036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4a08e09640 1 -- 172.21.15.123:0/3436357520 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4b0c048e80 con 0x5654a579e130 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1b973640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a040342b0 0x7f4a04036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a57a2630 0x5654a5895b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a5896080 con 0x5654a57a2630 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1c975640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a57a2630 0x5654a5895b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.810+0000 7f4b1b973640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a040342b0 0x7f4a04036770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b100ae000 tx=0x7f4b100a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c975640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a57a2630 0x5654a5895b40 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c975640 1 -- 172.21.15.123:0/3436357520 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a57a2630 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58968f0 0x5654a5898ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a5899400 con 0x5654a58968f0 2024-03-20T13:37:20.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c174640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58968f0 0x5654a5898ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c174640 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58968f0 0x5654a5898ce0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c174640 1 -- 172.21.15.123:0/3436357520 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b0c016070 con 0x5654a58968f0 2024-03-20T13:37:20.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a589ac60 con 0x5654a58968f0 2024-03-20T13:37:20.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c174640 1 -- 172.21.15.123:0/3436357520 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4b0c016070 con 0x5654a58968f0 2024-03-20T13:37:20.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a5899e60 con 0x5654a58968f0 2024-03-20T13:37:20.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1c174640 1 -- 172.21.15.123:0/3436357520 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b0c016070 con 0x5654a58968f0 2024-03-20T13:37:20.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.814+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a589a270 con 0x5654a57a2630 2024-03-20T13:37:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c975640 1 -- 172.21.15.123:0/3436357520 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a57a2630 2024-03-20T13:37:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1e659980 1 Processor -- start 2024-03-20T13:37:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1e659980 1 -- start start 2024-03-20T13:37:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1e659980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 0x5654a58a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1e659980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a5640e30 con 0x5654a58a9340 2024-03-20T13:37:20.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 0x5654a58a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 0x5654a58a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36272/0 (socket says 172.21.15.123:36272) 2024-03-20T13:37:20.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c975640 1 -- 172.21.15.123:0/3742732233 learned_addr learned my addr 172.21.15.123:0/3742732233 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c975640 1 -- 172.21.15.123:0/3742732233 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a58a9ca0 con 0x5654a58a9340 2024-03-20T13:37:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c975640 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 0x5654a58a9760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b14016cf0 tx=0x7f4b1400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4a01ffb640 1 -- 172.21.15.123:0/3742732233 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b14017660 con 0x5654a58a9340 2024-03-20T13:37:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654a58a9ef0 con 0x5654a58a9340 2024-03-20T13:37:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4a01ffb640 1 -- 172.21.15.123:0/3742732233 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140177c0 con 0x5654a58a9340 2024-03-20T13:37:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4a01ffb640 1 -- 172.21.15.123:0/3742732233 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b14017a60 con 0x5654a58a9340 2024-03-20T13:37:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654a58aaa40 con 0x5654a58a9340 2024-03-20T13:37:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4a01ffb640 1 -- 172.21.15.123:0/3742732233 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b1401d020 con 0x5654a58a9340 2024-03-20T13:37:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4a01ffb640 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49f40342b0 0x7f49f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4a01ffb640 1 -- 172.21.15.123:0/3742732233 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4b1404b310 con 0x5654a58a9340 2024-03-20T13:37:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.818+0000 7f4b1c174640 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49f40342b0 0x7f49f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 Processor -- start 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- start start 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c174640 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49f40342b0 0x7f49f4036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5654a5899960 tx=0x7f4b0c01bd40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a5634790 con 0x5654a58b6270 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36280/0 (socket says 172.21.15.123:36280) 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 -- 172.21.15.123:0/2635449200 learned_addr learned my addr 172.21.15.123:0/2635449200 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 -- 172.21.15.123:0/2635449200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a58b6c60 con 0x5654a58b6270 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 --2- 172.21.15.123:0/2635449200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58b6690 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b140495a0 tx=0x7f4b14049850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e80e45f46239f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f49fb7fe640 1 -- 172.21.15.123:0/2635449200 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b1403b070 con 0x5654a58b6270 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f49fb7fe640 1 -- 172.21.15.123:0/2635449200 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1404b110 con 0x5654a58b6270 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f49fb7fe640 1 -- 172.21.15.123:0/2635449200 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b14011cb0 con 0x5654a58b6270 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- 172.21.15.123:0/2635449200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 msgr2=0x5654a58b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 --2- 172.21.15.123:0/2635449200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58b6690 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b140495a0 tx=0x7f4b14049850 comp rx=0 tx=0).stop 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- 172.21.15.123:0/2635449200 shutdown_connections 2024-03-20T13:37:20.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 --2- 172.21.15.123:0/2635449200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58b6690 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- 172.21.15.123:0/2635449200 >> 172.21.15.123:0/2635449200 conn(0x5654a58b2600 msgr2=0x5654a58b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- 172.21.15.123:0/2635449200 shutdown_connections 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- 172.21.15.123:0/2635449200 wait complete. 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 Processor -- start 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- start start 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1e659980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a58bd6a0 con 0x5654a58b6270 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36296/0 (socket says 172.21.15.123:36296) 2024-03-20T13:37:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.822+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 learned_addr learned my addr 172.21.15.123:0/678965736 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a58aaa40 con 0x5654a58b6270 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1c975640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58bd160 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400dce0 tx=0x7f4b14049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f49f9ffb640 1 -- 172.21.15.123:0/678965736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b140481d0 con 0x5654a58b6270 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654a58bd8a0 con 0x5654a58b6270 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f49f9ffb640 1 -- 172.21.15.123:0/678965736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140499b0 con 0x5654a58b6270 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f49f9ffb640 1 -- 172.21.15.123:0/678965736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b14049c50 con 0x5654a58b6270 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654a58bdcd0 con 0x5654a58b6270 2024-03-20T13:37:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f49f9ffb640 1 -- 172.21.15.123:0/678965736 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b1401f8b0 con 0x5654a58b6270 2024-03-20T13:37:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f49f9ffb640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49ec0342b0 0x7f49ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f49f9ffb640 1 -- 172.21.15.123:0/678965736 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4b1403c040 con 0x5654a58b6270 2024-03-20T13:37:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a58c87f0 0x5654a58cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58cb400 con 0x5654a58c87f0 2024-03-20T13:37:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1b973640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a58c87f0 0x5654a58cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1b973640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a58c87f0 0x5654a58cacb0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 realm 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58cb7f0 con 0x5654a58c87f0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58cc070 con 0x5654a58c87f0 2024-03-20T13:37:20.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.826+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58cca50 0x5654a58cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58cf5d0 con 0x5654a58cca50 2024-03-20T13:37:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c975640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58cca50 0x5654a58cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c975640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58cca50 0x5654a58cee60 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58cfe20 con 0x5654a58cca50 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 20 searching for the correct realm 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5654a58d1b40 0x5654a58d3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58d1b40 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c174640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5654a58d1b40 0x5654a58d3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c174640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5654a58d1b40 0x5654a58d3f30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.830+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58cca50 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b14025c40 0x7f4b14005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x7f4b14025c40 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b14025c40 0x7f4b14005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b14025c40 0x7f4b14005040 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x7f4b14025c40 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58c87f0 2024-03-20T13:37:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58c87f0 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58d1b40 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58c87f0 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58cca50 2024-03-20T13:37:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d4510 con 0x5654a58cca50 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.834+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x7f4b14025c40 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x7f4b14025c40 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x7f4b14025c40 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4b100b0020 con 0x7f4b14025c40 2024-03-20T13:37:20.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58cca50 2024-03-20T13:37:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58d1b40 2024-03-20T13:37:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58cca50 2024-03-20T13:37:20.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58d1b40 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100b0020 con 0x5654a58c87f0 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.838+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58d1b40 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x7f4b14025c40 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58c87f0 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x7f4b14025c40 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58d1b40 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x7f4b14025c40 2024-03-20T13:37:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58cca50 2024-03-20T13:37:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58cca50 2024-03-20T13:37:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.842+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58d1b40 2024-03-20T13:37:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58cca50 2024-03-20T13:37:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4b1405b040 con 0x5654a58cca50 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d0620 con 0x5654a58c87f0 2024-03-20T13:37:20.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d09d0 con 0x5654a58cca50 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d09d0 con 0x5654a58c87f0 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 zone default found 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 4 Realm: () 2024-03-20T13:37:20.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 zonegroup default 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d1250 con 0x7f4b14025c40 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d6820 con 0x5654a58d1b40 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.846+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b0c04d040 con 0x5654a58d1b40 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 20 rados->read ofs=0 len=0 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d6b80 con 0x5654a58d1b40 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:20.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 20 started sync module instance, tier type = 2024-03-20T13:37:20.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:20.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d5df0 con 0x5654a58cca50 2024-03-20T13:37:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94921554747808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d5df0 con 0x5654a58cca50 2024-03-20T13:37:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.850+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d74f0 con 0x5654a58c87f0 2024-03-20T13:37:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94921554751568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d7910 con 0x5654a58c87f0 2024-03-20T13:37:20.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d8390 con 0x5654a58cca50 2024-03-20T13:37:20.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94921554747808] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94921554751568] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94921554755216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d7470 con 0x5654a58cca50 2024-03-20T13:37:20.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d8be0 con 0x7f4b14025c40 2024-03-20T13:37:20.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94921554757440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d7470 con 0x7f4b14025c40 2024-03-20T13:37:20.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.854+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d9680 con 0x5654a58cca50 2024-03-20T13:37:20.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1c174640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49ec0342b0 0x7f49ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:20.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94921554755216] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94921554757440] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1c174640 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49ec0342b0 0x7f49ec036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5654a58d0fc0 tx=0x7f4b0c054040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:20.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94921554758496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d9680 con 0x5654a58cca50 2024-03-20T13:37:20.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d9a60 con 0x5654a58d1b40 2024-03-20T13:37:20.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94921554745680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d9a60 con 0x5654a58d1b40 2024-03-20T13:37:20.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58da9b0 con 0x5654a58d1b40 2024-03-20T13:37:20.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.858+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94921554758496] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94921554745680] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94921554763280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58da9b0 con 0x5654a58d1b40 2024-03-20T13:37:20.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58db200 con 0x7f4b14025c40 2024-03-20T13:37:20.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94921554763280] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94921554760096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58db200 con 0x7f4b14025c40 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=0 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=1 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=2 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=3 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=4 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=5 2024-03-20T13:37:20.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=6 2024-03-20T13:37:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94921554760096] v34'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 20 add_watcher() i=7 2024-03-20T13:37:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58de3d0 con 0x5654a58c87f0 2024-03-20T13:37:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.862+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94921554767200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58db620 con 0x5654a58c87f0 2024-03-20T13:37:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94921554767200] v34'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f49d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f4b1e659980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f4b1e659980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:20.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e68e0 con 0x5654a58cca50 2024-03-20T13:37:20.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.866+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e68e0 con 0x7f4b14025c40 2024-03-20T13:37:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.870+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.870+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e6ab0 con 0x5654a58d1b40 2024-03-20T13:37:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.870+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.870+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58dd290 con 0x5654a58c87f0 2024-03-20T13:37:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.874+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.874+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58dd8a0 con 0x5654a58cca50 2024-03-20T13:37:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.874+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'57 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.874+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58ddeb0 con 0x5654a58d1b40 2024-03-20T13:37:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.878+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.878+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e81e0 con 0x5654a58cca50 2024-03-20T13:37:20.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.878+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.878+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e8710 con 0x5654a58c87f0 2024-03-20T13:37:20.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.882+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.882+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e8c40 con 0x5654a58cca50 2024-03-20T13:37:20.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.882+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.882+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e8c40 con 0x5654a58cca50 2024-03-20T13:37:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.886+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.886+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e8c40 con 0x5654a58cca50 2024-03-20T13:37:20.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.886+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'58 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.886+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e8c40 con 0x5654a58d1b40 2024-03-20T13:37:20.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.890+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.890+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e90e0 con 0x5654a58cca50 2024-03-20T13:37:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.890+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.890+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e90e0 con 0x5654a58c87f0 2024-03-20T13:37:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.890+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.890+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e90e0 con 0x5654a58c87f0 2024-03-20T13:37:20.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.894+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.894+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.898+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.898+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.898+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'59 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.898+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58d1b40 2024-03-20T13:37:20.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.902+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.902+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.902+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.902+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58c87f0 2024-03-20T13:37:20.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.906+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.906+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.910+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.910+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.910+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.910+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58d1b40 2024-03-20T13:37:20.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.914+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.914+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.914+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.914+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58d1b40 2024-03-20T13:37:20.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.918+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.918+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58d1b40 2024-03-20T13:37:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.918+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.918+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58d1b40 2024-03-20T13:37:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.918+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.918+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.922+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.922+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58c87f0 2024-03-20T13:37:20.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.922+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.922+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58cca50 2024-03-20T13:37:20.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.926+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.926+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x5654a58c87f0 2024-03-20T13:37:20.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.926+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.926+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e91c0 con 0x7f4b14025c40 2024-03-20T13:37:20.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f49d17e2640 20 reqs_thread_entry: start 2024-03-20T13:37:20.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1e659980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:20.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1e659980 20 Filter name: none 2024-03-20T13:37:20.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4942ffd640 20 reqs_thread_entry: start 2024-03-20T13:37:20.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4cf0 con 0x5654a58cca50 2024-03-20T13:37:20.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.930+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x7f4b14025c40 2024-03-20T13:37:20.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4cd0 con 0x7f4b14025c40 2024-03-20T13:37:20.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e50b0 con 0x7f4b14025c40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e50b0 con 0x5654a58d1b40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e50b0 con 0x5654a58d1b40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e50b0 con 0x5654a58d1b40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e50b0 con 0x5654a58c87f0 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.934+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.938+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.942+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58c87f0 2024-03-20T13:37:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4d10 con 0x5654a58cca50 2024-03-20T13:37:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.946+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4d10 con 0x5654a58cca50 2024-03-20T13:37:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.950+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.950+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.950+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.950+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.950+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.950+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4d10 con 0x5654a58cca50 2024-03-20T13:37:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58d1b40 2024-03-20T13:37:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4d10 con 0x5654a58d1b40 2024-03-20T13:37:20.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58d1b40 2024-03-20T13:37:20.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4d10 con 0x5654a58cca50 2024-03-20T13:37:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.954+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58c87f0 2024-03-20T13:37:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4d10 con 0x5654a58c87f0 2024-03-20T13:37:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58c87f0 2024-03-20T13:37:20.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58c87f0 2024-03-20T13:37:20.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58c87f0 2024-03-20T13:37:20.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.958+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.962+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58d1b40 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4cb0 con 0x5654a58d1b40 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58d1b40 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.966+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.970+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.974+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58cca50 2024-03-20T13:37:20.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58d1b40 2024-03-20T13:37:20.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4cb0 con 0x5654a58d1b40 2024-03-20T13:37:20.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.978+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e4930 con 0x5654a58d1b40 2024-03-20T13:37:20.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e5090 con 0x5654a58d1b40 2024-03-20T13:37:20.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.982+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:20.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:20.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.986+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:20.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:20.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:20.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:20.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.990+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x7f4b14025c40 2024-03-20T13:37:20.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x7f4b14025c40 2024-03-20T13:37:20.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:20.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x7f4b14025c40 2024-03-20T13:37:20.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:21.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f49d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.994+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94921554767200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:21.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.998+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94921554767200] v34'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:21.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.998+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94921554747808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:21.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.998+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94921554747808] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:21.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.998+0000 7f4b1e659980 20 remove_watcher() i=0 2024-03-20T13:37:21.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.998+0000 7f4b1e659980 2 removed watcher, disabling cache 2024-03-20T13:37:21.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:20.998+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94921554751568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58c87f0 2024-03-20T13:37:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.002+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.1 v2:172.21.15.123:6800/3706732118 49 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94921554751568] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x5654a58c87f0 2024-03-20T13:37:21.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.002+0000 7f4b1e659980 20 remove_watcher() i=1 2024-03-20T13:37:21.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.002+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94921554755216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.002+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94921554755216] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.002+0000 7f4b1e659980 20 remove_watcher() i=2 2024-03-20T13:37:21.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.002+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94921554757440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x7f4b14025c40 2024-03-20T13:37:21.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.006+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94921554757440] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:21.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.006+0000 7f4b1e659980 20 remove_watcher() i=3 2024-03-20T13:37:21.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.006+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94921554758496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58cca50 2024-03-20T13:37:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1c975640 1 -- 172.21.15.123:0/678965736 <== osd.0 v2:172.21.15.89:6800/854515999 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94921554758496] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b1400a4d0 con 0x5654a58cca50 2024-03-20T13:37:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1e659980 20 remove_watcher() i=4 2024-03-20T13:37:21.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94921554745680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58e3920 con 0x5654a58d1b40 2024-03-20T13:37:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94921554745680] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1e659980 20 remove_watcher() i=5 2024-03-20T13:37:21.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94921554763280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d61a0 con 0x5654a58d1b40 2024-03-20T13:37:21.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1c174640 1 -- 172.21.15.123:0/678965736 <== osd.3 v2:172.21.15.123:6816/3519650013 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94921554763280] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b0c059040 con 0x5654a58d1b40 2024-03-20T13:37:21.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1e659980 20 remove_watcher() i=6 2024-03-20T13:37:21.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.010+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94921554760096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5654a58d7050 con 0x7f4b14025c40 2024-03-20T13:37:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94921554760096] v34'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b100d5060 con 0x7f4b14025c40 2024-03-20T13:37:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 20 remove_watcher() i=7 2024-03-20T13:37:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58cca50 msgr2=0x5654a58cee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58cca50 0x5654a58cee60 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a58c87f0 msgr2=0x5654a58cacb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a58c87f0 0x5654a58cacb0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b14025c40 msgr2=0x7f4b14005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4b14025c40 0x7f4b14005040 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5654a58d1b40 msgr2=0x5654a58d3f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5654a58d1b40 0x5654a58d3f30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49ec0342b0 msgr2=0x7f49ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49ec0342b0 0x7f49ec036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5654a58d0fc0 tx=0x7f4b0c054040 comp rx=0 tx=0).stop 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1b973640 1 -- 172.21.15.123:0/678965736 reap_dead start 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 msgr2=0x5654a58bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58bd160 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400dce0 tx=0x7f4b14049530 comp rx=0 tx=0).stop 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 shutdown_connections 2024-03-20T13:37:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/678965736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58b6270 0x5654a58bd160 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 >> 172.21.15.123:0/678965736 conn(0x5654a58b2600 msgr2=0x5654a58afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 shutdown_connections 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/678965736 wait complete. 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49f40342b0 msgr2=0x7f49f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49f40342b0 0x7f49f4036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5654a5899960 tx=0x7f4b0c01bd40 comp rx=0 tx=0).stop 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 msgr2=0x5654a58a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 0x5654a58a9760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b14016cf0 tx=0x7f4b1400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 shutdown_connections 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49f40342b0 0x7f49f4036770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3742732233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a58a9340 0x5654a58a9760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 >> 172.21.15.123:0/3742732233 conn(0x5654a589e150 msgr2=0x5654a589ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 shutdown_connections 2024-03-20T13:37:21.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3742732233 wait complete. 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58968f0 msgr2=0x5654a5898ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58968f0 0x5654a5898ce0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a57a2630 msgr2=0x5654a5895b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.014+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a57a2630 0x5654a5895b40 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a040342b0 msgr2=0x7f4a04036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a040342b0 0x7f4a04036770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b100ae000 tx=0x7f4b100a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 msgr2=0x5654a588eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a588eec0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x5654a5888f00 tx=0x7f4b0c000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 shutdown_connections 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5654a58968f0 0x5654a5898ce0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5654a57a2630 0x5654a5895b40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f4a040342b0 0x7f4a04036770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 --2- 172.21.15.123:0/3436357520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654a579e130 0x5654a588eec0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 >> 172.21.15.123:0/3436357520 conn(0x5654a5711850 msgr2=0x5654a5882710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 shutdown_connections 2024-03-20T13:37:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.018+0000 7f4b1e659980 1 -- 172.21.15.123:0/3436357520 wait complete. 2024-03-20T13:37:21.037 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-03-20T13:37:21.038 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:37:21.038 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-03-20T13:37:21.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-03-20T13:37:21.038 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-03-20T13:37:21.118 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:21.118 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:21.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c6b23980 1 Processor -- start 2024-03-20T13:37:21.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c6b23980 1 -- start start 2024-03-20T13:37:21.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c6b23980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f0f65e0e00 0x55f0f666eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c6b23980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f0f65b8520 con 0x55f0f65e2140 2024-03-20T13:37:21.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c6b23980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f0f657f0f0 con 0x55f0f65e0e00 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c3e3d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f0f65e0e00 0x55f0f666eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c3e3d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f0f65e0e00 0x55f0f666eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36298/0 (socket says 172.21.15.123:36298) 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c463e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f0f65e2140 0x55f0f65e06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33248/0 (socket says 172.21.15.123:33248) 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/2094996995 learned_addr learned my addr 172.21.15.123:0/2094996995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/2094996995 >> v1:172.21.15.89:6789/0 conn(0x55f0f65e2140 legacy=0x55f0f65e06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c363c640 1 -- 172.21.15.123:0/2094996995 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426767601 0 0) 0x55f0f65b8520 con 0x55f0f65e2140 2024-03-20T13:37:21.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.114+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/2094996995 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f65e1210 con 0x55f0f65e0e00 2024-03-20T13:37:21.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/2094996995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f666eb30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800a4e0 tx=0x7ff3b801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28833372d96a6ce server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c363c640 1 -- 172.21.15.123:0/2094996995 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b80aa540 con 0x55f0f65e0e00 2024-03-20T13:37:21.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c363c640 1 -- 172.21.15.123:0/2094996995 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80a6070 con 0x55f0f65e0e00 2024-03-20T13:37:21.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c363c640 1 -- 172.21.15.123:0/2094996995 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b80aa810 con 0x55f0f65e0e00 2024-03-20T13:37:21.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2094996995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 msgr2=0x55f0f666eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/2094996995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f666eb30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800a4e0 tx=0x7ff3b801b090 comp rx=0 tx=0).stop 2024-03-20T13:37:21.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2094996995 shutdown_connections 2024-03-20T13:37:21.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/2094996995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f666eb30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2094996995 >> 172.21.15.123:0/2094996995 conn(0x55f0f6667810 msgr2=0x55f0f6669c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2094996995 shutdown_connections 2024-03-20T13:37:21.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.118+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2094996995 wait complete. 2024-03-20T13:37:21.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c6b23980 1 Processor -- start 2024-03-20T13:37:21.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c6b23980 1 -- start start 2024-03-20T13:37:21.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c6b23980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f675c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c6b23980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f657c620 con 0x55f0f65e0e00 2024-03-20T13:37:21.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c463e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f675c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c463e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f675c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36300/0 (socket says 172.21.15.123:36300) 2024-03-20T13:37:21.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c463e640 1 -- 172.21.15.123:0/2830402812 learned_addr learned my addr 172.21.15.123:0/2830402812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c463e640 1 -- 172.21.15.123:0/2830402812 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b800a1c0 con 0x55f0f65e0e00 2024-03-20T13:37:21.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.134+0000 7ff3c463e640 1 --2- 172.21.15.123:0/2830402812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f675c4c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400b250 tx=0x7ff3b400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb40ebd93977fb2c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff2b260c640 1 -- 172.21.15.123:0/2830402812 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4014070 con 0x55f0f65e0e00 2024-03-20T13:37:21.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff2b260c640 1 -- 172.21.15.123:0/2830402812 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b400d640 con 0x55f0f65e0e00 2024-03-20T13:37:21.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff2b260c640 1 -- 172.21.15.123:0/2830402812 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b400d960 con 0x55f0f65e0e00 2024-03-20T13:37:21.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2830402812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 msgr2=0x55f0f675c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/2830402812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f675c4c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400b250 tx=0x7ff3b400b710 comp rx=0 tx=0).stop 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2830402812 shutdown_connections 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/2830402812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e0e00 0x55f0f675c4c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2830402812 >> 172.21.15.123:0/2830402812 conn(0x55f0f6667810 msgr2=0x55f0f6758050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2830402812 shutdown_connections 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2830402812 wait complete. 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 Processor -- start 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- start start 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 0x55f0f67635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f6577e00 con 0x55f0f65e2140 2024-03-20T13:37:21.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c463e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 0x55f0f67635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c463e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 0x55f0f67635a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36312/0 (socket says 172.21.15.123:36312) 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c463e640 1 -- 172.21.15.123:0/3512690956 learned_addr learned my addr 172.21.15.123:0/3512690956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c463e640 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4001bb0 con 0x55f0f65e2140 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c463e640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 0x55f0f67635a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000c10 tx=0x7ff3b4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff2b0e09640 1 -- 172.21.15.123:0/3512690956 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4001510 con 0x55f0f65e2140 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f6763ae0 con 0x55f0f65e2140 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff2b0e09640 1 -- 172.21.15.123:0/3512690956 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b4021070 con 0x55f0f65e2140 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff2b0e09640 1 -- 172.21.15.123:0/3512690956 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b400fa10 con 0x55f0f65e2140 2024-03-20T13:37:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.138+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f6763f10 con 0x55f0f65e2140 2024-03-20T13:37:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff2b0e09640 1 -- 172.21.15.123:0/3512690956 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3b400fc80 con 0x55f0f65e2140 2024-03-20T13:37:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff2b0e09640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff2ac034300 0x7ff2ac0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff2b0e09640 1 -- 172.21.15.123:0/3512690956 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff3b404a0c0 con 0x55f0f65e2140 2024-03-20T13:37:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff2ac034300 0x7ff2ac0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f6768210 0x55f0f676a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f676ab40 con 0x55f0f6768210 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f6768210 0x55f0f676a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff2ac034300 0x7ff2ac0367c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80ab000 tx=0x7ff3b80a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f6768210 0x55f0f676a600 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/3512690956 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3bc0083f0 con 0x55f0f6768210 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f676b3b0 0x55f0f676d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f676df50 con 0x55f0f676b3b0 2024-03-20T13:37:21.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c463e640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f676b3b0 0x55f0f676d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c463e640 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f676b3b0 0x55f0f676d7e0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c463e640 1 -- 172.21.15.123:0/3512690956 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f676b3b0 2024-03-20T13:37:21.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.142+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f676f7b0 con 0x55f0f676b3b0 2024-03-20T13:37:21.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c463e640 1 -- 172.21.15.123:0/3512690956 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f676b3b0 2024-03-20T13:37:21.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f676e9b0 con 0x55f0f676b3b0 2024-03-20T13:37:21.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c463e640 1 -- 172.21.15.123:0/3512690956 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f676b3b0 2024-03-20T13:37:21.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f676edc0 con 0x55f0f6768210 2024-03-20T13:37:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/3512690956 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff3bc0083f0 con 0x55f0f6768210 2024-03-20T13:37:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c6b23980 1 Processor -- start 2024-03-20T13:37:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c6b23980 1 -- start start 2024-03-20T13:37:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c6b23980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 0x55f0f677e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c6b23980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f6510e30 con 0x55f0f677df40 2024-03-20T13:37:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c4e3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 0x55f0f677e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c4e3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 0x55f0f677e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36324/0 (socket says 172.21.15.123:36324) 2024-03-20T13:37:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/147636591 learned_addr learned my addr 172.21.15.123:0/147636591 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/147636591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f677e8a0 con 0x55f0f677df40 2024-03-20T13:37:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.146+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 0x55f0f677e360 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00aae0 tx=0x7ff3bc008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff2a9ffb640 1 -- 172.21.15.123:0/147636591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc01d070 con 0x55f0f677df40 2024-03-20T13:37:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff2a9ffb640 1 -- 172.21.15.123:0/147636591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc010040 con 0x55f0f677df40 2024-03-20T13:37:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff2a9ffb640 1 -- 172.21.15.123:0/147636591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc007e70 con 0x55f0f677df40 2024-03-20T13:37:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f677eaf0 con 0x55f0f677df40 2024-03-20T13:37:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f677f640 con 0x55f0f677df40 2024-03-20T13:37:21.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff2a9ffb640 1 -- 172.21.15.123:0/147636591 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3bc018430 con 0x55f0f677df40 2024-03-20T13:37:21.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff2a9ffb640 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff29c0342b0 0x7ff29c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff2a9ffb640 1 -- 172.21.15.123:0/147636591 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff3bc04a750 con 0x55f0f677df40 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c463e640 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff29c0342b0 0x7ff29c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c6b23980 1 Processor -- start 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c6b23980 1 -- start start 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c463e640 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff29c0342b0 0x7ff29c036770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55f0f676e3f0 tx=0x7ff3b40482e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c6b23980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f678b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c6b23980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f6504790 con 0x55f0f678aeb0 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c4e3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f678b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c4e3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f678b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36328/0 (socket says 172.21.15.123:36328) 2024-03-20T13:37:21.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/2383456551 learned_addr learned my addr 172.21.15.123:0/2383456551 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/2383456551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f678b8a0 con 0x55f0f678aeb0 2024-03-20T13:37:21.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/2383456551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f678b2d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc048a10 tx=0x7ff3bc020430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60e5bedd934d944 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff29b7fe640 1 -- 172.21.15.123:0/2383456551 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc03e030 con 0x55f0f678aeb0 2024-03-20T13:37:21.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff29b7fe640 1 -- 172.21.15.123:0/2383456551 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc022590 con 0x55f0f678aeb0 2024-03-20T13:37:21.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.150+0000 7ff29b7fe640 1 -- 172.21.15.123:0/2383456551 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc042b40 con 0x55f0f678aeb0 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2383456551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 msgr2=0x55f0f678b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/2383456551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f678b2d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc048a10 tx=0x7ff3bc020430 comp rx=0 tx=0).stop 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2383456551 shutdown_connections 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/2383456551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f678b2d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2383456551 >> 172.21.15.123:0/2383456551 conn(0x55f0f6787240 msgr2=0x55f0f67852a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2383456551 shutdown_connections 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/2383456551 wait complete. 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 Processor -- start 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- start start 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f6791da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f67922e0 con 0x55f0f678aeb0 2024-03-20T13:37:21.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c4e3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f6791da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c4e3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f6791da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36344/0 (socket says 172.21.15.123:36344) 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 learned_addr learned my addr 172.21.15.123:0/4009309871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f677f640 con 0x55f0f678aeb0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f6791da0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0077a0 tx=0x7ff3bc048970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff299ffb640 1 -- 172.21.15.123:0/4009309871 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc0475d0 con 0x55f0f678aeb0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f67924e0 con 0x55f0f678aeb0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff299ffb640 1 -- 172.21.15.123:0/4009309871 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc047730 con 0x55f0f678aeb0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f6792910 con 0x55f0f678aeb0 2024-03-20T13:37:21.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff299ffb640 1 -- 172.21.15.123:0/4009309871 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3bc04ab60 con 0x55f0f678aeb0 2024-03-20T13:37:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff299ffb640 1 -- 172.21.15.123:0/4009309871 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3bc041070 con 0x55f0f678aeb0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff299ffb640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff28c0342b0 0x7ff28c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff299ffb640 1 -- 172.21.15.123:0/4009309871 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff3bc03f070 con 0x55f0f678aeb0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.154+0000 7ff3c463e640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff28c0342b0 0x7ff28c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f679d450 0x55f0f679f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a0060 con 0x55f0f679d450 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f679d450 0x55f0f679f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c463e640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff28c0342b0 0x7ff28c036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e970 tx=0x7ff3b403f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f679d450 0x55f0f679f910 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3b80aa960 con 0x55f0f679d450 2024-03-20T13:37:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 realm 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a0450 con 0x55f0f679d450 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3b80aa960 con 0x55f0f679d450 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a0cd0 con 0x55f0f679d450 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3b80aa960 con 0x55f0f679d450 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f67a16b0 0x55f0f67a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a4250 con 0x55f0f67a16b0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f67a16b0 0x55f0f67a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f67a16b0 0x55f0f67a3ae0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a4a50 con 0x55f0f67a16b0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 20 searching for the correct realm 2024-03-20T13:37:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f0f67a6990 0x55f0f67a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.158+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c463e640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f0f67a6990 0x55f0f67a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c463e640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f0f67a6990 0x55f0f67a8e50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c4e3f640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff3bc055040 0x7ff3bc0240b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x7ff3bc055040 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff3bc055040 0x7ff3bc0240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff3bc055040 0x7ff3bc0240b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80aa960 con 0x7ff3bc055040 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.162+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x7ff3bc055040 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x7ff3bc055040 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x7ff3bc055040 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff3b80c9040 con 0x7ff3bc055040 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.166+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80c9040 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x7ff3bc055040 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f679d450 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x7ff3bc055040 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.170+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x7ff3bc055040 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a6990 2024-03-20T13:37:21.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9520 con 0x55f0f67a16b0 2024-03-20T13:37:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a5f20 con 0x55f0f679d450 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.174+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a4ea0 con 0x55f0f67a16b0 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a5790 con 0x55f0f679d450 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 zone default found 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 4 Realm: () 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:21.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 zonegroup default 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67a9e00 con 0x7ff3bc055040 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67abfe0 con 0x55f0f67a6990 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ac340 con 0x55f0f67a6990 2024-03-20T13:37:21.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 started sync module instance, tier type = 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.178+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ab470 con 0x55f0f67a16b0 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94493415749712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ab470 con 0x55f0f67a16b0 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67accb0 con 0x55f0f679d450 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94493415753744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ad4b0 con 0x55f0f679d450 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ade60 con 0x55f0f67a16b0 2024-03-20T13:37:21.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94493415749712] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.182+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94493415753744] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94493415747536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ad010 con 0x55f0f67a16b0 2024-03-20T13:37:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ae6b0 con 0x7ff3bc055040 2024-03-20T13:37:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94493415760400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ad010 con 0x7ff3bc055040 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67af180 con 0x55f0f67a16b0 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94493415747536] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94493415760400] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94493415761456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67af180 con 0x55f0f67a16b0 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.186+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67af570 con 0x55f0f67a6990 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94493415763056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67afdc0 con 0x55f0f67a6990 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b0770 con 0x55f0f67a6990 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94493415761456] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94493415763056] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94493415766304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b0290 con 0x55f0f67a6990 2024-03-20T13:37:21.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b0fc0 con 0x7ff3bc055040 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94493415766304] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.190+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94493415758208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b0fc0 con 0x7ff3bc055040 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=0 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=1 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=2 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=3 2024-03-20T13:37:21.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=4 2024-03-20T13:37:21.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=5 2024-03-20T13:37:21.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=6 2024-03-20T13:37:21.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94493415758208] v34'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 20 add_watcher() i=7 2024-03-20T13:37:21.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:21.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b43b0 con 0x55f0f679d450 2024-03-20T13:37:21.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.194+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94493415771376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b1890 con 0x55f0f679d450 2024-03-20T13:37:21.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94493415771376] v34'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff27a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff3c6b23980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:21.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff3c6b23980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:21.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b3cb0 con 0x55f0f67a16b0 2024-03-20T13:37:21.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.198+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b3d50 con 0x7ff3bc055040 2024-03-20T13:37:21.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.202+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.202+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67b41b0 con 0x55f0f67a6990 2024-03-20T13:37:21.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.202+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.202+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bd430 con 0x55f0f679d450 2024-03-20T13:37:21.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.206+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.206+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bd430 con 0x55f0f67a16b0 2024-03-20T13:37:21.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.206+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'60 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.206+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bde00 con 0x55f0f67a6990 2024-03-20T13:37:21.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.206+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.206+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67be330 con 0x55f0f67a16b0 2024-03-20T13:37:21.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.210+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.210+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67be860 con 0x55f0f679d450 2024-03-20T13:37:21.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.210+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.210+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bed90 con 0x55f0f67a16b0 2024-03-20T13:37:21.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.214+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.214+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bed90 con 0x55f0f67a16b0 2024-03-20T13:37:21.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.218+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.218+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bed90 con 0x55f0f67a16b0 2024-03-20T13:37:21.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.218+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'61 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.218+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bed90 con 0x55f0f67a6990 2024-03-20T13:37:21.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.218+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.218+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bdd00 con 0x55f0f67a16b0 2024-03-20T13:37:21.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.222+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.222+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bdd00 con 0x55f0f679d450 2024-03-20T13:37:21.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.222+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.222+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f679d450 2024-03-20T13:37:21.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.226+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.226+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.230+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.230+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.230+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'62 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.230+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a6990 2024-03-20T13:37:21.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.234+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.234+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.234+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.234+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f679d450 2024-03-20T13:37:21.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.238+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.238+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.238+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.238+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.242+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.242+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a6990 2024-03-20T13:37:21.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.242+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.242+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.246+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.246+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a6990 2024-03-20T13:37:21.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.246+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.246+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a6990 2024-03-20T13:37:21.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.250+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.250+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a6990 2024-03-20T13:37:21.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.250+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.250+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.254+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.254+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f679d450 2024-03-20T13:37:21.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.254+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.254+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f67a16b0 2024-03-20T13:37:21.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.258+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.258+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x55f0f679d450 2024-03-20T13:37:21.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.258+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.258+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bf230 con 0x7ff3bc055040 2024-03-20T13:37:21.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff2797e2640 20 reqs_thread_entry: start 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 20 Filter name: none 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff1eaffd640 20 reqs_thread_entry: start 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67bacc0 con 0x55f0f679d450 2024-03-20T13:37:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67db880 con 0x7ff3bc055040 2024-03-20T13:37:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-03-20T13:37:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff27a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.262+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94493415771376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67baad0 con 0x55f0f679d450 2024-03-20T13:37:21.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.266+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94493415771376] v34'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.266+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94493415749712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67baad0 con 0x55f0f67a16b0 2024-03-20T13:37:21.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.266+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94493415749712] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.266+0000 7ff3c6b23980 20 remove_watcher() i=0 2024-03-20T13:37:21.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.266+0000 7ff3c6b23980 2 removed watcher, disabling cache 2024-03-20T13:37:21.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.266+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94493415753744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ab850 con 0x55f0f679d450 2024-03-20T13:37:21.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.270+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94493415753744] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x55f0f679d450 2024-03-20T13:37:21.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.270+0000 7ff3c6b23980 20 remove_watcher() i=1 2024-03-20T13:37:21.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.270+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94493415747536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ab850 con 0x55f0f67a16b0 2024-03-20T13:37:21.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.270+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94493415747536] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.270+0000 7ff3c6b23980 20 remove_watcher() i=2 2024-03-20T13:37:21.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.270+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94493415760400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67aafd0 con 0x7ff3bc055040 2024-03-20T13:37:21.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94493415760400] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c6b23980 20 remove_watcher() i=3 2024-03-20T13:37:21.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94493415761456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ab850 con 0x55f0f67a16b0 2024-03-20T13:37:21.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c4e3f640 1 -- 172.21.15.123:0/4009309871 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94493415761456] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3bc033070 con 0x55f0f67a16b0 2024-03-20T13:37:21.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c6b23980 20 remove_watcher() i=4 2024-03-20T13:37:21.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94493415763056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67aafd0 con 0x55f0f67a6990 2024-03-20T13:37:21.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.274+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94493415763056] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 20 remove_watcher() i=5 2024-03-20T13:37:21.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94493415766304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67ab850 con 0x55f0f67a6990 2024-03-20T13:37:21.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c463e640 1 -- 172.21.15.123:0/4009309871 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94493415766304] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b4016070 con 0x55f0f67a6990 2024-03-20T13:37:21.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 20 remove_watcher() i=6 2024-03-20T13:37:21.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94493415758208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f67aec70 con 0x7ff3bc055040 2024-03-20T13:37:21.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94493415758208] v34'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b80d6060 con 0x7ff3bc055040 2024-03-20T13:37:21.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 20 remove_watcher() i=7 2024-03-20T13:37:21.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f67a16b0 msgr2=0x55f0f67a3ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f67a16b0 0x55f0f67a3ae0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f679d450 msgr2=0x55f0f679f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f679d450 0x55f0f679f910 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff3bc055040 msgr2=0x7ff3bc0240b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff3bc055040 0x7ff3bc0240b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f0f67a6990 msgr2=0x55f0f67a8e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f0f67a6990 0x55f0f67a8e50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff28c0342b0 msgr2=0x7ff28c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff28c0342b0 0x7ff28c036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e970 tx=0x7ff3b403f000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 msgr2=0x55f0f6791da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f6791da0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0077a0 tx=0x7ff3bc048970 comp rx=0 tx=0).stop 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c3e3d640 1 -- 172.21.15.123:0/4009309871 reap_dead start 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 shutdown_connections 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/4009309871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f678aeb0 0x55f0f6791da0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 >> 172.21.15.123:0/4009309871 conn(0x55f0f6787240 msgr2=0x55f0f67848a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 shutdown_connections 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/4009309871 wait complete. 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff29c0342b0 msgr2=0x7ff29c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.278+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff29c0342b0 0x7ff29c036770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55f0f676e3f0 tx=0x7ff3b40482e0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 msgr2=0x55f0f677e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 0x55f0f677e360 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00aae0 tx=0x7ff3bc008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 shutdown_connections 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff29c0342b0 0x7ff29c036770 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/147636591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f677df40 0x55f0f677e360 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 >> 172.21.15.123:0/147636591 conn(0x55f0f6772d50 msgr2=0x55f0f6773860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 shutdown_connections 2024-03-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/147636591 wait complete. 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f676b3b0 msgr2=0x55f0f676d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f676b3b0 0x55f0f676d7e0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f6768210 msgr2=0x55f0f676a600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f6768210 0x55f0f676a600 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff2ac034300 msgr2=0x7ff2ac0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff2ac034300 0x7ff2ac0367c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80ab000 tx=0x7ff3b80a5000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 msgr2=0x55f0f67635a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 0x55f0f67635a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000c10 tx=0x7ff3b4000ee0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 shutdown_connections 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f676b3b0 0x55f0f676d7e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f0f6768210 0x55f0f676a600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff2ac034300 0x7ff2ac0367c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 --2- 172.21.15.123:0/3512690956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f65e2140 0x55f0f67635a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 >> 172.21.15.123:0/3512690956 conn(0x55f0f6667810 msgr2=0x55f0f6756b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 shutdown_connections 2024-03-20T13:37:21.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.282+0000 7ff3c6b23980 1 -- 172.21.15.123:0/3512690956 wait complete. 2024-03-20T13:37:21.298 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:37:21.309 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-03-20T13:37:21.315 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:21.351 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:21.366 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:21.411 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-03-20T13:37:21.423 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:21.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:37:21.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:37:21.423 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:37:21.460 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:21.460 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:21.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.454+0000 7fc3b63d9980 1 Processor -- start 2024-03-20T13:37:21.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.454+0000 7fc3b63d9980 1 -- start start 2024-03-20T13:37:21.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.454+0000 7fc3b63d9980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56139c91e720 0x56139c920b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.454+0000 7fc3b63d9980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56139c8644c0 con 0x56139c88c900 2024-03-20T13:37:21.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b63d9980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56139c82b0f0 con 0x56139c91e720 2024-03-20T13:37:21.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b36f3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56139c91e720 0x56139c920b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b36f3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56139c91e720 0x56139c920b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36350/0 (socket says 172.21.15.123:36350) 2024-03-20T13:37:21.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b3ef4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56139c88c900 0x56139c91d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33260/0 (socket says 172.21.15.123:33260) 2024-03-20T13:37:21.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3442408083 learned_addr learned my addr 172.21.15.123:0/3442408083 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3442408083 >> v1:172.21.15.89:6789/0 conn(0x56139c88c900 legacy=0x56139c91d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3442408083 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139c922060 con 0x56139c91e720 2024-03-20T13:37:21.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3442408083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c91e720 0x56139c920b10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800a5c0 tx=0x7fc3a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3cb1fd8ea1e205 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b2ef2640 1 -- 172.21.15.123:0/3442408083 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a80aa470 con 0x56139c91e720 2024-03-20T13:37:21.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b2ef2640 1 -- 172.21.15.123:0/3442408083 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a80aa5d0 con 0x56139c91e720 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.458+0000 7fc3b2ef2640 1 -- 172.21.15.123:0/3442408083 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a80aa890 con 0x56139c91e720 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3442408083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c91e720 msgr2=0x56139c920b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3442408083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c91e720 0x56139c920b10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800a5c0 tx=0x7fc3a801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3442408083 shutdown_connections 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3442408083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c91e720 0x56139c920b10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3442408083 >> 172.21.15.123:0/3442408083 conn(0x56139c912720 msgr2=0x56139c914b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3442408083 shutdown_connections 2024-03-20T13:37:21.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.462+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3442408083 wait complete. 2024-03-20T13:37:21.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 Processor -- start 2024-03-20T13:37:21.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- start start 2024-03-20T13:37:21.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139c828620 con 0x56139c88c900 2024-03-20T13:37:21.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b3ef4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b3ef4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca040f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36360/0 (socket says 172.21.15.123:36360) 2024-03-20T13:37:21.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/2894640139 learned_addr learned my addr 172.21.15.123:0/2894640139 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/2894640139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8005df0 con 0x56139c88c900 2024-03-20T13:37:21.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/2894640139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca040f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006fb0 tx=0x7fc3ac001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53938272a49fdf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc2a1e0b640 1 -- 172.21.15.123:0/2894640139 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3ac013420 con 0x56139c88c900 2024-03-20T13:37:21.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc2a1e0b640 1 -- 172.21.15.123:0/2894640139 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac013580 con 0x56139c88c900 2024-03-20T13:37:21.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc2a1e0b640 1 -- 172.21.15.123:0/2894640139 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3ac013860 con 0x56139c88c900 2024-03-20T13:37:21.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- 172.21.15.123:0/2894640139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 msgr2=0x56139ca040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/2894640139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca040f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006fb0 tx=0x7fc3ac001940 comp rx=0 tx=0).stop 2024-03-20T13:37:21.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- 172.21.15.123:0/2894640139 shutdown_connections 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/2894640139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca040f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- 172.21.15.123:0/2894640139 >> 172.21.15.123:0/2894640139 conn(0x56139c912720 msgr2=0x56139c9ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- 172.21.15.123:0/2894640139 shutdown_connections 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- 172.21.15.123:0/2894640139 wait complete. 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 Processor -- start 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- start start 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca0af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.478+0000 7fc3b63d9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139c823e00 con 0x56139c88c900 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b3ef4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca0af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b3ef4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca0af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36376/0 (socket says 172.21.15.123:36376) 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3389874911 learned_addr learned my addr 172.21.15.123:0/3389874911 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139c8644c0 con 0x56139c88c900 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca0af40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x56139ca04f80 tx=0x7fc3ac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc29bfff640 1 -- 172.21.15.123:0/3389874911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3ac0037a0 con 0x56139c88c900 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56139ca0b480 con 0x56139c88c900 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56139ca0b8b0 con 0x56139c88c900 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc29bfff640 1 -- 172.21.15.123:0/3389874911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac003900 con 0x56139c88c900 2024-03-20T13:37:21.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc29bfff640 1 -- 172.21.15.123:0/3389874911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3ac003ba0 con 0x56139c88c900 2024-03-20T13:37:21.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc29bfff640 1 -- 172.21.15.123:0/3389874911 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3ac003d00 con 0x56139c88c900 2024-03-20T13:37:21.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc29bfff640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc29c0342b0 0x7fc29c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc29bfff640 1 -- 172.21.15.123:0/3389874911 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc3ac0496d0 con 0x56139c88c900 2024-03-20T13:37:21.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc29c0342b0 0x7fc29c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139c91e720 0x56139ca11bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca12100 con 0x56139c91e720 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139c91e720 0x56139ca11bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139c91e720 0x56139ca11bc0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.482+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc29c0342b0 0x7fc29c036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80ae000 tx=0x7fc3a80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3389874911 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3a40083f0 con 0x56139c91e720 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca12970 0x56139ca14d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca15460 con 0x56139ca12970 2024-03-20T13:37:21.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca12970 0x56139ca14d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca12970 0x56139ca14d60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3389874911 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca12970 2024-03-20T13:37:21.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca16ca0 con 0x56139ca12970 2024-03-20T13:37:21.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3389874911 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca12970 2024-03-20T13:37:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca15ea0 con 0x56139ca12970 2024-03-20T13:37:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3389874911 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca12970 2024-03-20T13:37:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca162b0 con 0x56139c91e720 2024-03-20T13:37:21.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.486+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3389874911 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc3a40083f0 con 0x56139c91e720 2024-03-20T13:37:21.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 Processor -- start 2024-03-20T13:37:21.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 -- start start 2024-03-20T13:37:21.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 0x56139ca25850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139c7bce30 con 0x56139ca25430 2024-03-20T13:37:21.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b46f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 0x56139ca25850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b46f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 0x56139ca25850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36380/0 (socket says 172.21.15.123:36380) 2024-03-20T13:37:21.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b46f5640 1 -- 172.21.15.123:0/32976850 learned_addr learned my addr 172.21.15.123:0/32976850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b46f5640 1 -- 172.21.15.123:0/32976850 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139ca25d90 con 0x56139ca25430 2024-03-20T13:37:21.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 0x56139ca25850 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400aae0 tx=0x7fc3a4008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc2997fa640 1 -- 172.21.15.123:0/32976850 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a401d070 con 0x56139ca25430 2024-03-20T13:37:21.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc2997fa640 1 -- 172.21.15.123:0/32976850 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a4010040 con 0x56139ca25430 2024-03-20T13:37:21.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56139ca25fe0 con 0x56139ca25430 2024-03-20T13:37:21.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc2997fa640 1 -- 172.21.15.123:0/32976850 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a4007e70 con 0x56139ca25430 2024-03-20T13:37:21.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56139ca26b30 con 0x56139ca25430 2024-03-20T13:37:21.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc2997fa640 1 -- 172.21.15.123:0/32976850 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3a4018430 con 0x56139ca25430 2024-03-20T13:37:21.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc2997fa640 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc28c0342b0 0x7fc28c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc2997fa640 1 -- 172.21.15.123:0/32976850 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc3a404a790 con 0x56139ca25430 2024-03-20T13:37:21.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc28c0342b0 0x7fc28c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.490+0000 7fc3b63d9980 1 Processor -- start 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- start start 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc28c0342b0 0x7fc28c036770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56139ca158e0 tx=0x7fc3ac0123c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139c7b0790 con 0x56139ca323d0 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca327f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36392/0 (socket says 172.21.15.123:36392) 2024-03-20T13:37:21.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3990060350 learned_addr learned my addr 172.21.15.123:0/3990060350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3990060350 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139ca32dc0 con 0x56139ca323d0 2024-03-20T13:37:21.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3990060350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca327f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4048a20 tx=0x7fc3a4021770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90621d6bf16d24dd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc292ffd640 1 -- 172.21.15.123:0/3990060350 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a4047070 con 0x56139ca323d0 2024-03-20T13:37:21.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc292ffd640 1 -- 172.21.15.123:0/3990060350 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a4039220 con 0x56139ca323d0 2024-03-20T13:37:21.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc292ffd640 1 -- 172.21.15.123:0/3990060350 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a40393d0 con 0x56139ca323d0 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3990060350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 msgr2=0x56139ca327f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3990060350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca327f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4048a20 tx=0x7fc3a4021770 comp rx=0 tx=0).stop 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3990060350 shutdown_connections 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3990060350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca327f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3990060350 >> 172.21.15.123:0/3990060350 conn(0x56139ca2e710 msgr2=0x56139ca2c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3990060350 shutdown_connections 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3990060350 wait complete. 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 Processor -- start 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- start start 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca39220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b63d9980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139ca39760 con 0x56139ca323d0 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca39220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca39220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36396/0 (socket says 172.21.15.123:36396) 2024-03-20T13:37:21.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 learned_addr learned my addr 172.21.15.123:0/3877808117 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.494+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139ca26b30 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca39220 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4048980 tx=0x7fc3a40489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc2917fa640 1 -- 172.21.15.123:0/3877808117 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a4021e00 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc2917fa640 1 -- 172.21.15.123:0/3877808117 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a404a0d0 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56139ca39960 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc2917fa640 1 -- 172.21.15.123:0/3877808117 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3a404a430 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56139ca39df0 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc2917fa640 1 -- 172.21.15.123:0/3877808117 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc3a404aa70 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc2917fa640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc27c0342b0 0x7fc27c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc2917fa640 1 -- 172.21.15.123:0/3877808117 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc3a4036d90 con 0x56139ca323d0 2024-03-20T13:37:21.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc27c0342b0 0x7fc27c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139ca44970 0x56139ca46e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca47580 con 0x56139ca44970 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139ca44970 0x56139ca46e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc27c0342b0 0x7fc27c036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac027720 tx=0x7fc3ac034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139ca44970 0x56139ca46e30 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 realm 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca47970 con 0x56139ca44970 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca481f0 con 0x56139ca44970 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca48bd0 0x56139ca4b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.498+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca4b770 con 0x56139ca48bd0 2024-03-20T13:37:21.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca48bd0 0x56139ca4b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca48bd0 0x56139ca4b000 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca4bf70 con 0x56139ca48bd0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 20 searching for the correct realm 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56139ca4deb0 0x56139ca50370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56139ca4deb0 0x56139ca50370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b3ef4640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56139ca4deb0 0x56139ca50370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc3a4035070 0x7fc3a401d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.502+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x7fc3a4035070 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc3a4035070 0x7fc3a401d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc3a4035070 0x7fc3a401d960 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x7fc3a4035070 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.506+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x7fc3a4035070 2024-03-20T13:37:21.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x7fc3a4035070 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x7fc3a4035070 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc3a80b0020 con 0x7fc3a4035070 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80b0020 con 0x56139ca44970 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.510+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x7fc3a4035070 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca44970 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x7fc3a4035070 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x7fc3a4035070 2024-03-20T13:37:21.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca4deb0 2024-03-20T13:37:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.514+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50a40 con 0x56139ca48bd0 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca4d440 con 0x56139ca44970 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca4c3c0 con 0x56139ca48bd0 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca4ccb0 con 0x56139ca44970 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 zone default found 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 4 Realm: () 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 zonegroup default 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca51320 con 0x7fc3a4035070 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca50f40 con 0x56139ca4deb0 2024-03-20T13:37:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca535a0 con 0x56139ca4deb0 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 started sync module instance, tier type = 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:21.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.518+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca52ad0 con 0x56139ca48bd0 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.522+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.522+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642232438400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca52ad0 con 0x56139ca48bd0 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.522+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca54010 con 0x56139ca44970 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.522+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.522+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642232441616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca54860 con 0x56139ca44970 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.522+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca55280 con 0x56139ca48bd0 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642232438400] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642232441616] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642232446304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca543c0 con 0x56139ca48bd0 2024-03-20T13:37:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca55ad0 con 0x7fc3a4035070 2024-03-20T13:37:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642232448560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca543c0 con 0x7fc3a4035070 2024-03-20T13:37:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.526+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca565a0 con 0x56139ca48bd0 2024-03-20T13:37:21.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642232448560] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642232446304] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642232436272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca560c0 con 0x56139ca48bd0 2024-03-20T13:37:21.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca56e20 con 0x56139ca4deb0 2024-03-20T13:37:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642232453504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca560c0 con 0x56139ca4deb0 2024-03-20T13:37:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca57c30 con 0x56139ca4deb0 2024-03-20T13:37:21.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642232436272] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642232453504] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.530+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642232449616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca57c30 con 0x56139ca4deb0 2024-03-20T13:37:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca58430 con 0x7fc3a4035070 2024-03-20T13:37:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642232449616] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642232457584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca58310 con 0x7fc3a4035070 2024-03-20T13:37:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=0 2024-03-20T13:37:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=1 2024-03-20T13:37:21.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=2 2024-03-20T13:37:21.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=3 2024-03-20T13:37:21.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=4 2024-03-20T13:37:21.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=5 2024-03-20T13:37:21.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=6 2024-03-20T13:37:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642232457584] v34'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 20 add_watcher() i=7 2024-03-20T13:37:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca5b7e0 con 0x56139ca44970 2024-03-20T13:37:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.534+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642232458704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca58c90 con 0x56139ca44970 2024-03-20T13:37:21.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642232458704] v34'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 5 note: GC not initialized 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc268fe1640 20 reqs_thread_entry: start 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 Filter name: none 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc1e27fc640 20 reqs_thread_entry: start 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca7dde0 con 0x7fc3a4035070 2024-03-20T13:37:21.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:21.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:21.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:21.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 : miss 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 8.15 8:a9ce0b4f:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca7f6b0 con 0x56139ca4deb0 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 info.flags=0x17 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 to cache LRU end 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 20 get_obj_state: octx=0x7fc3a80aab30 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56139ca817a8 s->prefetch_data=0 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 3.2as0 3:55dd5bc1:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca48bd0 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.538+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+864 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.542+0000 7fc3b63d9980 10 manifest: total_size = 5 2024-03-20T13:37:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.542+0000 7fc3b63d9980 20 get_obj_state: setting s->obj_tag to _wZoD52s5KyjHvA5mfm4qmr-ZIC_7kn8 2024-03-20T13:37:21.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.542+0000 7fc269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.542+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642232458704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca44970 2024-03-20T13:37:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.542+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94642232458704] v34'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.542+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642232438400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca48bd0 2024-03-20T13:37:21.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94642232438400] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b63d9980 20 remove_watcher() i=0 2024-03-20T13:37:21.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b63d9980 2 removed watcher, disabling cache 2024-03-20T13:37:21.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642232441616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca44970 2024-03-20T13:37:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94642232441616] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x56139ca44970 2024-03-20T13:37:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b63d9980 20 remove_watcher() i=1 2024-03-20T13:37:21.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.546+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642232446304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca48bd0 2024-03-20T13:37:21.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94642232446304] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b63d9980 20 remove_watcher() i=2 2024-03-20T13:37:21.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642232448560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x7fc3a4035070 2024-03-20T13:37:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94642232448560] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b63d9980 20 remove_watcher() i=3 2024-03-20T13:37:21.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642232436272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca48bd0 2024-03-20T13:37:21.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b46f5640 1 -- 172.21.15.123:0/3877808117 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94642232436272] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a4041040 con 0x56139ca48bd0 2024-03-20T13:37:21.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b63d9980 20 remove_watcher() i=4 2024-03-20T13:37:21.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.550+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642232453504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca4deb0 2024-03-20T13:37:21.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94642232453504] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 20 remove_watcher() i=5 2024-03-20T13:37:21.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642232449616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x56139ca4deb0 2024-03-20T13:37:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b3ef4640 1 -- 172.21.15.123:0/3877808117 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94642232449616] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3ac024020 con 0x56139ca4deb0 2024-03-20T13:37:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 20 remove_watcher() i=6 2024-03-20T13:37:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642232457584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56139ca828e0 con 0x7fc3a4035070 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94642232457584] v34'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc3a80d5060 con 0x7fc3a4035070 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 20 remove_watcher() i=7 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca48bd0 msgr2=0x56139ca4b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca48bd0 0x56139ca4b000 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139ca44970 msgr2=0x56139ca46e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139ca44970 0x56139ca46e30 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc3a4035070 msgr2=0x7fc3a401d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc3a4035070 0x7fc3a401d960 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56139ca4deb0 msgr2=0x56139ca50370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x56139ca4deb0 0x56139ca50370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc27c0342b0 msgr2=0x7fc27c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.554+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc27c0342b0 0x7fc27c036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac027720 tx=0x7fc3ac034000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b36f3640 1 -- 172.21.15.123:0/3877808117 reap_dead start 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 msgr2=0x56139ca39220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca39220 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4048980 tx=0x7fc3a40489b0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 shutdown_connections 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3877808117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca323d0 0x56139ca39220 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 >> 172.21.15.123:0/3877808117 conn(0x56139ca2e710 msgr2=0x56139ca2bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 shutdown_connections 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3877808117 wait complete. 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc28c0342b0 msgr2=0x7fc28c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc28c0342b0 0x7fc28c036770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x56139ca158e0 tx=0x7fc3ac0123c0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 msgr2=0x56139ca25850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 0x56139ca25850 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400aae0 tx=0x7fc3a4008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 shutdown_connections 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc28c0342b0 0x7fc28c036770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/32976850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139ca25430 0x56139ca25850 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 >> 172.21.15.123:0/32976850 conn(0x56139ca1a240 msgr2=0x56139ca1ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 shutdown_connections 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/32976850 wait complete. 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca12970 msgr2=0x56139ca14d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca12970 0x56139ca14d60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139c91e720 msgr2=0x56139ca11bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139c91e720 0x56139ca11bc0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc29c0342b0 msgr2=0x7fc29c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc29c0342b0 0x7fc29c036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80ae000 tx=0x7fc3a80a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 msgr2=0x56139ca0af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca0af40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x56139ca04f80 tx=0x7fc3ac000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 shutdown_connections 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56139ca12970 0x56139ca14d60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56139c91e720 0x56139ca11bc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc29c0342b0 0x7fc29c036770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 --2- 172.21.15.123:0/3389874911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56139c88c900 0x56139ca0af40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 >> 172.21.15.123:0/3389874911 conn(0x56139c912720 msgr2=0x56139c9fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 shutdown_connections 2024-03-20T13:37:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.558+0000 7fc3b63d9980 1 -- 172.21.15.123:0/3389874911 wait complete. 2024-03-20T13:37:21.574 INFO:teuthology.orchestra.run.smithi123.stdout:fooFoofooFooFULL_CONTROL 2024-03-20T13:37:21.574 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-03-20T13:37:21.577 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-03-20T13:37:21.585 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:21.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:37:21.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:37:21.586 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:37:21.651 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:21.651 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:21.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f23105f1980 1 Processor -- start 2024-03-20T13:37:21.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f23105f1980 1 -- start start 2024-03-20T13:37:21.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f23105f1980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5609f44c22e0 0x5609f44c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f23105f1980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5609f440a4c0 con 0x5609f44320c0 2024-03-20T13:37:21.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f23105f1980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5609f43d10f0 con 0x5609f44c22e0 2024-03-20T13:37:21.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f230d90b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5609f44c22e0 0x5609f44c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f230e10c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5609f44320c0 0x5609f44c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33276/0 (socket says 172.21.15.123:33276) 2024-03-20T13:37:21.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f230e10c640 1 -- 172.21.15.123:0/2101493248 learned_addr learned my addr 172.21.15.123:0/2101493248 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:21.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f230d90b640 1 -- 172.21.15.123:0/2101493248 >> v1:172.21.15.89:6789/0 conn(0x5609f44320c0 legacy=0x5609f44c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.646+0000 7f230d90b640 1 -- 172.21.15.123:0/2101493248 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f44c5ce0 con 0x5609f44c22e0 2024-03-20T13:37:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f230d90b640 1 --2- 172.21.15.123:0/2101493248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44c22e0 0x5609f44c46d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f230400a420 tx=0x7f230401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa646399c01116b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f230d10a640 1 -- 172.21.15.123:0/2101493248 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23040aa530 con 0x5609f44c22e0 2024-03-20T13:37:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f230d10a640 1 -- 172.21.15.123:0/2101493248 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040a6050 con 0x5609f44c22e0 2024-03-20T13:37:21.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f230d10a640 1 -- 172.21.15.123:0/2101493248 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23040aa800 con 0x5609f44c22e0 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 -- 172.21.15.123:0/2101493248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44c22e0 msgr2=0x5609f44c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 --2- 172.21.15.123:0/2101493248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44c22e0 0x5609f44c46d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f230400a420 tx=0x7f230401afd0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 -- 172.21.15.123:0/2101493248 shutdown_connections 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 --2- 172.21.15.123:0/2101493248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44c22e0 0x5609f44c46d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 -- 172.21.15.123:0/2101493248 >> 172.21.15.123:0/2101493248 conn(0x5609f44b86e0 msgr2=0x5609f44bab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 -- 172.21.15.123:0/2101493248 shutdown_connections 2024-03-20T13:37:21.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.650+0000 7f23105f1980 1 -- 172.21.15.123:0/2101493248 wait complete. 2024-03-20T13:37:21.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f23105f1980 1 Processor -- start 2024-03-20T13:37:21.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f23105f1980 1 -- start start 2024-03-20T13:37:21.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f23105f1980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f23105f1980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f43ce620 con 0x5609f44320c0 2024-03-20T13:37:21.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f230e10c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f230e10c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45a7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36414/0 (socket says 172.21.15.123:36414) 2024-03-20T13:37:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.666+0000 7f230e10c640 1 -- 172.21.15.123:0/2602954051 learned_addr learned my addr 172.21.15.123:0/2602954051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 -- 172.21.15.123:0/2602954051 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230400a100 con 0x5609f44320c0 2024-03-20T13:37:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 --2- 172.21.15.123:0/2602954051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45a7f40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2300001c00 tx=0x7f230000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49bf7a364d1378 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f21fc608640 1 -- 172.21.15.123:0/2602954051 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230000e690 con 0x5609f44320c0 2024-03-20T13:37:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f21fc608640 1 -- 172.21.15.123:0/2602954051 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230000e810 con 0x5609f44320c0 2024-03-20T13:37:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f21fc608640 1 -- 172.21.15.123:0/2602954051 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230000eb30 con 0x5609f44320c0 2024-03-20T13:37:21.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- 172.21.15.123:0/2602954051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 msgr2=0x5609f45a7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 --2- 172.21.15.123:0/2602954051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45a7f40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2300001c00 tx=0x7f230000b6d0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- 172.21.15.123:0/2602954051 shutdown_connections 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 --2- 172.21.15.123:0/2602954051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45a7f40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- 172.21.15.123:0/2602954051 >> 172.21.15.123:0/2602954051 conn(0x5609f44b86e0 msgr2=0x5609f45a3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- 172.21.15.123:0/2602954051 shutdown_connections 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- 172.21.15.123:0/2602954051 wait complete. 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 Processor -- start 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- start start 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f23105f1980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f43c9e00 con 0x5609f44320c0 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36430/0 (socket says 172.21.15.123:36430) 2024-03-20T13:37:21.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 -- 172.21.15.123:0/735085088 learned_addr learned my addr 172.21.15.123:0/735085088 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f440a4c0 con 0x5609f44320c0 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.670+0000 7f230e10c640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45aed90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f230000b710 tx=0x7f2300000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f21fae05640 1 -- 172.21.15.123:0/735085088 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230001f070 con 0x5609f44320c0 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609f45af2d0 con 0x5609f44320c0 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f21fae05640 1 -- 172.21.15.123:0/735085088 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230001a910 con 0x5609f44320c0 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f21fae05640 1 -- 172.21.15.123:0/735085088 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230001abf0 con 0x5609f44320c0 2024-03-20T13:37:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609f45af700 con 0x5609f44320c0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f21fae05640 1 -- 172.21.15.123:0/735085088 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f230000a040 con 0x5609f44320c0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f21fae05640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21f40342b0 0x7f21f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f21fae05640 1 -- 172.21.15.123:0/735085088 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2300049fe0 con 0x5609f44320c0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f230d90b640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21f40342b0 0x7f21f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f44c22e0 0x5609f45b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45b5f50 con 0x5609f44c22e0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f230e90d640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f44c22e0 0x5609f45b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f230d90b640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21f40342b0 0x7f21f4036770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23040ac000 tx=0x7f23040a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f230e90d640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f44c22e0 0x5609f45b5a10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f230e90d640 1 -- 172.21.15.123:0/735085088 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23080083f0 con 0x5609f44c22e0 2024-03-20T13:37:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45b67c0 0x5609f45b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45b92e0 con 0x5609f45b67c0 2024-03-20T13:37:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.674+0000 7f230e10c640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45b67c0 0x5609f45b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e10c640 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45b67c0 0x5609f45b8bb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e10c640 1 -- 172.21.15.123:0/735085088 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45b67c0 2024-03-20T13:37:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45bab40 con 0x5609f45b67c0 2024-03-20T13:37:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e10c640 1 -- 172.21.15.123:0/735085088 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45b67c0 2024-03-20T13:37:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45b9c80 con 0x5609f45b67c0 2024-03-20T13:37:21.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e10c640 1 -- 172.21.15.123:0/735085088 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45b67c0 2024-03-20T13:37:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45ba090 con 0x5609f44c22e0 2024-03-20T13:37:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e90d640 1 -- 172.21.15.123:0/735085088 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f23080083f0 con 0x5609f44c22e0 2024-03-20T13:37:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 Processor -- start 2024-03-20T13:37:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 -- start start 2024-03-20T13:37:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 0x5609f44bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f23105f1980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f4362e30 con 0x5609f44be700 2024-03-20T13:37:21.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e90d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 0x5609f44bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e90d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 0x5609f44bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36438/0 (socket says 172.21.15.123:36438) 2024-03-20T13:37:21.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.678+0000 7f230e90d640 1 -- 172.21.15.123:0/387684886 learned_addr learned my addr 172.21.15.123:0/387684886 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e90d640 1 -- 172.21.15.123:0/387684886 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f44bd0e0 con 0x5609f44be700 2024-03-20T13:37:21.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e90d640 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 0x5609f44bcba0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f230800aae0 tx=0x7f2308008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f21f3fff640 1 -- 172.21.15.123:0/387684886 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230801d070 con 0x5609f44be700 2024-03-20T13:37:21.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609f44bd390 con 0x5609f44be700 2024-03-20T13:37:21.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f21f3fff640 1 -- 172.21.15.123:0/387684886 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308010040 con 0x5609f44be700 2024-03-20T13:37:21.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f21f3fff640 1 -- 172.21.15.123:0/387684886 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2308007e70 con 0x5609f44be700 2024-03-20T13:37:21.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609f44bd820 con 0x5609f44be700 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f21f3fff640 1 -- 172.21.15.123:0/387684886 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2308018430 con 0x5609f44be700 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f21f3fff640 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21e80342b0 0x7f21e8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f21f3fff640 1 -- 172.21.15.123:0/387684886 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f230804a950 con 0x5609f44be700 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e10c640 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21e80342b0 0x7f21e8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f23105f1980 1 Processor -- start 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f23105f1980 1 -- start start 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e10c640 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21e80342b0 0x7f21e8036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5609f45b9780 tx=0x7f230000df50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f23105f1980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45d8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f23105f1980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f4356790 con 0x5609f45d8560 2024-03-20T13:37:21.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e90d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45d8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e90d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45d8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36448/0 (socket says 172.21.15.123:36448) 2024-03-20T13:37:21.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e90d640 1 -- 172.21.15.123:0/3618432827 learned_addr learned my addr 172.21.15.123:0/3618432827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.682+0000 7f230e90d640 1 -- 172.21.15.123:0/3618432827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f45d8f50 con 0x5609f45d8560 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f230e90d640 1 --2- 172.21.15.123:0/3618432827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45d8980 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2308048be0 tx=0x7f2308048de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc7631fd95f7a34 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f21f1ffb640 1 -- 172.21.15.123:0/3618432827 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2308047070 con 0x5609f45d8560 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f21f1ffb640 1 -- 172.21.15.123:0/3618432827 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308021c50 con 0x5609f45d8560 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f21f1ffb640 1 -- 172.21.15.123:0/3618432827 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2308021de0 con 0x5609f45d8560 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3618432827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 msgr2=0x5609f45d8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 --2- 172.21.15.123:0/3618432827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45d8980 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2308048be0 tx=0x7f2308048de0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3618432827 shutdown_connections 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 --2- 172.21.15.123:0/3618432827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45d8980 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3618432827 >> 172.21.15.123:0/3618432827 conn(0x5609f45d48a0 msgr2=0x5609f45d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3618432827 shutdown_connections 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3618432827 wait complete. 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 Processor -- start 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- start start 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f45df900 con 0x5609f45d8560 2024-03-20T13:37:21.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f230e90d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f230e90d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45df3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36454/0 (socket says 172.21.15.123:36454) 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 learned_addr learned my addr 172.21.15.123:0/3763121697 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f44bd820 con 0x5609f45d8560 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f230e90d640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45df3c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2308020890 tx=0x7f2308048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f21dffff640 1 -- 172.21.15.123:0/3763121697 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f230803ae90 con 0x5609f45d8560 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609f45dfb00 con 0x5609f45d8560 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f21dffff640 1 -- 172.21.15.123:0/3763121697 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308020900 con 0x5609f45d8560 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f21dffff640 1 -- 172.21.15.123:0/3763121697 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2308017c10 con 0x5609f45d8560 2024-03-20T13:37:21.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.686+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609f45dff90 con 0x5609f45d8560 2024-03-20T13:37:21.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f21dffff640 1 -- 172.21.15.123:0/3763121697 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f23080423b0 con 0x5609f45d8560 2024-03-20T13:37:21.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f21dffff640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21d80342b0 0x7f21d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f21dffff640 1 -- 172.21.15.123:0/3763121697 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f230800c0b0 con 0x5609f45d8560 2024-03-20T13:37:21.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230e10c640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21d80342b0 0x7f21d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f45eab10 0x5609f45ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45ed720 con 0x5609f45eab10 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230d90b640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f45eab10 0x5609f45ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230e10c640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21d80342b0 0x7f21d8036770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f230001afb0 tx=0x7f2300037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230d90b640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f45eab10 0x5609f45ecfd0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 realm 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45edb10 con 0x5609f45eab10 2024-03-20T13:37:21.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45ee390 con 0x5609f45eab10 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45eed70 0x5609f45f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f1910 con 0x5609f45eed70 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230e90d640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45eed70 0x5609f45f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.690+0000 7f230e90d640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45eed70 0x5609f45f11a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f2110 con 0x5609f45eed70 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 20 searching for the correct realm 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609f45f4190 0x5609f45f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e10c640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609f45f4190 0x5609f45f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e10c640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609f45f4190 0x5609f45f6650 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e90d640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2308035020 0x7f2308047070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x7f2308035020 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230d90b640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2308035020 0x7f2308047070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230d90b640 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2308035020 0x7f2308047070 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.694+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x7f2308035020 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x7f2308035020 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.698+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x7f2308035020 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.702+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eab10 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x7f2308035020 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x7f2308035020 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45f4190 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f6d20 con 0x5609f45eed70 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.706+0000 7f23105f1980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f36f0 con 0x5609f45eab10 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f2b10 con 0x5609f45eed70 2024-03-20T13:37:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f25e0 con 0x5609f45eab10 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 zone default found 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 4 Realm: () 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 zonegroup default 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f7600 con 0x7f2308035020 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f93d0 con 0x5609f45f4190 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f98a0 con 0x5609f45f4190 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 started sync module instance, tier type = 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:21.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.710+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f8c20 con 0x5609f45eed70 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600754595712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45f8fd0 con 0x5609f45eed70 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fa600 con 0x5609f45eab10 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600754602336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fae00 con 0x5609f45eab10 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fb600 con 0x5609f45eed70 2024-03-20T13:37:21.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94600754595712] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.714+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94600754602336] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600754604384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fb220 con 0x5609f45eed70 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fba20 con 0x7f2308035020 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600754606896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fbe10 con 0x7f2308035020 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fc8d0 con 0x5609f45eed70 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94600754604384] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.718+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94600754606896] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600754611088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fc890 con 0x5609f45eed70 2024-03-20T13:37:21.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fb980 con 0x5609f45f4190 2024-03-20T13:37:21.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600754613376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fd540 con 0x5609f45f4190 2024-03-20T13:37:21.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fdef0 con 0x5609f45f4190 2024-03-20T13:37:21.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94600754611088] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94600754613376] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600754614432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fda10 con 0x5609f45f4190 2024-03-20T13:37:21.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.722+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fe740 con 0x7f2308035020 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600754619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45feba0 con 0x7f2308035020 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=0 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=1 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=2 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=3 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=4 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=5 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94600754614432] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=6 2024-03-20T13:37:21.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94600754619040] v34'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 20 add_watcher() i=7 2024-03-20T13:37:21.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:21.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fad80 con 0x5609f45eab10 2024-03-20T13:37:21.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.726+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600754620096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f45fad80 con 0x5609f45eab10 2024-03-20T13:37:21.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94600754620096] v34'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f21c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 5 note: GC not initialized 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f213f7fe640 20 reqs_thread_entry: start 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 Filter name: none 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f213d7fa640 20 reqs_thread_entry: start 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4624050 con 0x7f2308035020 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 : miss 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 8.15 8:a9ce0b4f:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4625920 con 0x5609f45f4190 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 info.flags=0x17 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 to cache LRU end 2024-03-20T13:37:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:21.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:21.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 2024-03-20T13:37:21.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 get_obj_state: octx=0x7f23040aa640 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5609f46279f8 s->prefetch_data=0 2024-03-20T13:37:21.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 3.2as0 3:55dd5bc1:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45eed70 2024-03-20T13:37:21.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 10 manifest: total_size = 5 2024-03-20T13:37:21.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.730+0000 7f23105f1980 20 get_obj_state: setting s->obj_tag to _3knysLRnuTKmmQEHSZ_lhBhcrpbnA9b 2024-03-20T13:37:21.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.734+0000 7f21c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.734+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600754620096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45eab10 2024-03-20T13:37:21.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.734+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94600754620096] v34'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.734+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600754595712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45eed70 2024-03-20T13:37:21.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94600754595712] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f23105f1980 20 remove_watcher() i=0 2024-03-20T13:37:21.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f23105f1980 2 removed watcher, disabling cache 2024-03-20T13:37:21.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600754602336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45eab10 2024-03-20T13:37:21.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94600754602336] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x5609f45eab10 2024-03-20T13:37:21.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f23105f1980 20 remove_watcher() i=1 2024-03-20T13:37:21.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.738+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600754604384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45eed70 2024-03-20T13:37:21.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.742+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94600754604384] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.742+0000 7f23105f1980 20 remove_watcher() i=2 2024-03-20T13:37:21.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.742+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600754606896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x7f2308035020 2024-03-20T13:37:21.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.742+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94600754606896] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.742+0000 7f23105f1980 20 remove_watcher() i=3 2024-03-20T13:37:21.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.742+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600754611088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45eed70 2024-03-20T13:37:21.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f230e90d640 1 -- 172.21.15.123:0/3763121697 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94600754611088] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2308040070 con 0x5609f45eed70 2024-03-20T13:37:21.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 20 remove_watcher() i=4 2024-03-20T13:37:21.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600754613376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45f4190 2024-03-20T13:37:21.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94600754613376] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 20 remove_watcher() i=5 2024-03-20T13:37:21.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600754614432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x5609f45f4190 2024-03-20T13:37:21.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f230e10c640 1 -- 172.21.15.123:0/3763121697 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94600754614432] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23000173e0 con 0x5609f45f4190 2024-03-20T13:37:21.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 20 remove_watcher() i=6 2024-03-20T13:37:21.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600754619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5609f4628af0 con 0x7f2308035020 2024-03-20T13:37:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94600754619040] v34'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23040b1040 con 0x7f2308035020 2024-03-20T13:37:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.746+0000 7f23105f1980 20 remove_watcher() i=7 2024-03-20T13:37:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45eed70 msgr2=0x5609f45f11a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45eed70 0x5609f45f11a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f45eab10 msgr2=0x5609f45ecfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f45eab10 0x5609f45ecfd0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2308035020 msgr2=0x7f2308047070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f2308035020 0x7f2308047070 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609f45f4190 msgr2=0x5609f45f6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5609f45f4190 0x5609f45f6650 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21d80342b0 msgr2=0x7f21d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21d80342b0 0x7f21d8036770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f230001afb0 tx=0x7f2300037000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 msgr2=0x5609f45df3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f230d90b640 1 -- 172.21.15.123:0/3763121697 reap_dead start 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45df3c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2308020890 tx=0x7f2308048b70 comp rx=0 tx=0).stop 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 shutdown_connections 2024-03-20T13:37:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/3763121697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f45d8560 0x5609f45df3c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 >> 172.21.15.123:0/3763121697 conn(0x5609f45d48a0 msgr2=0x5609f45d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 shutdown_connections 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/3763121697 wait complete. 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21e80342b0 msgr2=0x7f21e8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21e80342b0 0x7f21e8036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5609f45b9780 tx=0x7f230000df50 comp rx=0 tx=0).stop 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 msgr2=0x5609f44bcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 0x5609f44bcba0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f230800aae0 tx=0x7f2308008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 shutdown_connections 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21e80342b0 0x7f21e8036770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/387684886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44be700 0x5609f44bcba0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 >> 172.21.15.123:0/387684886 conn(0x5609f45be060 msgr2=0x5609f45beb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 shutdown_connections 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/387684886 wait complete. 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45b67c0 msgr2=0x5609f45b8bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45b67c0 0x5609f45b8bb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f44c22e0 msgr2=0x5609f45b5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f44c22e0 0x5609f45b5a10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21f40342b0 msgr2=0x7f21f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21f40342b0 0x7f21f4036770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23040ac000 tx=0x7f23040a5000 comp rx=0 tx=0).stop 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 msgr2=0x5609f45aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45aed90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f230000b710 tx=0x7f2300000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 shutdown_connections 2024-03-20T13:37:21.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5609f45b67c0 0x5609f45b8bb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5609f44c22e0 0x5609f45b5a10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f21f40342b0 0x7f21f4036770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 --2- 172.21.15.123:0/735085088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5609f44320c0 0x5609f45aed90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 >> 172.21.15.123:0/735085088 conn(0x5609f44b86e0 msgr2=0x5609f45a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 shutdown_connections 2024-03-20T13:37:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.750+0000 7f23105f1980 1 -- 172.21.15.123:0/735085088 wait complete. 2024-03-20T13:37:21.766 INFO:teuthology.orchestra.run.smithi123.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-03-20T13:37:21.767 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-03-20T13:37:21.769 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-03-20T13:37:21.787 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:21.863 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-03-20T13:37:21.863 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-03-20T13:37:21.863 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:37:21.863 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-03-20T13:37:21.863 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-03-20T13:37:21.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-03-20T13:37:21.864 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-03-20T13:37:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:21.901 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:21.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87fbb2a980 1 Processor -- start 2024-03-20T13:37:21.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87fbb2a980 1 -- start start 2024-03-20T13:37:21.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87fbb2a980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5598314b2640 0x5598314b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87fbb2a980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5598313f84c0 con 0x5598314ae140 2024-03-20T13:37:21.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87fbb2a980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5598313bf0f0 con 0x5598314b2640 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f8e44640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5598314b2640 0x5598314b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f9645640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5598314ae140 0x5598314ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33288/0 (socket says 172.21.15.123:33288) 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f8e44640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5598314b2640 0x5598314b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36462/0 (socket says 172.21.15.123:36462) 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f9645640 1 -- 172.21.15.123:0/187210054 learned_addr learned my addr 172.21.15.123:0/187210054 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f8e44640 1 -- 172.21.15.123:0/187210054 >> v1:172.21.15.89:6789/0 conn(0x5598314ae140 legacy=0x5598314ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f8e44640 1 -- 172.21.15.123:0/187210054 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598314b5f80 con 0x5598314b2640 2024-03-20T13:37:21.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87ebfff640 1 -- 172.21.15.123:0/187210054 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014242330 0 0) 0x5598313f84c0 con 0x5598314ae140 2024-03-20T13:37:21.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.898+0000 7f87f8e44640 1 --2- 172.21.15.123:0/187210054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x5598314b4a30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f87f000a480 tx=0x7f87f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97f39fbb975824f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87ebfff640 1 -- 172.21.15.123:0/187210054 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f00ab540 con 0x5598314b2640 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87ebfff640 1 -- 172.21.15.123:0/187210054 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f00ab6a0 con 0x5598314b2640 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87ebfff640 1 -- 172.21.15.123:0/187210054 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f00ab960 con 0x5598314b2640 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 -- 172.21.15.123:0/187210054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 msgr2=0x5598314b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/187210054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x5598314b4a30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f87f000a480 tx=0x7f87f001b280 comp rx=0 tx=0).stop 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 -- 172.21.15.123:0/187210054 shutdown_connections 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/187210054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x5598314b4a30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 -- 172.21.15.123:0/187210054 >> 172.21.15.123:0/187210054 conn(0x559831421860 msgr2=0x559831421c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 -- 172.21.15.123:0/187210054 shutdown_connections 2024-03-20T13:37:21.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.902+0000 7f87fbb2a980 1 -- 172.21.15.123:0/187210054 wait complete. 2024-03-20T13:37:21.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 Processor -- start 2024-03-20T13:37:21.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- start start 2024-03-20T13:37:21.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 0x559831597ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598313bc620 con 0x5598314ae140 2024-03-20T13:37:21.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87f9645640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 0x559831597ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87f9645640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 0x559831597ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36466/0 (socket says 172.21.15.123:36466) 2024-03-20T13:37:21.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87f9645640 1 -- 172.21.15.123:0/4204108664 learned_addr learned my addr 172.21.15.123:0/4204108664 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87f9645640 1 -- 172.21.15.123:0/4204108664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0005d30 con 0x5598314ae140 2024-03-20T13:37:21.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87f9645640 1 --2- 172.21.15.123:0/4204108664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 0x559831597ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f87f40016c0 tx=0x7f87f4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaecdb099c90f05b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f86e7606640 1 -- 172.21.15.123:0/4204108664 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f4003460 con 0x5598314ae140 2024-03-20T13:37:21.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f86e7606640 1 -- 172.21.15.123:0/4204108664 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f40035c0 con 0x5598314ae140 2024-03-20T13:37:21.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f86e7606640 1 -- 172.21.15.123:0/4204108664 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f40038a0 con 0x5598314ae140 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- 172.21.15.123:0/4204108664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 msgr2=0x559831597ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/4204108664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 0x559831597ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f87f40016c0 tx=0x7f87f4001b80 comp rx=0 tx=0).stop 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- 172.21.15.123:0/4204108664 shutdown_connections 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/4204108664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314ae140 0x559831597ea0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- 172.21.15.123:0/4204108664 >> 172.21.15.123:0/4204108664 conn(0x559831421860 msgr2=0x559831593a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- 172.21.15.123:0/4204108664 shutdown_connections 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.918+0000 7f87fbb2a980 1 -- 172.21.15.123:0/4204108664 wait complete. 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87fbb2a980 1 Processor -- start 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87fbb2a980 1 -- start start 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87fbb2a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x55983159efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87fbb2a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598313b7e00 con 0x5598314b2640 2024-03-20T13:37:21.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87f9645640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x55983159efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87f9645640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x55983159efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36482/0 (socket says 172.21.15.123:36482) 2024-03-20T13:37:21.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87f9645640 1 -- 172.21.15.123:0/1105880066 learned_addr learned my addr 172.21.15.123:0/1105880066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87f9645640 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4006cf0 con 0x5598314b2640 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87f9645640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x55983159efe0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f87f40012f0 tx=0x7f87f4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f86e5e03640 1 -- 172.21.15.123:0/1105880066 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f4013760 con 0x5598314b2640 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f86e5e03640 1 -- 172.21.15.123:0/1105880066 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f40138c0 con 0x5598314b2640 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f86e5e03640 1 -- 172.21.15.123:0/1105880066 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87f4013b60 con 0x5598314b2640 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55983159f520 con 0x5598314b2640 2024-03-20T13:37:21.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.922+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55983159f950 con 0x5598314b2640 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f86e5e03640 1 -- 172.21.15.123:0/1105880066 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f87f4013cc0 con 0x5598314b2640 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f86e5e03640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86e0034350 0x7f86e0036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f86e5e03640 1 -- 172.21.15.123:0/1105880066 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f87f4049550 con 0x5598314b2640 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f8e44640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86e0034350 0x7f86e0036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315a3c00 0x5598315a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315a6530 con 0x5598315a3c00 2024-03-20T13:37:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f9e46640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315a3c00 0x5598315a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f9e46640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315a3c00 0x5598315a5ff0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f8e44640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86e0034350 0x7f86e0036810 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87f00ad000 tx=0x7f87f00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f9e46640 1 -- 172.21.15.123:0/1105880066 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87ec0083f0 con 0x5598315a3c00 2024-03-20T13:37:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315a6da0 0x5598315a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315a9810 con 0x5598315a6da0 2024-03-20T13:37:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f9645640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315a6da0 0x5598315a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.926+0000 7f87f9645640 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315a6da0 0x5598315a9190 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9645640 1 -- 172.21.15.123:0/1105880066 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87f4024020 con 0x5598315a6da0 2024-03-20T13:37:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315ab070 con 0x5598315a6da0 2024-03-20T13:37:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9645640 1 -- 172.21.15.123:0/1105880066 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f87f4024020 con 0x5598315a6da0 2024-03-20T13:37:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315aa270 con 0x5598315a6da0 2024-03-20T13:37:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9645640 1 -- 172.21.15.123:0/1105880066 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87f4024020 con 0x5598315a6da0 2024-03-20T13:37:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315aa680 con 0x5598315a3c00 2024-03-20T13:37:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9e46640 1 -- 172.21.15.123:0/1105880066 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f87ec0083f0 con 0x5598315a3c00 2024-03-20T13:37:21.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 Processor -- start 2024-03-20T13:37:21.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 -- start start 2024-03-20T13:37:21.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 0x5598315b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87fbb2a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559831350e30 con 0x5598315b9710 2024-03-20T13:37:21.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 0x5598315b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 0x5598315b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36486/0 (socket says 172.21.15.123:36486) 2024-03-20T13:37:21.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9e46640 1 -- 172.21.15.123:0/105221352 learned_addr learned my addr 172.21.15.123:0/105221352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.930+0000 7f87f9e46640 1 -- 172.21.15.123:0/105221352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598315ba070 con 0x5598315b9710 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9e46640 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 0x5598315b9b30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00aae0 tx=0x7f87ec008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86deffd640 1 -- 172.21.15.123:0/105221352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87ec01d070 con 0x5598315b9710 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86deffd640 1 -- 172.21.15.123:0/105221352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec010040 con 0x5598315b9710 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598315ba2c0 con 0x5598315b9710 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86deffd640 1 -- 172.21.15.123:0/105221352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87ec007e70 con 0x5598315b9710 2024-03-20T13:37:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598315bae10 con 0x5598315b9710 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86deffd640 1 -- 172.21.15.123:0/105221352 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f87ec018430 con 0x5598315b9710 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86deffd640 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86d40342b0 0x7f86d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86deffd640 1 -- 172.21.15.123:0/105221352 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f87ec04a6a0 con 0x5598315b9710 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9645640 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86d40342b0 0x7f86d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87fbb2a980 1 Processor -- start 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87fbb2a980 1 -- start start 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9645640 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86d40342b0 0x7f86d4036770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5598315a9d70 tx=0x7f87f4035040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87fbb2a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87fbb2a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559831344790 con 0x5598315c6640 2024-03-20T13:37:21.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36490/0 (socket says 172.21.15.123:36490) 2024-03-20T13:37:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9e46640 1 -- 172.21.15.123:0/1501107843 learned_addr learned my addr 172.21.15.123:0/1501107843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9e46640 1 -- 172.21.15.123:0/1501107843 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598315c7030 con 0x5598315c6640 2024-03-20T13:37:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f87f9e46640 1 --2- 172.21.15.123:0/1501107843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315c6a60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0489f0 tx=0x7f87ec048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d05ff98f58999d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.934+0000 7f86dcff9640 1 -- 172.21.15.123:0/1501107843 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87ec047070 con 0x5598315c6640 2024-03-20T13:37:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f86dcff9640 1 -- 172.21.15.123:0/1501107843 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec022410 con 0x5598315c6640 2024-03-20T13:37:21.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f86dcff9640 1 -- 172.21.15.123:0/1501107843 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87ec016330 con 0x5598315c6640 2024-03-20T13:37:21.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1501107843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 msgr2=0x5598315c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1501107843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315c6a60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0489f0 tx=0x7f87ec048f00 comp rx=0 tx=0).stop 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1501107843 shutdown_connections 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1501107843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315c6a60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1501107843 >> 172.21.15.123:0/1501107843 conn(0x5598315c29d0 msgr2=0x5598315c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1501107843 shutdown_connections 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1501107843 wait complete. 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 Processor -- start 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- start start 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598315cdaa0 con 0x5598315c6640 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87f9e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87f9e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36504/0 (socket says 172.21.15.123:36504) 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 learned_addr learned my addr 172.21.15.123:0/3872886114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:21.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598315bae10 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87f9e46640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315cd560 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f87ec048950 tx=0x7f87ec048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f86caffd640 1 -- 172.21.15.123:0/3872886114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87ec04a510 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f86caffd640 1 -- 172.21.15.123:0/3872886114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec022580 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598315cdca0 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f86caffd640 1 -- 172.21.15.123:0/3872886114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87ec018880 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.938+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598315ce130 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f86caffd640 1 -- 172.21.15.123:0/3872886114 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f87ec0189e0 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f86caffd640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86c40342b0 0x7f86c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f86caffd640 1 -- 172.21.15.123:0/3872886114 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f87ec036d70 con 0x5598315c6640 2024-03-20T13:37:21.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f9645640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86c40342b0 0x7f86c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315d8c40 0x5598315db100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315db850 con 0x5598315d8c40 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f8e44640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315d8c40 0x5598315db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f9645640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86c40342b0 0x7f86c4036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f87f4049500 tx=0x7f87f403c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f8e44640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315d8c40 0x5598315db100 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f00abb40 con 0x5598315d8c40 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 realm 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315dbc40 con 0x5598315d8c40 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f00abb40 con 0x5598315d8c40 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315dc4c0 con 0x5598315d8c40 2024-03-20T13:37:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f00abb40 con 0x5598315d8c40 2024-03-20T13:37:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315dcea0 0x5598315df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315dfa40 con 0x5598315dcea0 2024-03-20T13:37:21.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f9e46640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315dcea0 0x5598315df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.942+0000 7f87f9e46640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315dcea0 0x5598315df2d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e0240 con 0x5598315dcea0 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 20 searching for the correct realm 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5598315e22a0 0x5598315e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9645640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5598315e22a0 0x5598315e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9645640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5598315e22a0 0x5598315e4760 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9e46640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f87ec035070 0x7f87ec03a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x7f87ec035070 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f87ec035070 0x7f87ec03a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f87ec035070 0x7f87ec03a1f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00abb40 con 0x7f87ec035070 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.946+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x7f87ec035070 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x7f87ec035070 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x7f87ec035070 2024-03-20T13:37:21.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f87f00c8040 con 0x7f87ec035070 2024-03-20T13:37:21.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.950+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00c8040 con 0x5598315d8c40 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x7f87ec035070 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315d8c40 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x7f87ec035070 2024-03-20T13:37:21.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.954+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x7f87ec035070 2024-03-20T13:37:21.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315e22a0 2024-03-20T13:37:21.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e4e30 con 0x5598315dcea0 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.958+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e1800 con 0x5598315d8c40 2024-03-20T13:37:21.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e0780 con 0x5598315dcea0 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e0750 con 0x5598315d8c40 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 zone default found 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 4 Realm: () 2024-03-20T13:37:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 zonegroup default 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e12a0 con 0x7f87ec035070 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e7210 con 0x5598315e22a0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e7640 con 0x5598315e22a0 2024-03-20T13:37:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:21.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 started sync module instance, tier type = 2024-03-20T13:37:21.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:21.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.962+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e6530 con 0x5598315dcea0 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94112151658640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e64b0 con 0x5598315dcea0 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e83a0 con 0x5598315d8c40 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94112151666432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e87c0 con 0x5598315d8c40 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e9020 con 0x5598315dcea0 2024-03-20T13:37:21.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94112151658640] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.966+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94112151666432] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94112151665248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e87c0 con 0x5598315dcea0 2024-03-20T13:37:21.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e9870 con 0x7f87ec035070 2024-03-20T13:37:21.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94112151671760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e87c0 con 0x7f87ec035070 2024-03-20T13:37:21.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315ea360 con 0x5598315dcea0 2024-03-20T13:37:21.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94112151671760] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.970+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94112151665248] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94112151674464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e8320 con 0x5598315dcea0 2024-03-20T13:37:21.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315eabb0 con 0x5598315e22a0 2024-03-20T13:37:21.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94112151676688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e8320 con 0x5598315e22a0 2024-03-20T13:37:21.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315eb9c0 con 0x5598315e22a0 2024-03-20T13:37:21.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94112151674464] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94112151676688] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94112151678736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315eb520 con 0x5598315e22a0 2024-03-20T13:37:21.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.974+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315ebd80 con 0x7f87ec035070 2024-03-20T13:37:21.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94112151678736] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94112151672816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315eb9c0 con 0x7f87ec035070 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=0 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=1 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=2 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=3 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=4 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=5 2024-03-20T13:37:21.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=6 2024-03-20T13:37:21.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94112151672816] v34'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 20 add_watcher() i=7 2024-03-20T13:37:21.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:21.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315ef320 con 0x5598315d8c40 2024-03-20T13:37:21.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.978+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94112151680912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315ec6c0 con 0x5598315d8c40 2024-03-20T13:37:21.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.982+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94112151680912] v34'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.982+0000 7f86af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:21.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.982+0000 7f87fbb2a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:21.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.982+0000 7f87fbb2a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:21.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.982+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f7890 con 0x5598315dcea0 2024-03-20T13:37:21.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.986+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.986+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f7d50 con 0x7f87ec035070 2024-03-20T13:37:21.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.986+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:21.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.986+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f7d50 con 0x5598315e22a0 2024-03-20T13:37:21.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.986+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.986+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f8280 con 0x5598315d8c40 2024-03-20T13:37:21.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.990+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:21.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.990+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f87b0 con 0x5598315dcea0 2024-03-20T13:37:21.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.990+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'63 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:21.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.994+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f8ce0 con 0x5598315e22a0 2024-03-20T13:37:21.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.994+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:21.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.994+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f9210 con 0x5598315dcea0 2024-03-20T13:37:22.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.994+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.994+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f9740 con 0x5598315d8c40 2024-03-20T13:37:22.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.998+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.998+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f9c70 con 0x5598315dcea0 2024-03-20T13:37:22.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.998+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:21.998+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f9c70 con 0x5598315dcea0 2024-03-20T13:37:22.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.002+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.002+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f9c70 con 0x5598315dcea0 2024-03-20T13:37:22.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.002+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'64 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.002+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f9c70 con 0x5598315e22a0 2024-03-20T13:37:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.006+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.006+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa110 con 0x5598315dcea0 2024-03-20T13:37:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.006+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.006+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa110 con 0x5598315d8c40 2024-03-20T13:37:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.010+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.010+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa1a0 con 0x5598315d8c40 2024-03-20T13:37:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.010+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.010+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa230 con 0x5598315dcea0 2024-03-20T13:37:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.014+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.014+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa6d0 con 0x5598315dcea0 2024-03-20T13:37:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.014+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'65 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.014+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f7390 con 0x5598315e22a0 2024-03-20T13:37:22.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.018+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.018+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa6d0 con 0x5598315dcea0 2024-03-20T13:37:22.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.018+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.018+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa540 con 0x5598315d8c40 2024-03-20T13:37:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.022+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.022+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa540 con 0x5598315dcea0 2024-03-20T13:37:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.026+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.026+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa4b0 con 0x5598315dcea0 2024-03-20T13:37:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.026+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.026+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fa4b0 con 0x5598315e22a0 2024-03-20T13:37:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.030+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.030+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f59e0 con 0x5598315dcea0 2024-03-20T13:37:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.030+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.030+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f71b0 con 0x5598315e22a0 2024-03-20T13:37:22.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.034+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.034+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f71b0 con 0x5598315e22a0 2024-03-20T13:37:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.034+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.034+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f5540 con 0x5598315e22a0 2024-03-20T13:37:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.038+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.038+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f5540 con 0x5598315dcea0 2024-03-20T13:37:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.042+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.042+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f71b0 con 0x5598315d8c40 2024-03-20T13:37:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.042+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.042+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fac80 con 0x5598315dcea0 2024-03-20T13:37:22.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.046+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.046+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fac80 con 0x5598315d8c40 2024-03-20T13:37:22.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.046+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.046+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315fac80 con 0x7f87ec035070 2024-03-20T13:37:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.046+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f86ae7e4640 20 reqs_thread_entry: start 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 20 Filter name: none 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f861ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315f5360 con 0x7f87ec035070 2024-03-20T13:37:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 : miss 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:95 8.15 8:a9ce0b4f:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831615d60 con 0x5598315e22a0 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(95 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 info.flags=0x17 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 to cache LRU end 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:96 4.0 4:027b1434:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932b0 con 0x5598315e22a0 2024-03-20T13:37:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(96 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 4.2 4:405e2bf6:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932f0 con 0x5598315d8c40 2024-03-20T13:37:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(97 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 4.12 4:4ad65f82:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932f0 con 0x5598315d8c40 2024-03-20T13:37:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(98 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-03-20T13:37:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 4.28 4:1757a9cf:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932f0 con 0x5598315dcea0 2024-03-20T13:37:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(99 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.050+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 4.31 4:8e019fe3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932f0 con 0x5598315dcea0 2024-03-20T13:37:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(100 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 4.15 4:a9fd367b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932b0 con 0x5598315e22a0 2024-03-20T13:37:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(101 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 4.1 4:823a9504:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316932b0 con 0x7f87ec035070 2024-03-20T13:37:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(102 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87fbb2a980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-03-20T13:37:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:103 4.1f 4:fb970cfb:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831693880 con 0x5598315dcea0 2024-03-20T13:37:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(103 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 4.37 4:eec48ff7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831693880 con 0x7f87ec035070 2024-03-20T13:37:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.054+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(104 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 [call out=426b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-03-20T13:37:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 4.36 4:6df48240:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831693880 con 0x5598315d8c40 2024-03-20T13:37:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(105 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831693880 con 0x5598315dcea0 2024-03-20T13:37:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(106 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [call out=698b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-03-20T13:37:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:37:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:107 3.bs0 3:d0beab72:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616880 con 0x5598315e22a0 2024-03-20T13:37:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(107 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 10 manifest: total_size = 6 2024-03-20T13:37:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.13586185733166769894 2024-03-20T13:37:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 20 prepare_atomic_modification: state is not atomic. state=0x559831692738 2024-03-20T13:37:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 2024-03-20T13:37:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.058+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:108 4.12 4:4ad65f82:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161b150 con 0x5598315d8c40 2024-03-20T13:37:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.062+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(108 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 [stat,call,call] v34'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.062+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:109 3.bs0 3:d0beab72:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831619130 con 0x5598315e22a0 2024-03-20T13:37:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.062+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(109 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.062+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:110 4.12 4:4ad65f82:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161b190 con 0x5598315d8c40 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.062+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.062+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:111 3.37s0 3:ee219c91:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161b190 con 0x5598315d8c40 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(111 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 10 manifest: total_size = 3 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.8277978266710381524 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 20 prepare_atomic_modification: state is not atomic. state=0x559831692738 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 2024-03-20T13:37:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:112 4.1 4:823a9504:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161ff70 con 0x7f87ec035070 2024-03-20T13:37:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(110 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 [stat,call,call] v34'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f86dcff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-03-20T13:37:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(112 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 [stat,call,call] v34'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.066+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:113 3.37s0 3:ee219c91:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831619130 con 0x5598315d8c40 2024-03-20T13:37:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(113 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:114 4.1 4:823a9504:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161bf30 con 0x7f87ec035070 2024-03-20T13:37:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:115 3.as0 3:53a2c21f:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161ca80 con 0x5598315dcea0 2024-03-20T13:37:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(115 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 10 manifest: total_size = 4 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.17767933772740520602 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 20 prepare_atomic_modification: state is not atomic. state=0x559831692738 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:116 4.37 4:eec48ff7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161c090 con 0x7f87ec035070 2024-03-20T13:37:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(114 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 [stat,call,call] v34'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.070+0000 7f86cbfff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-03-20T13:37:22.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.074+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(116 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 [stat,call,call] v34'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.074+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:117 3.as0 3:53a2c21f:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161c090 con 0x5598315dcea0 2024-03-20T13:37:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(117 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:118 4.37 4:eec48ff7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161c090 con 0x7f87ec035070 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:119 3.34s0 3:2d38e1f2:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161c090 con 0x5598315dcea0 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(119 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 10 manifest: total_size = 5 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10924747133757142316 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 20 prepare_atomic_modification: state is not atomic. state=0x559831692738 2024-03-20T13:37:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 2024-03-20T13:37:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:120 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161c390 con 0x5598315dcea0 2024-03-20T13:37:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(118 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 [stat,call,call] v34'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.078+0000 7f86dcff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-03-20T13:37:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== osd_op_reply(120 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [stat,call,call] v34'14 uv14 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:121 3.34s0 3:2d38e1f2:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161c390 con 0x5598315dcea0 2024-03-20T13:37:22.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== osd_op_reply(121 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:122 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161fd50 con 0x5598315dcea0 2024-03-20T13:37:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:123 3.2as0 3:55dd5bc1:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316170b0 con 0x5598315dcea0 2024-03-20T13:37:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(123 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 10 manifest: total_size = 5 2024-03-20T13:37:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 20 get_obj_state: setting s->obj_tag to _3knysLRnuTKmmQEHSZ_lhBhcrpbnA9b 2024-03-20T13:37:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 20 get_obj_state: octx=0x7f87f00c3040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x559831692738 s->prefetch_data=0 2024-03-20T13:37:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 20 prepare_atomic_modification: state is not atomic. state=0x559831692738 2024-03-20T13:37:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 2024-03-20T13:37:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.082+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:124 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831621b80 con 0x5598315dcea0 2024-03-20T13:37:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.086+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(122 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [stat,call,call] v34'15 uv15 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.086+0000 7f86cbfff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-03-20T13:37:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.086+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== osd_op_reply(124 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [stat,call,call] v34'16 uv16 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.086+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:125 3.2as0 3:55dd5bc1:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831621b80 con 0x5598315dcea0 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== osd_op_reply(125 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:126 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616c10 con 0x5598315dcea0 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 20 list_objects_ordered: starting attempt 1 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:127 4.0 4:027b1434:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616c10 con 0x5598315e22a0 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:128 4.2 4:405e2bf6:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161a6f0 con 0x5598315d8c40 2024-03-20T13:37:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:129 4.12 4:4ad65f82:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316929f0 con 0x5598315d8c40 2024-03-20T13:37:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:130 4.28 4:1757a9cf:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616c10 con 0x5598315dcea0 2024-03-20T13:37:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:131 4.31 4:8e019fe3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e00 con 0x5598315dcea0 2024-03-20T13:37:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:132 4.15 4:a9fd367b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983162cb60 con 0x5598315e22a0 2024-03-20T13:37:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:133 4.1 4:823a9504:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983161a6f0 con 0x7f87ec035070 2024-03-20T13:37:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:134 4.1f 4:fb970cfb:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e00 con 0x5598315dcea0 2024-03-20T13:37:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:135 4.37 4:eec48ff7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e00 con 0x7f87ec035070 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:136 4.36 4:6df48240:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831636610 con 0x5598315d8c40 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(132 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:137 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831639210 con 0x5598315dcea0 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(128 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(127 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(133 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(130 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== osd_op_reply(131 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(129 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 22 ==== osd_op_reply(135 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 49 ==== osd_op_reply(134 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(136 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 50 ==== osd_op_reply(126 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [stat,call,call] v34'17 uv17 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.090+0000 7f86cbfff640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 51 ==== osd_op_reply(137 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [call out=124b] v0'0 uv17 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5])"; uploads.size()=0; is_truncated=0 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:138 4.0 4:027b1434:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:139 4.2 4:405e2bf6:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831636030 con 0x5598315d8c40 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:140 4.12 4:4ad65f82:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831692550 con 0x5598315d8c40 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:141 4.28 4:1757a9cf:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315dcea0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:142 4.31 4:8e019fe3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831636010 con 0x5598315dcea0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:143 4.15 4:a9fd367b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:144 4.1 4:823a9504:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831692550 con 0x7f87ec035070 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:145 4.1f 4:fb970cfb:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315dcea0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:146 4.37 4:eec48ff7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831692550 con 0x7f87ec035070 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:147 4.36 4:6df48240:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831636010 con 0x5598315d8c40 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:148 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316334b0 con 0x5598315dcea0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(138 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(143 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== osd_op_reply(139 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 52 ==== osd_op_reply(141 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(147 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 23 ==== osd_op_reply(144 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 24 ==== osd_op_reply(146 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 53 ==== osd_op_reply(142 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== osd_op_reply(140 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 54 ==== osd_op_reply(145 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 55 ==== osd_op_reply(148 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [call out=124b] v0'0 uv17 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x7f87ec035070 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 25 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 10 removing default.rgw.meta+root+myfoo from cache 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94112151985808 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== watch-notify(notify (1) cookie 94112151678736 notify 146028888076 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55983159f950 con 0x5598315e22a0 2024-03-20T13:37:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f86cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94112151678736 notifier 4647 bl.length()=149 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(150 notify.6 [notify cookie 94112151985808 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f86cbfff640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f862c0032c0 con 0x5598315e22a0 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== watch-notify(notify_complete (2) cookie 94112151985808 notify 146028888076 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f87f402d070 con 0x5598315e22a0 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.094+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x7f87ec035070 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 26 ==== osd_op_reply(152 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 from cache 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5, ofs0, ns] 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:153 7.0 7:05bf5b68:::notify.1:head [notify cookie 94112151985776 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315d8c40 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== watch-notify(notify (1) cookie 94112151666432 notify 146028888075 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f87f00d0040 con 0x5598315d8c40 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f86dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94112151666432 notifier 4647 bl.length()=206 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(153 notify.1 [notify cookie 94112151985776 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f86dcff9640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:154 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f86bc003d60 con 0x5598315d8c40 2024-03-20T13:37:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(154 notify.1 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== watch-notify(notify_complete (2) cookie 94112151985776 notify 146028888075 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5598314b5f80 con 0x5598315d8c40 2024-03-20T13:37:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:155 8.15 8:a9ce0b4f:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(155 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 [call,call,delete] v34'4 uv4 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:156 4.0 4:027b1434:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:157 4.2 4:405e2bf6:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616c10 con 0x5598315d8c40 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:158 4.12 4:4ad65f82:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315d8c40 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:159 4.28 4:1757a9cf:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983162c390 con 0x5598315dcea0 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:160 4.31 4:8e019fe3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616c10 con 0x5598315dcea0 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:161 4.15 4:a9fd367b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:162 4.1 4:823a9504:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983162c390 con 0x7f87ec035070 2024-03-20T13:37:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.098+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:163 4.1f 4:fb970cfb:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55983162c730 con 0x5598315dcea0 2024-03-20T13:37:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:164 4.37 4:eec48ff7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x7f87ec035070 2024-03-20T13:37:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:165 4.36 4:6df48240:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831616c10 con 0x5598315d8c40 2024-03-20T13:37:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:166 4.18 4:18e26223:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598316155e0 con 0x5598315dcea0 2024-03-20T13:37:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(165 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.9 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(156 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.0 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(161 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.5 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 27 ==== osd_op_reply(164 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.8 [delete] v34'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 56 ==== osd_op_reply(163 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.7 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 57 ==== osd_op_reply(160 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.4 [delete] v34'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 58 ==== osd_op_reply(159 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.3 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 28 ==== osd_op_reply(162 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.6 [delete] v34'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(157 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.1 [delete] v34'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.102+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 59 ==== osd_op_reply(166 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.10 [delete] v34'18 uv18 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(158 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5.2 [delete] v34'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 : miss 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:167 6.1f 6:fb910292:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== osd_op_reply(167 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 info.flags=0x0 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 10 adding default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 to cache LRU end 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 10 removing default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 from cache 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5, ofs0, ns] 2024-03-20T13:37:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94112152358864 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831615cd0 con 0x5598315dcea0 2024-03-20T13:37:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 60 ==== watch-notify(notify (1) cookie 94112151658640 notify 146028888099 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x5598315ce130 con 0x5598315dcea0 2024-03-20T13:37:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f86cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94112151658640 notifier 4647 bl.length()=203 2024-03-20T13:37:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f86cbfff640 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f862c003260 con 0x5598315dcea0 2024-03-20T13:37:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 61 ==== osd_op_reply(168 notify.0 [notify cookie 94112152358864 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 62 ==== osd_op_reply(169 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 63 ==== watch-notify(notify_complete (2) cookie 94112152358864 notify 146028888099 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f87ec04e020 con 0x5598315dcea0 2024-03-20T13:37:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:170 6.1f 6:fb910292:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x5598315e22a0 2024-03-20T13:37:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.106+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(170 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.5 [delete] v34'27 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.110+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831690fd0 con 0x7f87ec035070 2024-03-20T13:37:22.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.110+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 29 ==== osd_op_reply(171 foo.buckets [call] v34'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.110+0000 7f86af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.110+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94112151680912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x5598315d8c40 2024-03-20T13:37:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.114+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94112151680912] v34'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.114+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94112151658640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x5598315dcea0 2024-03-20T13:37:22.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.114+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 64 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94112151658640] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.114+0000 7f87fbb2a980 20 remove_watcher() i=0 2024-03-20T13:37:22.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.114+0000 7f87fbb2a980 2 removed watcher, disabling cache 2024-03-20T13:37:22.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.114+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94112151666432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x5598315d8c40 2024-03-20T13:37:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94112151666432] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x5598315d8c40 2024-03-20T13:37:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87fbb2a980 20 remove_watcher() i=1 2024-03-20T13:37:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94112151665248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x5598315dcea0 2024-03-20T13:37:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 65 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94112151665248] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87fbb2a980 20 remove_watcher() i=2 2024-03-20T13:37:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94112151671760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x7f87ec035070 2024-03-20T13:37:22.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 30 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94112151671760] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87fbb2a980 20 remove_watcher() i=3 2024-03-20T13:37:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.118+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94112151674464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x5598315dcea0 2024-03-20T13:37:22.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.122+0000 7f87f9e46640 1 -- 172.21.15.123:0/3872886114 <== osd.0 v2:172.21.15.89:6800/854515999 66 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94112151674464] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87ec041040 con 0x5598315dcea0 2024-03-20T13:37:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.122+0000 7f87fbb2a980 20 remove_watcher() i=4 2024-03-20T13:37:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.122+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94112151676688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559831629e10 con 0x5598315e22a0 2024-03-20T13:37:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.122+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94112151676688] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.122+0000 7f87fbb2a980 20 remove_watcher() i=5 2024-03-20T13:37:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.122+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94112151678736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e7a60 con 0x5598315e22a0 2024-03-20T13:37:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87f9645640 1 -- 172.21.15.123:0/3872886114 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94112151678736] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f4024020 con 0x5598315e22a0 2024-03-20T13:37:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 20 remove_watcher() i=6 2024-03-20T13:37:22.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94112151672816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5598315e93d0 con 0x7f87ec035070 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 <== osd.2 v2:172.21.15.123:6803/1251286685 31 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94112151672816] v34'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87f00d5060 con 0x7f87ec035070 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 20 remove_watcher() i=7 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315dcea0 msgr2=0x5598315df2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315dcea0 0x5598315df2d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315d8c40 msgr2=0x5598315db100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315d8c40 0x5598315db100 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f87ec035070 msgr2=0x7f87ec03a1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f87ec035070 0x7f87ec03a1f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5598315e22a0 msgr2=0x5598315e4760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5598315e22a0 0x5598315e4760 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86c40342b0 msgr2=0x7f86c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86c40342b0 0x7f86c4036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f87f4049500 tx=0x7f87f403c000 comp rx=0 tx=0).stop 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 msgr2=0x5598315cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315cd560 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f87ec048950 tx=0x7f87ec048980 comp rx=0 tx=0).stop 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87f8e44640 1 -- 172.21.15.123:0/3872886114 reap_dead start 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 shutdown_connections 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/3872886114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315c6640 0x5598315cd560 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 >> 172.21.15.123:0/3872886114 conn(0x5598315c29d0 msgr2=0x5598315c0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 shutdown_connections 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/3872886114 wait complete. 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86d40342b0 msgr2=0x7f86d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86d40342b0 0x7f86d4036770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5598315a9d70 tx=0x7f87f4035040 comp rx=0 tx=0).stop 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 msgr2=0x5598315b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 0x5598315b9b30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00aae0 tx=0x7f87ec008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 shutdown_connections 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86d40342b0 0x7f86d4036770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/105221352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598315b9710 0x5598315b9b30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 >> 172.21.15.123:0/105221352 conn(0x5598315ae520 msgr2=0x5598315af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 shutdown_connections 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/105221352 wait complete. 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315a6da0 msgr2=0x5598315a9190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315a6da0 0x5598315a9190 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315a3c00 msgr2=0x5598315a5ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315a3c00 0x5598315a5ff0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86e0034350 msgr2=0x7f86e0036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86e0034350 0x7f86e0036810 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87f00ad000 tx=0x7f87f00a5040 comp rx=0 tx=0).stop 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 msgr2=0x55983159efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.126+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x55983159efe0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f87f40012f0 tx=0x7f87f4001260 comp rx=0 tx=0).stop 2024-03-20T13:37:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 shutdown_connections 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5598315a6da0 0x5598315a9190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5598315a3c00 0x5598315a5ff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f86e0034350 0x7f86e0036810 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 --2- 172.21.15.123:0/1105880066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5598314b2640 0x55983159efe0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 >> 172.21.15.123:0/1105880066 conn(0x559831421860 msgr2=0x559831592540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 shutdown_connections 2024-03-20T13:37:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.130+0000 7f87fbb2a980 1 -- 172.21.15.123:0/1105880066 wait complete. 2024-03-20T13:37:22.145 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:37:22.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:37:22.146 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-03-20T13:37:22.227 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:22.227 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:22.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f46ac980 1 Processor -- start 2024-03-20T13:37:22.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f46ac980 1 -- start start 2024-03-20T13:37:22.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f46ac980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a96dd38360 0x55a96dd3a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f46ac980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a96dc814c0 con 0x55a96dd33e50 2024-03-20T13:37:22.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f46ac980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a96dc480f0 con 0x55a96dd38360 2024-03-20T13:37:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f19c6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a96dd38360 0x55a96dd3a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f19c6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a96dd38360 0x55a96dd3a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36514/0 (socket says 172.21.15.123:36514) 2024-03-20T13:37:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f19c6640 1 -- 172.21.15.123:0/3016576566 learned_addr learned my addr 172.21.15.123:0/3016576566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f19c6640 1 -- 172.21.15.123:0/3016576566 >> v1:172.21.15.89:6789/0 conn(0x55a96dd33e50 legacy=0x55a96dd34230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.222+0000 7ff1f19c6640 1 -- 172.21.15.123:0/3016576566 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a96dd3bca0 con 0x55a96dd38360 2024-03-20T13:37:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/3016576566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd38360 0x55a96dd3a750 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00a5c0 tx=0x7ff1dc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2868de7bd82a2ef2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f11c5640 1 -- 172.21.15.123:0/3016576566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0aa470 con 0x55a96dd38360 2024-03-20T13:37:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f11c5640 1 -- 172.21.15.123:0/3016576566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0aa5d0 con 0x55a96dd38360 2024-03-20T13:37:22.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f11c5640 1 -- 172.21.15.123:0/3016576566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc0aa890 con 0x55a96dd38360 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 -- 172.21.15.123:0/3016576566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd38360 msgr2=0x55a96dd3a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/3016576566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd38360 0x55a96dd3a750 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00a5c0 tx=0x7ff1dc01b340 comp rx=0 tx=0).stop 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 -- 172.21.15.123:0/3016576566 shutdown_connections 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/3016576566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd38360 0x55a96dd3a750 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 -- 172.21.15.123:0/3016576566 >> 172.21.15.123:0/3016576566 conn(0x55a96dd2f720 msgr2=0x55a96dd31b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 -- 172.21.15.123:0/3016576566 shutdown_connections 2024-03-20T13:37:22.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.226+0000 7ff1f46ac980 1 -- 172.21.15.123:0/3016576566 wait complete. 2024-03-20T13:37:22.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.242+0000 7ff1f46ac980 1 Processor -- start 2024-03-20T13:37:22.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.242+0000 7ff1f46ac980 1 -- start start 2024-03-20T13:37:22.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.242+0000 7ff1f46ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de1dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.242+0000 7ff1f46ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a96dc45620 con 0x55a96dd33e50 2024-03-20T13:37:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de1dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de1dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36528/0 (socket says 172.21.15.123:36528) 2024-03-20T13:37:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 -- 172.21.15.123:0/954714707 learned_addr learned my addr 172.21.15.123:0/954714707 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 -- 172.21.15.123:0/954714707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc005df0 con 0x55a96dd33e50 2024-03-20T13:37:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/954714707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de1dd30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fb0 tx=0x7ff1e4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2458077b911d70 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff0e0608640 1 -- 172.21.15.123:0/954714707 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e400f640 con 0x55a96dd33e50 2024-03-20T13:37:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff0e0608640 1 -- 172.21.15.123:0/954714707 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400f7c0 con 0x55a96dd33e50 2024-03-20T13:37:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff0e0608640 1 -- 172.21.15.123:0/954714707 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e400fae0 con 0x55a96dd33e50 2024-03-20T13:37:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- 172.21.15.123:0/954714707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 msgr2=0x55a96de1dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/954714707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de1dd30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fb0 tx=0x7ff1e4001940 comp rx=0 tx=0).stop 2024-03-20T13:37:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- 172.21.15.123:0/954714707 shutdown_connections 2024-03-20T13:37:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/954714707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de1dd30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- 172.21.15.123:0/954714707 >> 172.21.15.123:0/954714707 conn(0x55a96dd2f720 msgr2=0x55a96de198c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- 172.21.15.123:0/954714707 shutdown_connections 2024-03-20T13:37:22.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- 172.21.15.123:0/954714707 wait complete. 2024-03-20T13:37:22.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 Processor -- start 2024-03-20T13:37:22.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- start start 2024-03-20T13:37:22.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de25cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f46ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a96dc40e00 con 0x55a96dd33e50 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de25cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de25cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36538/0 (socket says 172.21.15.123:36538) 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2215057288 learned_addr learned my addr 172.21.15.123:0/2215057288 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.246+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a96dc814c0 con 0x55a96dd33e50 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de25cf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x55a96de1ebc0 tx=0x7ff1e4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff0dee05640 1 -- 172.21.15.123:0/2215057288 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4005450 con 0x55a96dd33e50 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a96de26230 con 0x55a96dd33e50 2024-03-20T13:37:22.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff0dee05640 1 -- 172.21.15.123:0/2215057288 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e40055b0 con 0x55a96dd33e50 2024-03-20T13:37:22.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a96de26660 con 0x55a96dd33e50 2024-03-20T13:37:22.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff0dee05640 1 -- 172.21.15.123:0/2215057288 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4005890 con 0x55a96dd33e50 2024-03-20T13:37:22.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff0dee05640 1 -- 172.21.15.123:0/2215057288 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1e40059f0 con 0x55a96dd33e50 2024-03-20T13:37:22.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff0dee05640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0d80342b0 0x7ff0d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff0dee05640 1 -- 172.21.15.123:0/2215057288 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff1e40492e0 con 0x55a96dd33e50 2024-03-20T13:37:22.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0d80342b0 0x7ff0d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96dd38360 0x55a96de2c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de2ceb0 con 0x55a96dd38360 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96dd38360 0x55a96de2c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0d80342b0 0x7ff0d8036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ae000 tx=0x7ff1dc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96dd38360 0x55a96de2c970 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2215057288 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1ec0083f0 con 0x55a96dd38360 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de2d720 0x55a96de2fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de30270 con 0x55a96de2d720 2024-03-20T13:37:22.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.250+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de2d720 0x55a96de2fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de2d720 0x55a96de2fb40 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2215057288 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de2d720 2024-03-20T13:37:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de31ab0 con 0x55a96de2d720 2024-03-20T13:37:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2215057288 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de2d720 2024-03-20T13:37:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de30cb0 con 0x55a96de2d720 2024-03-20T13:37:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2215057288 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de2d720 2024-03-20T13:37:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de310c0 con 0x55a96dd38360 2024-03-20T13:37:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2215057288 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff1ec0083f0 con 0x55a96dd38360 2024-03-20T13:37:22.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 Processor -- start 2024-03-20T13:37:22.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 -- start start 2024-03-20T13:37:22.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 0x55a96de1ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.254+0000 7ff1f46ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a96dbd9e30 con 0x55a96de1c770 2024-03-20T13:37:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 0x55a96de1ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 0x55a96de1ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36540/0 (socket says 172.21.15.123:36540) 2024-03-20T13:37:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 -- 172.21.15.123:0/748260272 learned_addr learned my addr 172.21.15.123:0/748260272 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 -- 172.21.15.123:0/748260272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a96de1b150 con 0x55a96de1c770 2024-03-20T13:37:22.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 0x55a96de1ac10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00aae0 tx=0x7ff1ec008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff0d7fff640 1 -- 172.21.15.123:0/748260272 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec01d070 con 0x55a96de1c770 2024-03-20T13:37:22.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff0d7fff640 1 -- 172.21.15.123:0/748260272 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec010040 con 0x55a96de1c770 2024-03-20T13:37:22.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a96de1b3a0 con 0x55a96de1c770 2024-03-20T13:37:22.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff0d7fff640 1 -- 172.21.15.123:0/748260272 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec007e70 con 0x55a96de1c770 2024-03-20T13:37:22.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a96de1b830 con 0x55a96de1c770 2024-03-20T13:37:22.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff0d7fff640 1 -- 172.21.15.123:0/748260272 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1ec018430 con 0x55a96de1c770 2024-03-20T13:37:22.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff0d7fff640 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0cc0342b0 0x7ff0cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff0d7fff640 1 -- 172.21.15.123:0/748260272 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff1ec04a930 con 0x55a96de1c770 2024-03-20T13:37:22.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0cc0342b0 0x7ff0cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f46ac980 1 Processor -- start 2024-03-20T13:37:22.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f46ac980 1 -- start start 2024-03-20T13:37:22.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0cc0342b0 0x7ff0cc036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55a96de307b0 tx=0x7ff1e40475c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f46ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de4f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f46ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a96dbcd790 con 0x55a96de4f430 2024-03-20T13:37:22.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de4f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de4f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36554/0 (socket says 172.21.15.123:36554) 2024-03-20T13:37:22.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.258+0000 7ff1f29c8640 1 -- 172.21.15.123:0/1935710535 learned_addr learned my addr 172.21.15.123:0/1935710535 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 -- 172.21.15.123:0/1935710535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a96de4fe20 con 0x55a96de4f430 2024-03-20T13:37:22.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/1935710535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de4f850 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec048c20 tx=0x7ff1ec023fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9e9b2cdb4452bf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff0d5ffb640 1 -- 172.21.15.123:0/1935710535 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec047070 con 0x55a96de4f430 2024-03-20T13:37:22.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff0d5ffb640 1 -- 172.21.15.123:0/1935710535 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec018c50 con 0x55a96de4f430 2024-03-20T13:37:22.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff0d5ffb640 1 -- 172.21.15.123:0/1935710535 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec018de0 con 0x55a96de4f430 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/1935710535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 msgr2=0x55a96de4f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/1935710535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de4f850 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec048c20 tx=0x7ff1ec023fd0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/1935710535 shutdown_connections 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/1935710535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de4f850 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/1935710535 >> 172.21.15.123:0/1935710535 conn(0x55a96de4b7c0 msgr2=0x55a96de49820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/1935710535 shutdown_connections 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/1935710535 wait complete. 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 Processor -- start 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- start start 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a96de56800 con 0x55a96de4f430 2024-03-20T13:37:22.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36564/0 (socket says 172.21.15.123:36564) 2024-03-20T13:37:22.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 learned_addr learned my addr 172.21.15.123:0/2450096985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a96de1b830 con 0x55a96de4f430 2024-03-20T13:37:22.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de562c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0077a0 tx=0x7ff1ec048b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff0c3fff640 1 -- 172.21.15.123:0/2450096985 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec018dc0 con 0x55a96de4f430 2024-03-20T13:37:22.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff0c3fff640 1 -- 172.21.15.123:0/2450096985 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec03ad00 con 0x55a96de4f430 2024-03-20T13:37:22.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a96de56a00 con 0x55a96de4f430 2024-03-20T13:37:22.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff0c3fff640 1 -- 172.21.15.123:0/2450096985 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec0166c0 con 0x55a96de4f430 2024-03-20T13:37:22.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.262+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a96de56e90 con 0x55a96de4f430 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff0c3fff640 1 -- 172.21.15.123:0/2450096985 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1ec016930 con 0x55a96de4f430 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff0c3fff640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0bc0342b0 0x7ff0bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff0c3fff640 1 -- 172.21.15.123:0/2450096985 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff1ec036d20 con 0x55a96de4f430 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0bc0342b0 0x7ff0bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0bc0342b0 0x7ff0bc036770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4047590 tx=0x7ff1e4031050 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96de61870 0x55a96de63d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de64480 con 0x55a96de61870 2024-03-20T13:37:22.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96de61870 0x55a96de63d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96de61870 0x55a96de63d30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 realm 2024-03-20T13:37:22.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de64870 con 0x55a96de61870 2024-03-20T13:37:22.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de650f0 con 0x55a96de61870 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de65ad0 0x55a96de67f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de68670 con 0x55a96de65ad0 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de65ad0 0x55a96de67f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.266+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de65ad0 0x55a96de67f00 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de68e70 con 0x55a96de65ad0 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 20 searching for the correct realm 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a96de6aeb0 0x55a96de6d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a96de6aeb0 0x55a96de6d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f21c7640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a96de6aeb0 0x55a96de6d370 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f29c8640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff1ec035020 0x7ff1ec03c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x7ff1ec035020 2024-03-20T13:37:22.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff1ec035020 0x7ff1ec03c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.270+0000 7ff1f19c6640 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff1ec035020 0x7ff1ec03c020 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x7ff1ec035020 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x7ff1ec035020 2024-03-20T13:37:22.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x7ff1ec035020 2024-03-20T13:37:22.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x7ff1ec035020 2024-03-20T13:37:22.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff1dc0b0020 con 0x7ff1ec035020 2024-03-20T13:37:22.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.274+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0b0020 con 0x55a96de61870 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x7ff1ec035020 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.278+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de61870 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x7ff1ec035020 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x7ff1ec035020 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de6aeb0 2024-03-20T13:37:22.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.282+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6da40 con 0x55a96de65ad0 2024-03-20T13:37:22.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6a460 con 0x55a96de61870 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de69850 con 0x55a96de65ad0 2024-03-20T13:37:22.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de69c30 con 0x55a96de61870 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 zone default found 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 4 Realm: () 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 zonegroup default 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6e320 con 0x7ff1ec035020 2024-03-20T13:37:22.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6df40 con 0x55a96de6aeb0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de70600 con 0x55a96de6aeb0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 started sync module instance, tier type = 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:22.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.286+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6fad0 con 0x55a96de65ad0 2024-03-20T13:37:22.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.290+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.290+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94186181688960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6fad0 con 0x55a96de65ad0 2024-03-20T13:37:22.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.290+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de71030 con 0x55a96de61870 2024-03-20T13:37:22.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.290+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.290+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94186181692304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de71450 con 0x55a96de61870 2024-03-20T13:37:22.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.290+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de71f20 con 0x55a96de65ad0 2024-03-20T13:37:22.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94186181688960] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94186181692304] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94186181696000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de70fb0 con 0x55a96de65ad0 2024-03-20T13:37:22.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de72770 con 0x7ff1ec035020 2024-03-20T13:37:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94186181698256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de70fb0 con 0x7ff1ec035020 2024-03-20T13:37:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de73240 con 0x55a96de65ad0 2024-03-20T13:37:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.294+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94186181696000] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94186181698256] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94186181686832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de72d60 con 0x55a96de65ad0 2024-03-20T13:37:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de73ac0 con 0x55a96de6aeb0 2024-03-20T13:37:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94186181703200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de72d60 con 0x55a96de6aeb0 2024-03-20T13:37:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de748d0 con 0x55a96de6aeb0 2024-03-20T13:37:22.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94186181686832] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.298+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94186181703200] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94186181699312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de748d0 con 0x55a96de6aeb0 2024-03-20T13:37:22.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de750d0 con 0x7ff1ec035020 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94186181699312] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94186181707280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de74fb0 con 0x7ff1ec035020 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=0 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=1 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=2 2024-03-20T13:37:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=3 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=4 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=5 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=6 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94186181707280] v34'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 20 add_watcher() i=7 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de784e0 con 0x55a96de61870 2024-03-20T13:37:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.302+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94186181708400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de759c0 con 0x55a96de61870 2024-03-20T13:37:22.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94186181708400] v34'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff0a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:22.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:22.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 5 note: GC not initialized 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff0237fe640 20 reqs_thread_entry: start 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 20 Filter name: none 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff0217fa640 20 reqs_thread_entry: start 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de9a480 con 0x55a96de61870 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:22.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.306+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96dea0120 con 0x55a96de61870 2024-03-20T13:37:22.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~369] v34'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f46ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:22.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f46ac980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f46ac980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:37:22.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94186181885376 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de9ce40 con 0x55a96de65ad0 2024-03-20T13:37:22.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94186181686832 notify 146028888100 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x55a96de56a00 con 0x55a96de65ad0 2024-03-20T13:37:22.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff0d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94186181686832 notifier 4654 bl.length()=545 2024-03-20T13:37:22.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 94186181885376 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff0d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:22.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff0d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff0d5ffb640 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff0b8003ea0 con 0x55a96de65ad0 2024-03-20T13:37:22.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec032070 con 0x55a96de65ad0 2024-03-20T13:37:22.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94186181885376 notify 146028888100 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff1ec069020 con 0x55a96de65ad0 2024-03-20T13:37:22.316 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:22.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff0a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.310+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94186181708400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de99400 con 0x55a96de61870 2024-03-20T13:37:22.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.314+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94186181708400] v34'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.314+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94186181688960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de74a30 con 0x55a96de65ad0 2024-03-20T13:37:22.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.314+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94186181688960] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec06b040 con 0x55a96de65ad0 2024-03-20T13:37:22.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.314+0000 7ff1f46ac980 20 remove_watcher() i=0 2024-03-20T13:37:22.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.314+0000 7ff1f46ac980 2 removed watcher, disabling cache 2024-03-20T13:37:22.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.314+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94186181692304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6fe80 con 0x55a96de61870 2024-03-20T13:37:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94186181692304] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x55a96de61870 2024-03-20T13:37:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f46ac980 20 remove_watcher() i=1 2024-03-20T13:37:22.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94186181696000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6fe80 con 0x55a96de65ad0 2024-03-20T13:37:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94186181696000] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec06b040 con 0x55a96de65ad0 2024-03-20T13:37:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f46ac980 20 remove_watcher() i=2 2024-03-20T13:37:22.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94186181698256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de71a00 con 0x7ff1ec035020 2024-03-20T13:37:22.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94186181698256] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f46ac980 20 remove_watcher() i=3 2024-03-20T13:37:22.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.318+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94186181686832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de722d0 con 0x55a96de65ad0 2024-03-20T13:37:22.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.322+0000 7ff1f29c8640 1 -- 172.21.15.123:0/2450096985 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94186181686832] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec06b040 con 0x55a96de65ad0 2024-03-20T13:37:22.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.322+0000 7ff1f46ac980 20 remove_watcher() i=4 2024-03-20T13:37:22.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.322+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94186181703200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de71a00 con 0x55a96de6aeb0 2024-03-20T13:37:22.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.322+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94186181703200] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.322+0000 7ff1f46ac980 20 remove_watcher() i=5 2024-03-20T13:37:22.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.322+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94186181699312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6f630 con 0x55a96de6aeb0 2024-03-20T13:37:22.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f21c7640 1 -- 172.21.15.123:0/2450096985 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94186181699312] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023070 con 0x55a96de6aeb0 2024-03-20T13:37:22.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 20 remove_watcher() i=6 2024-03-20T13:37:22.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94186181707280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a96de6f630 con 0x7ff1ec035020 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94186181707280] v34'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc0d5060 con 0x7ff1ec035020 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 20 remove_watcher() i=7 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de65ad0 msgr2=0x55a96de67f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de65ad0 0x55a96de67f00 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96de61870 msgr2=0x55a96de63d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96de61870 0x55a96de63d30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff1ec035020 msgr2=0x7ff1ec03c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff1ec035020 0x7ff1ec03c020 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a96de6aeb0 msgr2=0x55a96de6d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a96de6aeb0 0x55a96de6d370 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0bc0342b0 msgr2=0x7ff0bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0bc0342b0 0x7ff0bc036770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4047590 tx=0x7ff1e4031050 comp rx=0 tx=0).stop 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 msgr2=0x55a96de562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de562c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0077a0 tx=0x7ff1ec048b50 comp rx=0 tx=0).stop 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f19c6640 1 -- 172.21.15.123:0/2450096985 reap_dead start 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 shutdown_connections 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2450096985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de4f430 0x55a96de562c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 >> 172.21.15.123:0/2450096985 conn(0x55a96de4b7c0 msgr2=0x55a96de48e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 shutdown_connections 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2450096985 wait complete. 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0cc0342b0 msgr2=0x7ff0cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0cc0342b0 0x7ff0cc036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55a96de307b0 tx=0x7ff1e40475c0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 msgr2=0x55a96de1ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 0x55a96de1ac10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00aae0 tx=0x7ff1ec008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 shutdown_connections 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0cc0342b0 0x7ff0cc036770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/748260272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96de1c770 0x55a96de1ac10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 >> 172.21.15.123:0/748260272 conn(0x55a96de34fc0 msgr2=0x55a96de35ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 shutdown_connections 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/748260272 wait complete. 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de2d720 msgr2=0x55a96de2fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de2d720 0x55a96de2fb40 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96dd38360 msgr2=0x55a96de2c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96dd38360 0x55a96de2c970 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0d80342b0 msgr2=0x7ff0d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0d80342b0 0x7ff0d8036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ae000 tx=0x7ff1dc0a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:22.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 msgr2=0x55a96de25cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de25cf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x55a96de1ebc0 tx=0x7ff1e4000f50 comp rx=0 tx=0).stop 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 shutdown_connections 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a96de2d720 0x55a96de2fb40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a96dd38360 0x55a96de2c970 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff0d80342b0 0x7ff0d8036770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 --2- 172.21.15.123:0/2215057288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a96dd33e50 0x55a96de25cf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 >> 172.21.15.123:0/2215057288 conn(0x55a96dd2f720 msgr2=0x55a96de1cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 shutdown_connections 2024-03-20T13:37:22.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.326+0000 7ff1f46ac980 1 -- 172.21.15.123:0/2215057288 wait complete. 2024-03-20T13:37:22.344 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:22.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:37:22.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:37:22.344 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-03-20T13:37:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecf76f980 1 Processor -- start 2024-03-20T13:37:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecf76f980 1 -- start start 2024-03-20T13:37:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecf76f980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556d1576f990 0x556d1576df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecf76f980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556d157454c0 con 0x556d1576e4d0 2024-03-20T13:37:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecf76f980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x556d1570c0f0 con 0x556d1576f990 2024-03-20T13:37:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecd28a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556d1576f990 0x556d1576df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecd28a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556d1576f990 0x556d1576df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36574/0 (socket says 172.21.15.123:36574) 2024-03-20T13:37:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecca89640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x556d1576e4d0 0x556d15800f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33302/0 (socket says 172.21.15.123:33302) 2024-03-20T13:37:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecd28a640 1 -- 172.21.15.123:0/3708901812 learned_addr learned my addr 172.21.15.123:0/3708901812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecd28a640 1 -- 172.21.15.123:0/3708901812 >> v1:172.21.15.89:6789/0 conn(0x556d1576e4d0 legacy=0x556d15800f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.418+0000 7feecd28a640 1 -- 172.21.15.123:0/3708901812 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1576e8e0 con 0x556d1576f990 2024-03-20T13:37:22.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecd28a640 1 --2- 172.21.15.123:0/3708901812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576f990 0x556d1576df90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7feeb800a5c0 tx=0x7feeb801b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb64caf31f00c6d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feec7fff640 1 -- 172.21.15.123:0/3708901812 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80aa530 con 0x556d1576f990 2024-03-20T13:37:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feec7fff640 1 -- 172.21.15.123:0/3708901812 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80a6050 con 0x556d1576f990 2024-03-20T13:37:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feec7fff640 1 -- 172.21.15.123:0/3708901812 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80aa7e0 con 0x556d1576f990 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 -- 172.21.15.123:0/3708901812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576f990 msgr2=0x556d1576df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 --2- 172.21.15.123:0/3708901812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576f990 0x556d1576df90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7feeb800a5c0 tx=0x7feeb801b2e0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 -- 172.21.15.123:0/3708901812 shutdown_connections 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 --2- 172.21.15.123:0/3708901812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576f990 0x556d1576df90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 -- 172.21.15.123:0/3708901812 >> 172.21.15.123:0/3708901812 conn(0x556d157f4860 msgr2=0x556d157f6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 -- 172.21.15.123:0/3708901812 shutdown_connections 2024-03-20T13:37:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.422+0000 7feecf76f980 1 -- 172.21.15.123:0/3708901812 wait complete. 2024-03-20T13:37:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 Processor -- start 2024-03-20T13:37:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- start start 2024-03-20T13:37:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d15709620 con 0x556d1576e4d0 2024-03-20T13:37:22.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecd28a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecd28a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158e55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36582/0 (socket says 172.21.15.123:36582) 2024-03-20T13:37:22.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecd28a640 1 -- 172.21.15.123:0/669848955 learned_addr learned my addr 172.21.15.123:0/669848955 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecd28a640 1 -- 172.21.15.123:0/669848955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8005df0 con 0x556d1576e4d0 2024-03-20T13:37:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecd28a640 1 --2- 172.21.15.123:0/669848955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158e55d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7feeb8017f50 tx=0x7feeb8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def3d694b94dbb41 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7fedbb606640 1 -- 172.21.15.123:0/669848955 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80aa640 con 0x556d1576e4d0 2024-03-20T13:37:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7fedbb606640 1 -- 172.21.15.123:0/669848955 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80aa7c0 con 0x556d1576e4d0 2024-03-20T13:37:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7fedbb606640 1 -- 172.21.15.123:0/669848955 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80aaaa0 con 0x556d1576e4d0 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- 172.21.15.123:0/669848955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 msgr2=0x556d158e55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 --2- 172.21.15.123:0/669848955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158e55d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7feeb8017f50 tx=0x7feeb8003030 comp rx=0 tx=0).stop 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- 172.21.15.123:0/669848955 shutdown_connections 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 --2- 172.21.15.123:0/669848955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158e55d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- 172.21.15.123:0/669848955 >> 172.21.15.123:0/669848955 conn(0x556d157f4860 msgr2=0x556d158e1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- 172.21.15.123:0/669848955 shutdown_connections 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- 172.21.15.123:0/669848955 wait complete. 2024-03-20T13:37:22.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 Processor -- start 2024-03-20T13:37:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- start start 2024-03-20T13:37:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158ec300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.438+0000 7feecf76f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d15704e00 con 0x556d1576e4d0 2024-03-20T13:37:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecd28a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158ec300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecd28a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158ec300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36586/0 (socket says 172.21.15.123:36586) 2024-03-20T13:37:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecd28a640 1 -- 172.21.15.123:0/3525979449 learned_addr learned my addr 172.21.15.123:0/3525979449 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecd28a640 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d1576e8e0 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecd28a640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158ec300 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feeb8017f50 tx=0x7feeb80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7fedb9e03640 1 -- 172.21.15.123:0/3525979449 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80b4a00 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d158ec840 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7fedb9e03640 1 -- 172.21.15.123:0/3525979449 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80b4b60 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7fedb9e03640 1 -- 172.21.15.123:0/3525979449 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80b4e00 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d158eccd0 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7fedb9e03640 1 -- 172.21.15.123:0/3525979449 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feeb80c4020 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7fedb9e03640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fedb4034300 0x7fedb40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7fedb9e03640 1 -- 172.21.15.123:0/3525979449 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7feeb80e40d0 con 0x556d1576e4d0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecca89640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fedb4034300 0x7fedb40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1576f990 0x556d158f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d158f3420 con 0x556d1576f990 2024-03-20T13:37:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecda8b640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1576f990 0x556d158f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecca89640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fedb4034300 0x7fedb40367c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feec80012f0 tx=0x7feec8006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecda8b640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1576f990 0x556d158f2ee0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecda8b640 1 -- 172.21.15.123:0/3525979449 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feec00083f0 con 0x556d1576f990 2024-03-20T13:37:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d158f3c90 0x556d158f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.442+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d158f6710 con 0x556d158f3c90 2024-03-20T13:37:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecd28a640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d158f3c90 0x556d158f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecd28a640 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d158f3c90 0x556d158f6080 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecd28a640 1 -- 172.21.15.123:0/3525979449 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d158f3c90 2024-03-20T13:37:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d158f7f70 con 0x556d158f3c90 2024-03-20T13:37:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecd28a640 1 -- 172.21.15.123:0/3525979449 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d158f3c90 2024-03-20T13:37:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d158f7170 con 0x556d158f3c90 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecd28a640 1 -- 172.21.15.123:0/3525979449 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d158f3c90 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d158f7580 con 0x556d1576f990 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecda8b640 1 -- 172.21.15.123:0/3525979449 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7feec00083f0 con 0x556d1576f990 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 Processor -- start 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 -- start start 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 0x556d15906a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.446+0000 7feecf76f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1569de30 con 0x556d15906650 2024-03-20T13:37:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 0x556d15906a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 0x556d15906a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36598/0 (socket says 172.21.15.123:36598) 2024-03-20T13:37:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 -- 172.21.15.123:0/763157727 learned_addr learned my addr 172.21.15.123:0/763157727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 -- 172.21.15.123:0/763157727 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d15906fb0 con 0x556d15906650 2024-03-20T13:37:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 0x556d15906a70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feec000aae0 tx=0x7feec0008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7fedb2ffd640 1 -- 172.21.15.123:0/763157727 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec001d070 con 0x556d15906650 2024-03-20T13:37:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7fedb2ffd640 1 -- 172.21.15.123:0/763157727 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0010040 con 0x556d15906650 2024-03-20T13:37:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d15907200 con 0x556d15906650 2024-03-20T13:37:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7fedb2ffd640 1 -- 172.21.15.123:0/763157727 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0007e70 con 0x556d15906650 2024-03-20T13:37:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d15907d50 con 0x556d15906650 2024-03-20T13:37:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7fedb2ffd640 1 -- 172.21.15.123:0/763157727 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feec0018430 con 0x556d15906650 2024-03-20T13:37:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7fedb2ffd640 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feda40342b0 0x7feda4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7fedb2ffd640 1 -- 172.21.15.123:0/763157727 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7feec004a6d0 con 0x556d15906650 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecd28a640 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feda40342b0 0x7feda4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecf76f980 1 Processor -- start 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecf76f980 1 -- start start 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecd28a640 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feda40342b0 0x7feda4036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x556d158f6c70 tx=0x7feeb80bc450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecf76f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d159139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecf76f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d15691790 con 0x556d159135a0 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d159139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d159139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36610/0 (socket says 172.21.15.123:36610) 2024-03-20T13:37:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.450+0000 7feecda8b640 1 -- 172.21.15.123:0/2001523188 learned_addr learned my addr 172.21.15.123:0/2001523188 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 -- 172.21.15.123:0/2001523188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d15913f90 con 0x556d159135a0 2024-03-20T13:37:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 --2- 172.21.15.123:0/2001523188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d159139c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7feec0048a20 tx=0x7feec0021970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f587b4456a917b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7fedb0ff9640 1 -- 172.21.15.123:0/2001523188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0047070 con 0x556d159135a0 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7fedb0ff9640 1 -- 172.21.15.123:0/2001523188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0022590 con 0x556d159135a0 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7fedb0ff9640 1 -- 172.21.15.123:0/2001523188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0016330 con 0x556d159135a0 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/2001523188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 msgr2=0x556d159139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 --2- 172.21.15.123:0/2001523188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d159139c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7feec0048a20 tx=0x7feec0021970 comp rx=0 tx=0).stop 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/2001523188 shutdown_connections 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 --2- 172.21.15.123:0/2001523188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d159139c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/2001523188 >> 172.21.15.123:0/2001523188 conn(0x556d1590f930 msgr2=0x556d1590d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/2001523188 shutdown_connections 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/2001523188 wait complete. 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 Processor -- start 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- start start 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d1591a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d1591a970 con 0x556d159135a0 2024-03-20T13:37:22.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d1591a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d1591a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36616/0 (socket says 172.21.15.123:36616) 2024-03-20T13:37:22.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 learned_addr learned my addr 172.21.15.123:0/177713081 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d15907d50 con 0x556d159135a0 2024-03-20T13:37:22.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecda8b640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d1591a430 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7feec0022720 tx=0x7feec00489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feda2ffd640 1 -- 172.21.15.123:0/177713081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec0021b60 con 0x556d159135a0 2024-03-20T13:37:22.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feda2ffd640 1 -- 172.21.15.123:0/177713081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0021cc0 con 0x556d159135a0 2024-03-20T13:37:22.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d1591ab70 con 0x556d159135a0 2024-03-20T13:37:22.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feda2ffd640 1 -- 172.21.15.123:0/177713081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feec004a0d0 con 0x556d159135a0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.454+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d1591b000 con 0x556d159135a0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feda2ffd640 1 -- 172.21.15.123:0/177713081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feec004a300 con 0x556d159135a0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feda2ffd640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fed980342b0 0x7fed98036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feda2ffd640 1 -- 172.21.15.123:0/177713081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7feec0037d20 con 0x556d159135a0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecd28a640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fed980342b0 0x7fed98036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d15925b70 0x556d15928030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15928780 con 0x556d15925b70 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecca89640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d15925b70 0x556d15928030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecd28a640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fed980342b0 0x7fed98036770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feeb80d0fd0 tx=0x7feeb80c6f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecca89640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d15925b70 0x556d15928030 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 realm 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15924fd0 con 0x556d15925b70 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15929200 con 0x556d15925b70 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d15929f90 0x556d1592c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1592ca00 con 0x556d15929f90 2024-03-20T13:37:22.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecda8b640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d15929f90 0x556d1592c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.458+0000 7feecda8b640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d15929f90 0x556d1592c380 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1592d200 con 0x556d15929f90 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 20 searching for the correct realm 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1592f200 0x556d159316c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecd28a640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1592f200 0x556d159316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecd28a640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1592f200 0x556d159316c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecda8b640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7feec0036020 0x7feec0047210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x7feec0036020 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7feec0036020 0x7feec0047210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7feec0036020 0x7feec0047210 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.462+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x7feec0036020 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x7feec0036020 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.466+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x7feec0036020 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15925b70 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x7feec0036020 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.470+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x7feec0036020 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d1592f200 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15931d90 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:22.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1592e760 con 0x556d15925b70 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.474+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1592d710 con 0x556d15929f90 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1592e000 con 0x556d15925b70 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 zone default found 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 4 Realm: () 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 zonegroup default 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15932670 con 0x7feec0036020 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15934850 con 0x556d1592f200 2024-03-20T13:37:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15934bb0 con 0x556d1592f200 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 started sync module instance, tier type = 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.478+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15933c90 con 0x556d15929f90 2024-03-20T13:37:22.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93927001765872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159344e0 con 0x556d15929f90 2024-03-20T13:37:22.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15935520 con 0x556d15925b70 2024-03-20T13:37:22.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93927001774208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15936140 con 0x556d15925b70 2024-03-20T13:37:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15936ab0 con 0x556d15929f90 2024-03-20T13:37:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93927001765872] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93927001774208] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93927001775264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159360c0 con 0x556d15929f90 2024-03-20T13:37:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.482+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15936f50 con 0x7feec0036020 2024-03-20T13:37:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93927001778864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15937370 con 0x7feec0036020 2024-03-20T13:37:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15937d40 con 0x556d15929f90 2024-03-20T13:37:22.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93927001775264] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93927001778864] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93927001782336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15936ed0 con 0x556d15929f90 2024-03-20T13:37:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.486+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15938590 con 0x556d1592f200 2024-03-20T13:37:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93927001784560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15936ed0 con 0x556d1592f200 2024-03-20T13:37:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15938fc0 con 0x556d1592f200 2024-03-20T13:37:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93927001782336] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93927001784560] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93927001785616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15938b20 con 0x556d1592f200 2024-03-20T13:37:22.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15939810 con 0x7feec0036020 2024-03-20T13:37:22.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93927001789296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15939c30 con 0x7feec0036020 2024-03-20T13:37:22.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=0 2024-03-20T13:37:22.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=1 2024-03-20T13:37:22.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=2 2024-03-20T13:37:22.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=3 2024-03-20T13:37:22.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=4 2024-03-20T13:37:22.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=5 2024-03-20T13:37:22.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93927001785616] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.490+0000 7feecf76f980 20 add_watcher() i=6 2024-03-20T13:37:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93927001789296] v34'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 20 add_watcher() i=7 2024-03-20T13:37:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1593cc60 con 0x556d15925b70 2024-03-20T13:37:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93927001790352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1593a050 con 0x556d15925b70 2024-03-20T13:37:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93927001790352] v34'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7fed837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:22.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 5 note: GC not initialized 2024-03-20T13:37:22.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7fed827e4640 20 reqs_thread_entry: start 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.494+0000 7feecf76f980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 20 Filter name: none 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7fecf3fff640 20 reqs_thread_entry: start 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1595e890 con 0x556d15925b70 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+492 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 20 rados_obj.operate() r=0 bl.length=369 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:22.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15964530 con 0x556d15925b70 2024-03-20T13:37:22.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v34'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:22.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:37:22.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93927001965008 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15961250 con 0x556d15929f90 2024-03-20T13:37:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 93927001782336 notify 146028888101 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7feec0067040 con 0x556d15929f90 2024-03-20T13:37:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7fedb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 93927001782336 notifier 4661 bl.length()=533 2024-03-20T13:37:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(64 notify.4 [notify cookie 93927001965008 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7fedb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:37:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7fedb0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7fedb0ff9640 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fed90003ea0 con 0x556d15929f90 2024-03-20T13:37:22.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.498+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.502+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 93927001965008 notify 146028888101 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556d1591b000 con 0x556d15929f90 2024-03-20T13:37:22.506 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:22.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.502+0000 7fed837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.502+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93927001790352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1595d350 con 0x556d15925b70 2024-03-20T13:37:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.502+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93927001790352] v34'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.502+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93927001765872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d1595d350 con 0x556d15929f90 2024-03-20T13:37:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93927001765872] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecf76f980 20 remove_watcher() i=0 2024-03-20T13:37:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecf76f980 2 removed watcher, disabling cache 2024-03-20T13:37:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93927001774208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159337f0 con 0x556d15925b70 2024-03-20T13:37:22.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93927001774208] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x556d15925b70 2024-03-20T13:37:22.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecf76f980 20 remove_watcher() i=1 2024-03-20T13:37:22.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.506+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93927001775264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159337f0 con 0x556d15929f90 2024-03-20T13:37:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.510+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93927001775264] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.510+0000 7feecf76f980 20 remove_watcher() i=2 2024-03-20T13:37:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.510+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93927001778864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159337f0 con 0x7feec0036020 2024-03-20T13:37:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.510+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93927001778864] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.510+0000 7feecf76f980 20 remove_watcher() i=3 2024-03-20T13:37:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.510+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93927001782336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159337f0 con 0x556d15929f90 2024-03-20T13:37:22.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecda8b640 1 -- 172.21.15.123:0/177713081 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93927001782336] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec0033070 con 0x556d15929f90 2024-03-20T13:37:22.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecf76f980 20 remove_watcher() i=4 2024-03-20T13:37:22.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93927001784560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15937840 con 0x556d1592f200 2024-03-20T13:37:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93927001784560] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecf76f980 20 remove_watcher() i=5 2024-03-20T13:37:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93927001785616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d159337f0 con 0x556d1592f200 2024-03-20T13:37:22.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecd28a640 1 -- 172.21.15.123:0/177713081 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93927001785616] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feeb80bdc80 con 0x556d1592f200 2024-03-20T13:37:22.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecf76f980 20 remove_watcher() i=6 2024-03-20T13:37:22.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.514+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93927001789296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556d15937840 con 0x7feec0036020 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93927001789296] v34'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feec8003460 con 0x7feec0036020 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 20 remove_watcher() i=7 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d15929f90 msgr2=0x556d1592c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d15929f90 0x556d1592c380 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d15925b70 msgr2=0x556d15928030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d15925b70 0x556d15928030 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7feec0036020 msgr2=0x7feec0047210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7feec0036020 0x7feec0047210 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1592f200 msgr2=0x556d159316c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556d1592f200 0x556d159316c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fed980342b0 msgr2=0x7fed98036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fed980342b0 0x7fed98036770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feeb80d0fd0 tx=0x7feeb80c6f90 comp rx=0 tx=0).stop 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 msgr2=0x556d1591a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d1591a430 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7feec0022720 tx=0x7feec00489b0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecca89640 1 -- 172.21.15.123:0/177713081 reap_dead start 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 shutdown_connections 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/177713081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d159135a0 0x556d1591a430 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 >> 172.21.15.123:0/177713081 conn(0x556d1590f930 msgr2=0x556d1590cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 shutdown_connections 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/177713081 wait complete. 2024-03-20T13:37:22.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feda40342b0 msgr2=0x7feda4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feda40342b0 0x7feda4036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x556d158f6c70 tx=0x7feeb80bc450 comp rx=0 tx=0).stop 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 msgr2=0x556d15906a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 0x556d15906a70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feec000aae0 tx=0x7feec0008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 shutdown_connections 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feda40342b0 0x7feda4036770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/763157727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d15906650 0x556d15906a70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 >> 172.21.15.123:0/763157727 conn(0x556d158fb460 msgr2=0x556d158fbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 shutdown_connections 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/763157727 wait complete. 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d158f3c90 msgr2=0x556d158f6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d158f3c90 0x556d158f6080 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1576f990 msgr2=0x556d158f2ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1576f990 0x556d158f2ee0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fedb4034300 msgr2=0x7fedb40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fedb4034300 0x7fedb40367c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feec80012f0 tx=0x7feec8006700 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 msgr2=0x556d158ec300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158ec300 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feeb8017f50 tx=0x7feeb80180e0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 shutdown_connections 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556d158f3c90 0x556d158f6080 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556d1576f990 0x556d158f2ee0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fedb4034300 0x7fedb40367c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 --2- 172.21.15.123:0/3525979449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d1576e4d0 0x556d158ec300 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 >> 172.21.15.123:0/3525979449 conn(0x556d157f4860 msgr2=0x556d158dfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 shutdown_connections 2024-03-20T13:37:22.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.518+0000 7feecf76f980 1 -- 172.21.15.123:0/3525979449 wait complete. 2024-03-20T13:37:22.534 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:22.551 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:22.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-03-20T13:37:22.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-03-20T13:37:22.551 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-03-20T13:37:22.607 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:22.608 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:22.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d57f00980 1 Processor -- start 2024-03-20T13:37:22.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d57f00980 1 -- start start 2024-03-20T13:37:22.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d57f00980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ef4dbc48b0 0x55ef4dc52c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d57f00980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ef4db9c520 con 0x55ef4dc53170 2024-03-20T13:37:22.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d57f00980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ef4db630f0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d55a1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ef4dbc48b0 0x55ef4dc52c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d55a1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ef4dbc48b0 0x55ef4dc52c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36624/0 (socket says 172.21.15.123:36624) 2024-03-20T13:37:22.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d5521a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55ef4dc53170 0x55ef4dc55560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:33312/0 (socket says 172.21.15.123:33312) 2024-03-20T13:37:22.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.602+0000 7f9d55a1b640 1 -- 172.21.15.123:0/147810427 learned_addr learned my addr 172.21.15.123:0/147810427 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d55a1b640 1 -- 172.21.15.123:0/147810427 >> v1:172.21.15.89:6789/0 conn(0x55ef4dc53170 legacy=0x55ef4dc55560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d55a1b640 1 -- 172.21.15.123:0/147810427 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4dc57cc0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/147810427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc52c30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800a5c0 tx=0x7f9d4801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919a941bb07b4358 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d54a19640 1 -- 172.21.15.123:0/147810427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480aa470 con 0x55ef4dbc48b0 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d54a19640 1 -- 172.21.15.123:0/147810427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d480aa5d0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d54a19640 1 -- 172.21.15.123:0/147810427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480aa890 con 0x55ef4dbc48b0 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 -- 172.21.15.123:0/147810427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 msgr2=0x55ef4dc52c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 --2- 172.21.15.123:0/147810427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc52c30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800a5c0 tx=0x7f9d4801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 -- 172.21.15.123:0/147810427 shutdown_connections 2024-03-20T13:37:22.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 --2- 172.21.15.123:0/147810427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc52c30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 -- 172.21.15.123:0/147810427 >> 172.21.15.123:0/147810427 conn(0x55ef4dc4a710 msgr2=0x55ef4dc4cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 -- 172.21.15.123:0/147810427 shutdown_connections 2024-03-20T13:37:22.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.606+0000 7f9d57f00980 1 -- 172.21.15.123:0/147810427 wait complete. 2024-03-20T13:37:22.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d57f00980 1 Processor -- start 2024-03-20T13:37:22.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d57f00980 1 -- start start 2024-03-20T13:37:22.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d57f00980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc50390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d57f00980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4db60620 con 0x55ef4dbc48b0 2024-03-20T13:37:22.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d55a1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc50390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d55a1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc50390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36626/0 (socket says 172.21.15.123:36626) 2024-03-20T13:37:22.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.622+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3830012407 learned_addr learned my addr 172.21.15.123:0/3830012407 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3830012407 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48005df0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3830012407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc50390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d48018f70 tx=0x7f9d48003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f81bab9fe0e9054 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9c43e07640 1 -- 172.21.15.123:0/3830012407 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480aa9c0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9c43e07640 1 -- 172.21.15.123:0/3830012407 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d480aab20 con 0x55ef4dbc48b0 2024-03-20T13:37:22.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9c43e07640 1 -- 172.21.15.123:0/3830012407 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480aadc0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- 172.21.15.123:0/3830012407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 msgr2=0x55ef4dc50390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3830012407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc50390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9d48018f70 tx=0x7f9d48003030 comp rx=0 tx=0).stop 2024-03-20T13:37:22.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- 172.21.15.123:0/3830012407 shutdown_connections 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3830012407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dc50390 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- 172.21.15.123:0/3830012407 >> 172.21.15.123:0/3830012407 conn(0x55ef4dc4a710 msgr2=0x55ef4dd35a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- 172.21.15.123:0/3830012407 shutdown_connections 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- 172.21.15.123:0/3830012407 wait complete. 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 Processor -- start 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- start start 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dd42e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4db5be00 con 0x55ef4dbc48b0 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dd42e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dd42e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36628/0 (socket says 172.21.15.123:36628) 2024-03-20T13:37:22.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3249083662 learned_addr learned my addr 172.21.15.123:0/3249083662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4dc57cc0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dd42e40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d48018f70 tx=0x7f9d480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9c42604640 1 -- 172.21.15.123:0/3249083662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480cb070 con 0x55ef4dbc48b0 2024-03-20T13:37:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.626+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef4dd43380 con 0x55ef4dbc48b0 2024-03-20T13:37:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9c42604640 1 -- 172.21.15.123:0/3249083662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d480bd810 con 0x55ef4dbc48b0 2024-03-20T13:37:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef4dd43750 con 0x55ef4dbc48b0 2024-03-20T13:37:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9c42604640 1 -- 172.21.15.123:0/3249083662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d480bdab0 con 0x55ef4dbc48b0 2024-03-20T13:37:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9c42604640 1 -- 172.21.15.123:0/3249083662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d480bdc10 con 0x55ef4dbc48b0 2024-03-20T13:37:22.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9c42604640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c3c034300 0x7f9c3c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9c42604640 1 -- 172.21.15.123:0/3249083662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9d480e4a40 con 0x55ef4dbc48b0 2024-03-20T13:37:22.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d5521a640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c3c034300 0x7f9c3c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dc53170 0x55ef4dd49a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd49f60 con 0x55ef4dc53170 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d5621c640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dc53170 0x55ef4dd49a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d5521a640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c3c034300 0x7f9c3c0367c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000f70 tx=0x7f9d4c001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d5621c640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dc53170 0x55ef4dd49a20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d5621c640 1 -- 172.21.15.123:0/3249083662 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d5000a4d0 con 0x55ef4dc53170 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd4a7d0 0x55ef4dd4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd4d220 con 0x55ef4dd4a7d0 2024-03-20T13:37:22.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd4a7d0 0x55ef4dd4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.630+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd4a7d0 0x55ef4dd4cbc0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3249083662 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd4a7d0 2024-03-20T13:37:22.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd4ea60 con 0x55ef4dd4a7d0 2024-03-20T13:37:22.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3249083662 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd4a7d0 2024-03-20T13:37:22.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd4dba0 con 0x55ef4dd4a7d0 2024-03-20T13:37:22.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3249083662 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd4a7d0 2024-03-20T13:37:22.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd4dfb0 con 0x55ef4dc53170 2024-03-20T13:37:22.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d5621c640 1 -- 172.21.15.123:0/3249083662 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9d5000a4d0 con 0x55ef4dc53170 2024-03-20T13:37:22.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 Processor -- start 2024-03-20T13:37:22.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 -- start start 2024-03-20T13:37:22.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 0x55ef4dd5d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d57f00980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4daf4e30 con 0x55ef4dd5d130 2024-03-20T13:37:22.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d5621c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 0x55ef4dd5d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d5621c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 0x55ef4dd5d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36638/0 (socket says 172.21.15.123:36638) 2024-03-20T13:37:22.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d5621c640 1 -- 172.21.15.123:0/1568729297 learned_addr learned my addr 172.21.15.123:0/1568729297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d5621c640 1 -- 172.21.15.123:0/1568729297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4dd5da90 con 0x55ef4dd5d130 2024-03-20T13:37:22.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.634+0000 7f9d5621c640 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 0x55ef4dd5d550 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016cf0 tx=0x7f9d5000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c3b7fe640 1 -- 172.21.15.123:0/1568729297 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d50017660 con 0x55ef4dd5d130 2024-03-20T13:37:22.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c3b7fe640 1 -- 172.21.15.123:0/1568729297 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d500177c0 con 0x55ef4dd5d130 2024-03-20T13:37:22.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef4dd5dce0 con 0x55ef4dd5d130 2024-03-20T13:37:22.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c3b7fe640 1 -- 172.21.15.123:0/1568729297 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d50017a60 con 0x55ef4dd5d130 2024-03-20T13:37:22.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef4dd5e830 con 0x55ef4dd5d130 2024-03-20T13:37:22.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c3b7fe640 1 -- 172.21.15.123:0/1568729297 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d5001d020 con 0x55ef4dd5d130 2024-03-20T13:37:22.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c3b7fe640 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c30034300 0x7f9c300367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c3b7fe640 1 -- 172.21.15.123:0/1568729297 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9d5004b2d0 con 0x55ef4dd5d130 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c30034300 0x7f9c300367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 Processor -- start 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- start start 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd6a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c30034300 0x7f9c300367c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55ef4dd4d6a0 tx=0x7f9d480e2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4dae8790 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d5621c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd6a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d5621c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd6a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36652/0 (socket says 172.21.15.123:36652) 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d5621c640 1 -- 172.21.15.123:0/1352178124 learned_addr learned my addr 172.21.15.123:0/1352178124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d5621c640 1 -- 172.21.15.123:0/1352178124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4dd6aaa0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d5621c640 1 --2- 172.21.15.123:0/1352178124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd6a4d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000a100 tx=0x7f9d50049810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc3e5c88d39cd88 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c397fa640 1 -- 172.21.15.123:0/1352178124 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d50014710 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c397fa640 1 -- 172.21.15.123:0/1352178124 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5004b0d0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9c397fa640 1 -- 172.21.15.123:0/1352178124 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d5003b2e0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- 172.21.15.123:0/1352178124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 msgr2=0x55ef4dd6a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 --2- 172.21.15.123:0/1352178124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd6a4d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000a100 tx=0x7f9d50049810 comp rx=0 tx=0).stop 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- 172.21.15.123:0/1352178124 shutdown_connections 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 --2- 172.21.15.123:0/1352178124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd6a4d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.638+0000 7f9d57f00980 1 -- 172.21.15.123:0/1352178124 >> 172.21.15.123:0/1352178124 conn(0x55ef4dd66410 msgr2=0x55ef4dd64470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- 172.21.15.123:0/1352178124 shutdown_connections 2024-03-20T13:37:22.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- 172.21.15.123:0/1352178124 wait complete. 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 Processor -- start 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- start start 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd70f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4dd714d0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d5621c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd70f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d5621c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd70f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:36666/0 (socket says 172.21.15.123:36666) 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 learned_addr learned my addr 172.21.15.123:0/3829563840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4dd5e830 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d5621c640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd70f90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9d5003a060 tx=0x7f9d500494f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9c277fe640 1 -- 172.21.15.123:0/3829563840 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d50014710 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9c277fe640 1 -- 172.21.15.123:0/3829563840 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50011cb0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef4dd716d0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9c277fe640 1 -- 172.21.15.123:0/3829563840 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d50049970 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef4dd71b00 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9c277fe640 1 -- 172.21.15.123:0/3829563840 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d50049be0 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9c277fe640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c200342b0 0x7f9c20036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9c277fe640 1 -- 172.21.15.123:0/3829563840 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9d50044070 con 0x55ef4dd6a0d0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c200342b0 0x7f9c20036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dd7c670 0x55ef4dd7eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd7f280 con 0x55ef4dd7c670 2024-03-20T13:37:22.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c200342b0 0x7f9c20036770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d480a7020 tx=0x7f9d4801b340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.642+0000 7f9d5521a640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dd7c670 0x55ef4dd7eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5521a640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dd7c670 0x55ef4dd7eb30 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 realm 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd7bad0 con 0x55ef4dd7c670 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd7fd00 con 0x55ef4dd7c670 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd80a90 0x55ef4dd82e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd83500 con 0x55ef4dd80a90 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5621c640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd80a90 0x55ef4dd82e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5621c640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd80a90 0x55ef4dd82e80 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd83d00 con 0x55ef4dd80a90 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 20 searching for the correct realm 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ef4dd85d00 0x55ef4dd881c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd85d00 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.646+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ef4dd85d00 0x55ef4dd881c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d55a1b640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ef4dd85d00 0x55ef4dd881c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd80a90 2024-03-20T13:37:22.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5621c640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9d5002ac20 0x7f9d50005000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x7f9d5002ac20 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9d5002ac20 0x7f9d50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9d5002ac20 0x7f9d50005000 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd7c670 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd7c670 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd85d00 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd7c670 2024-03-20T13:37:22.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd80a90 2024-03-20T13:37:22.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.650+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd80a90 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd7c670 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x7f9d5002ac20 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88890 con 0x55ef4dd7c670 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x7f9d5002ac20 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd80a90 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd85d00 2024-03-20T13:37:22.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd7c670 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.654+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd80a90 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd85d00 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd7c670 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd7c670 2024-03-20T13:37:22.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd7c670 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd85d00 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x7f9d5002ac20 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd7c670 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x7f9d5002ac20 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd85d00 2024-03-20T13:37:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x7f9d5002ac20 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd80a90 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.658+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd80a90 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd85d00 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd80a90 2024-03-20T13:37:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f9d4c02d080 con 0x55ef4dd80a90 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd85260 con 0x55ef4dd7c670 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd846a0 con 0x55ef4dd80a90 2024-03-20T13:37:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.662+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd846c0 con 0x55ef4dd7c670 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 zone default found 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 4 Realm: () 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 zonegroup default 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd88cd0 con 0x7f9d5002ac20 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8aeb0 con 0x55ef4dd85d00 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8b210 con 0x55ef4dd85d00 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 started sync module instance, tier type = 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:22.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8a480 con 0x55ef4dd80a90 2024-03-20T13:37:22.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94486291589168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8a480 con 0x55ef4dd80a90 2024-03-20T13:37:22.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.666+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8bbc0 con 0x55ef4dd7c670 2024-03-20T13:37:22.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94486291592928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8c440 con 0x55ef4dd7c670 2024-03-20T13:37:22.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8ce40 con 0x55ef4dd80a90 2024-03-20T13:37:22.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94486291589168] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94486291592928] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94486291597632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8bfa0 con 0x55ef4dd80a90 2024-03-20T13:37:22.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.670+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8d690 con 0x7f9d5002ac20 2024-03-20T13:37:22.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94486291599856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8bfa0 con 0x7f9d5002ac20 2024-03-20T13:37:22.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8e160 con 0x55ef4dd80a90 2024-03-20T13:37:22.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94486291597632] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94486291599856] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94486291600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8e160 con 0x55ef4dd80a90 2024-03-20T13:37:22.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8e510 con 0x55ef4dd85d00 2024-03-20T13:37:22.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94486291602512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8ed10 con 0x55ef4dd85d00 2024-03-20T13:37:22.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.674+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8f720 con 0x55ef4dd85d00 2024-03-20T13:37:22.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94486291600912] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94486291602512] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94486291587040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8e870 con 0x55ef4dd85d00 2024-03-20T13:37:22.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8ff70 con 0x7f9d5002ac20 2024-03-20T13:37:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94486291610320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd90390 con 0x7f9d5002ac20 2024-03-20T13:37:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=0 2024-03-20T13:37:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=1 2024-03-20T13:37:22.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=2 2024-03-20T13:37:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=3 2024-03-20T13:37:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=4 2024-03-20T13:37:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=5 2024-03-20T13:37:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94486291587040] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=6 2024-03-20T13:37:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94486291610320] v34'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 20 add_watcher() i=7 2024-03-20T13:37:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.678+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd93050 con 0x55ef4dd7c670 2024-03-20T13:37:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94486291608080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd90390 con 0x55ef4dd7c670 2024-03-20T13:37:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94486291608080] v34'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9c077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9d57f00980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9d57f00980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.682+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd92500 con 0x55ef4dd80a90 2024-03-20T13:37:22.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.686+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.686+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd925b0 con 0x7f9d5002ac20 2024-03-20T13:37:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.686+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.686+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9c0d0 con 0x55ef4dd85d00 2024-03-20T13:37:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.686+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.686+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9c570 con 0x55ef4dd7c670 2024-03-20T13:37:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.690+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.690+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9c7d0 con 0x55ef4dd80a90 2024-03-20T13:37:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.694+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'66 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.694+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9cd40 con 0x55ef4dd85d00 2024-03-20T13:37:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.694+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.694+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9d270 con 0x55ef4dd80a90 2024-03-20T13:37:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.694+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.694+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9d710 con 0x55ef4dd7c670 2024-03-20T13:37:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.698+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.698+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9d710 con 0x55ef4dd80a90 2024-03-20T13:37:22.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.698+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.698+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9d710 con 0x55ef4dd80a90 2024-03-20T13:37:22.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.702+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.702+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9d710 con 0x55ef4dd80a90 2024-03-20T13:37:22.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.706+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'67 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.706+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9d710 con 0x55ef4dd85d00 2024-03-20T13:37:22.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.706+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.706+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9dc80 con 0x55ef4dd80a90 2024-03-20T13:37:22.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.710+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.710+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9dc80 con 0x55ef4dd7c670 2024-03-20T13:37:22.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.710+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.710+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9dc80 con 0x55ef4dd7c670 2024-03-20T13:37:22.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.714+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.714+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9dd10 con 0x55ef4dd80a90 2024-03-20T13:37:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.714+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.714+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9dd10 con 0x55ef4dd80a90 2024-03-20T13:37:22.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.718+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'68 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.718+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9dd10 con 0x55ef4dd85d00 2024-03-20T13:37:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.722+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.722+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd80a90 2024-03-20T13:37:22.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.722+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.722+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd7c670 2024-03-20T13:37:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.726+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.726+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd80a90 2024-03-20T13:37:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.730+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.730+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd80a90 2024-03-20T13:37:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.730+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.730+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd85d00 2024-03-20T13:37:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.734+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.734+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd80a90 2024-03-20T13:37:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.738+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.738+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd85d00 2024-03-20T13:37:22.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.738+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.738+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd85d00 2024-03-20T13:37:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.742+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.742+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd85d00 2024-03-20T13:37:22.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.742+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.742+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd80a90 2024-03-20T13:37:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.746+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.746+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd7c670 2024-03-20T13:37:22.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.746+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.746+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd80a90 2024-03-20T13:37:22.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.750+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.750+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x55ef4dd7c670 2024-03-20T13:37:22.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd9e260 con 0x7f9d5002ac20 2024-03-20T13:37:22.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9c067fc640 20 reqs_thread_entry: start 2024-03-20T13:37:22.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d57f00980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:22.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d57f00980 20 Filter name: none 2024-03-20T13:37:22.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9b77fff640 20 reqs_thread_entry: start 2024-03-20T13:37:22.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d57f00980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:37:22.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d57f00980 20 rados->read ofs=0 len=0 2024-03-20T13:37:22.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.754+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd99a00 con 0x55ef4dd7c670 2024-03-20T13:37:22.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d57f00980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d57f00980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d57f00980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d57f00980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4ddba4f0 con 0x7f9d5002ac20 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.763 INFO:teuthology.orchestra.run.smithi123.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-03-20T13:37:22.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9c077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:22.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.758+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94486291608080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd99570 con 0x55ef4dd7c670 2024-03-20T13:37:22.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.762+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94486291608080] v34'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.762+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94486291589168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd99570 con 0x55ef4dd80a90 2024-03-20T13:37:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94486291589168] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d57f00980 20 remove_watcher() i=0 2024-03-20T13:37:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d57f00980 2 removed watcher, disabling cache 2024-03-20T13:37:22.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94486291592928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8a830 con 0x55ef4dd7c670 2024-03-20T13:37:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94486291592928] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x55ef4dd7c670 2024-03-20T13:37:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d57f00980 20 remove_watcher() i=1 2024-03-20T13:37:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.766+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94486291597632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8a830 con 0x55ef4dd80a90 2024-03-20T13:37:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.770+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94486291597632] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.770+0000 7f9d57f00980 20 remove_watcher() i=2 2024-03-20T13:37:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.770+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94486291599856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8a830 con 0x7f9d5002ac20 2024-03-20T13:37:22.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.770+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94486291599856] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.770+0000 7f9d57f00980 20 remove_watcher() i=3 2024-03-20T13:37:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.770+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94486291600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8a830 con 0x55ef4dd80a90 2024-03-20T13:37:22.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d5621c640 1 -- 172.21.15.123:0/3829563840 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94486291600912] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d50053040 con 0x55ef4dd80a90 2024-03-20T13:37:22.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d57f00980 20 remove_watcher() i=4 2024-03-20T13:37:22.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94486291602512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8d690 con 0x55ef4dd85d00 2024-03-20T13:37:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94486291602512] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d57f00980 20 remove_watcher() i=5 2024-03-20T13:37:22.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94486291587040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8d690 con 0x55ef4dd85d00 2024-03-20T13:37:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d55a1b640 1 -- 172.21.15.123:0/3829563840 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94486291587040] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d480cd070 con 0x55ef4dd85d00 2024-03-20T13:37:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d57f00980 20 remove_watcher() i=6 2024-03-20T13:37:22.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.774+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94486291610320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ef4dd8d690 con 0x7f9d5002ac20 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94486291610320] v34'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d4c00f620 con 0x7f9d5002ac20 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 20 remove_watcher() i=7 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd80a90 msgr2=0x55ef4dd82e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd80a90 0x55ef4dd82e80 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dd7c670 msgr2=0x55ef4dd7eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dd7c670 0x55ef4dd7eb30 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9d5002ac20 msgr2=0x7f9d50005000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9d5002ac20 0x7f9d50005000 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ef4dd85d00 msgr2=0x55ef4dd881c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ef4dd85d00 0x55ef4dd881c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c200342b0 msgr2=0x7f9c20036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c200342b0 0x7f9c20036770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d480a7020 tx=0x7f9d4801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 msgr2=0x55ef4dd70f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d5521a640 1 -- 172.21.15.123:0/3829563840 reap_dead start 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd70f90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9d5003a060 tx=0x7f9d500494f0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 shutdown_connections 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3829563840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd6a0d0 0x55ef4dd70f90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 >> 172.21.15.123:0/3829563840 conn(0x55ef4dd66410 msgr2=0x55ef4dd63a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 shutdown_connections 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3829563840 wait complete. 2024-03-20T13:37:22.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c30034300 msgr2=0x7f9c300367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c30034300 0x7f9c300367c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55ef4dd4d6a0 tx=0x7f9d480e2040 comp rx=0 tx=0).stop 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 msgr2=0x55ef4dd5d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 0x55ef4dd5d550 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016cf0 tx=0x7f9d5000d790 comp rx=0 tx=0).stop 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 shutdown_connections 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c30034300 0x7f9c300367c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/1568729297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dd5d130 0x55ef4dd5d550 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 >> 172.21.15.123:0/1568729297 conn(0x55ef4dd51f40 msgr2=0x55ef4dd52a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 shutdown_connections 2024-03-20T13:37:22.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/1568729297 wait complete. 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd4a7d0 msgr2=0x55ef4dd4cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd4a7d0 0x55ef4dd4cbc0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dc53170 msgr2=0x55ef4dd49a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dc53170 0x55ef4dd49a20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c3c034300 msgr2=0x7f9c3c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c3c034300 0x7f9c3c0367c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000f70 tx=0x7f9d4c001380 comp rx=0 tx=0).stop 2024-03-20T13:37:22.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 msgr2=0x55ef4dd42e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dd42e40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d48018f70 tx=0x7f9d480180e0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 shutdown_connections 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ef4dd4a7d0 0x55ef4dd4cbc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ef4dc53170 0x55ef4dd49a20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9c3c034300 0x7f9c3c0367c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 --2- 172.21.15.123:0/3249083662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ef4dbc48b0 0x55ef4dd42e40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 >> 172.21.15.123:0/3249083662 conn(0x55ef4dc4a710 msgr2=0x55ef4dc4ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 shutdown_connections 2024-03-20T13:37:22.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:22.778+0000 7f9d57f00980 1 -- 172.21.15.123:0/3249083662 wait complete. 2024-03-20T13:37:22.797 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:37:22.818 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:22.862 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-03-20T13:37:57.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-03-20T13:37:57.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-03-20T13:37:57.865 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-03-20T13:37:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:57.904 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e084e6980 1 Processor -- start 2024-03-20T13:37:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e084e6980 1 -- start start 2024-03-20T13:37:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e084e6980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ac1e7a0130 0x55ac1e7a0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e084e6980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ac1e6ea520 con 0x55ac1e7a0a50 2024-03-20T13:37:57.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e084e6980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ac1e6b10f0 con 0x55ac1e7a0130 2024-03-20T13:37:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e06001640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ac1e7a0130 0x55ac1e7a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e06001640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ac1e7a0130 0x55ac1e7a0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49252/0 (socket says 172.21.15.123:49252) 2024-03-20T13:37:57.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e06001640 1 -- 172.21.15.123:0/572344076 learned_addr learned my addr 172.21.15.123:0/572344076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e06001640 1 -- 172.21.15.123:0/572344076 >> v1:172.21.15.89:6789/0 conn(0x55ac1e7a0a50 legacy=0x55ac1e7a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.902+0000 7f9e06001640 1 -- 172.21.15.123:0/572344076 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1e7a1c30 con 0x55ac1e7a0130 2024-03-20T13:37:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e06001640 1 --2- 172.21.15.123:0/572344076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e7a0510 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9df800a4e0 tx=0x7f9df801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960f9e635e9318bb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e04fff640 1 -- 172.21.15.123:0/572344076 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9df80aa540 con 0x55ac1e7a0130 2024-03-20T13:37:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e04fff640 1 -- 172.21.15.123:0/572344076 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80a6070 con 0x55ac1e7a0130 2024-03-20T13:37:57.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e04fff640 1 -- 172.21.15.123:0/572344076 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9df80aa850 con 0x55ac1e7a0130 2024-03-20T13:37:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 -- 172.21.15.123:0/572344076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 msgr2=0x55ac1e7a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 --2- 172.21.15.123:0/572344076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e7a0510 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9df800a4e0 tx=0x7f9df801b090 comp rx=0 tx=0).stop 2024-03-20T13:37:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 -- 172.21.15.123:0/572344076 shutdown_connections 2024-03-20T13:37:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 --2- 172.21.15.123:0/572344076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e7a0510 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 -- 172.21.15.123:0/572344076 >> 172.21.15.123:0/572344076 conn(0x55ac1e713850 msgr2=0x55ac1e713c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:57.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 -- 172.21.15.123:0/572344076 shutdown_connections 2024-03-20T13:37:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.906+0000 7f9e084e6980 1 -- 172.21.15.123:0/572344076 wait complete. 2024-03-20T13:37:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 Processor -- start 2024-03-20T13:37:57.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- start start 2024-03-20T13:37:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e88a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1e6ae620 con 0x55ac1e7a0130 2024-03-20T13:37:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e06001640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e88a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e06001640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e88a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49264/0 (socket says 172.21.15.123:49264) 2024-03-20T13:37:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e06001640 1 -- 172.21.15.123:0/3094927549 learned_addr learned my addr 172.21.15.123:0/3094927549 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e06001640 1 -- 172.21.15.123:0/3094927549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df800a1c0 con 0x55ac1e7a0130 2024-03-20T13:37:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e06001640 1 --2- 172.21.15.123:0/3094927549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e88a650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9df8017ca0 tx=0x7f9df80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2256fb66700164d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9cf3e07640 1 -- 172.21.15.123:0/3094927549 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9df80aa780 con 0x55ac1e7a0130 2024-03-20T13:37:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9cf3e07640 1 -- 172.21.15.123:0/3094927549 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80aa8e0 con 0x55ac1e7a0130 2024-03-20T13:37:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9cf3e07640 1 -- 172.21.15.123:0/3094927549 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9df80aab80 con 0x55ac1e7a0130 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- 172.21.15.123:0/3094927549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 msgr2=0x55ac1e88a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3094927549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e88a650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9df8017ca0 tx=0x7f9df80033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- 172.21.15.123:0/3094927549 shutdown_connections 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3094927549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e88a650 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- 172.21.15.123:0/3094927549 >> 172.21.15.123:0/3094927549 conn(0x55ac1e713850 msgr2=0x55ac1e8861e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- 172.21.15.123:0/3094927549 shutdown_connections 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.922+0000 7f9e084e6980 1 -- 172.21.15.123:0/3094927549 wait complete. 2024-03-20T13:37:57.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 Processor -- start 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 -- start start 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e8913a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1e6a9e00 con 0x55ac1e7a0130 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e06001640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e8913a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e06001640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e8913a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49280/0 (socket says 172.21.15.123:49280) 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e06001640 1 -- 172.21.15.123:0/1595031318 learned_addr learned my addr 172.21.15.123:0/1595031318 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:57.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e06001640 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1e7a1c30 con 0x55ac1e7a0130 2024-03-20T13:37:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e06001640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e8913a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9df801aec0 tx=0x7f9df8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9cf2604640 1 -- 172.21.15.123:0/1595031318 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9df80c4070 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ac1e8918e0 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9cf2604640 1 -- 172.21.15.123:0/1595031318 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80b5650 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9cf2604640 1 -- 172.21.15.123:0/1595031318 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9df80b58f0 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac1e891d10 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9cf2604640 1 -- 172.21.15.123:0/1595031318 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9df80a8070 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9cf2604640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cec0342b0 0x7f9cec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9cf2604640 1 -- 172.21.15.123:0/1595031318 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9df80e3810 con 0x55ac1e7a0130 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e05800640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cec0342b0 0x7f9cec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e7a0a50 0x55ac1e897fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.926+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e898510 con 0x55ac1e7a0a50 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06802640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e7a0a50 0x55ac1e897fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e05800640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cec0342b0 0x7f9cec036770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9df0001e20 tx=0x7f9df00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06802640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e7a0a50 0x55ac1e897fd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06802640 1 -- 172.21.15.123:0/1595031318 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9e000083f0 con 0x55ac1e7a0a50 2024-03-20T13:37:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e898d80 0x55ac1e89b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e89b800 con 0x55ac1e898d80 2024-03-20T13:37:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06001640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e898d80 0x55ac1e89b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06001640 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e898d80 0x55ac1e89b170 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06001640 1 -- 172.21.15.123:0/1595031318 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e898d80 2024-03-20T13:37:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e89d060 con 0x55ac1e898d80 2024-03-20T13:37:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e06001640 1 -- 172.21.15.123:0/1595031318 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e898d80 2024-03-20T13:37:57.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.930+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e89c1a0 con 0x55ac1e898d80 2024-03-20T13:37:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06001640 1 -- 172.21.15.123:0/1595031318 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e898d80 2024-03-20T13:37:57.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e89c5b0 con 0x55ac1e7a0a50 2024-03-20T13:37:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06802640 1 -- 172.21.15.123:0/1595031318 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9e000083f0 con 0x55ac1e7a0a50 2024-03-20T13:37:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 Processor -- start 2024-03-20T13:37:57.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 -- start start 2024-03-20T13:37:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 0x55ac1e8abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1e642e30 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06802640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 0x55ac1e8abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06802640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 0x55ac1e8abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49286/0 (socket says 172.21.15.123:49286) 2024-03-20T13:37:57.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06802640 1 -- 172.21.15.123:0/897669339 learned_addr learned my addr 172.21.15.123:0/897669339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06802640 1 -- 172.21.15.123:0/897669339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1e8ac100 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e06802640 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 0x55ac1e8abbc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000aae0 tx=0x7f9e00008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9ceb7fe640 1 -- 172.21.15.123:0/897669339 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e0001d070 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9ceb7fe640 1 -- 172.21.15.123:0/897669339 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00010040 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ac1e8ac350 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9ceb7fe640 1 -- 172.21.15.123:0/897669339 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e00007e70 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.934+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac1e8acea0 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9ceb7fe640 1 -- 172.21.15.123:0/897669339 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9e00018430 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9ceb7fe640 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9ce00342b0 0x7f9ce0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9ceb7fe640 1 -- 172.21.15.123:0/897669339 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9e0004a780 con 0x55ac1e8ab7a0 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06001640 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9ce00342b0 0x7f9ce0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 Processor -- start 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- start start 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06001640 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9ce00342b0 0x7f9ce0036770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55ac1e89bca0 tx=0x7f9df80b4f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1e636790 con 0x55ac1e8b8720 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06802640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06802640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49288/0 (socket says 172.21.15.123:49288) 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06802640 1 -- 172.21.15.123:0/3547717275 learned_addr learned my addr 172.21.15.123:0/3547717275 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06802640 1 -- 172.21.15.123:0/3547717275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1e8b9110 con 0x55ac1e8b8720 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e06802640 1 --2- 172.21.15.123:0/3547717275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8b8b40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9e00048a10 tx=0x7f9e00020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35ae9349d9feb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9ce97fa640 1 -- 172.21.15.123:0/3547717275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e00047070 con 0x55ac1e8b8720 2024-03-20T13:37:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9ce97fa640 1 -- 172.21.15.123:0/3547717275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00021790 con 0x55ac1e8b8720 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9ce97fa640 1 -- 172.21.15.123:0/3547717275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e00039240 con 0x55ac1e8b8720 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- 172.21.15.123:0/3547717275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 msgr2=0x55ac1e8b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3547717275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8b8b40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9e00048a10 tx=0x7f9e00020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- 172.21.15.123:0/3547717275 shutdown_connections 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3547717275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8b8b40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- 172.21.15.123:0/3547717275 >> 172.21.15.123:0/3547717275 conn(0x55ac1e8b4a60 msgr2=0x55ac1e8b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- 172.21.15.123:0/3547717275 shutdown_connections 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- 172.21.15.123:0/3547717275 wait complete. 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 Processor -- start 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- start start 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8bf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.938+0000 7f9e084e6980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1e8bfac0 con 0x55ac1e8b8720 2024-03-20T13:37:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06802640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06802640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49302/0 (socket says 172.21.15.123:49302) 2024-03-20T13:37:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 learned_addr learned my addr 172.21.15.123:0/3411101085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1e8acea0 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06802640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8bf580 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9e000077a0 tx=0x7f9e000489a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9cd77fe640 1 -- 172.21.15.123:0/3411101085 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e00048c10 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9cd77fe640 1 -- 172.21.15.123:0/3411101085 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0003a940 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ac1e8bfcc0 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9cd77fe640 1 -- 172.21.15.123:0/3411101085 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e0003ac20 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac1e8c0150 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9cd77fe640 1 -- 172.21.15.123:0/3411101085 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9e00018730 con 0x55ac1e8b8720 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9cd77fe640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cd00342b0 0x7f9cd0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9cd77fe640 1 -- 172.21.15.123:0/3411101085 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9e00036d20 con 0x55ac1e8b8720 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06001640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cd00342b0 0x7f9cd0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e8cac90 0x55ac1e8cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8cd8a0 con 0x55ac1e8cac90 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e05800640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e8cac90 0x55ac1e8cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e06001640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cd00342b0 0x7f9cd0036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9df80e3b40 tx=0x7f9df80e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e05800640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e8cac90 0x55ac1e8cd150 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 20 realm 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.942+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8ca170 con 0x55ac1e8cac90 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8ce320 con 0x55ac1e8cac90 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e8cf0b0 0x55ac1e8d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d1b50 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06802640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e8cf0b0 0x55ac1e8d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06802640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e8cf0b0 0x55ac1e8d14a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9e00032070 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d23a0 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9e00032070 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 20 searching for the correct realm 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ac1e8d40c0 0x55ac1e8d64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06001640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ac1e8d40c0 0x55ac1e8d64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06001640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ac1e8d40c0 0x55ac1e8d64b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.946+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e00032070 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9e00035020 0x7f9e0004aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x7f9e00035020 2024-03-20T13:37:57.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9e00035020 0x7f9e0004aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9e00035020 0x7f9e0004aa60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x7f9e00035020 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e00032070 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e00032070 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.950+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x7f9e00035020 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x7f9e00035020 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x7f9e00035020 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9df00105b0 con 0x7f9e00035020 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df00105b0 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.954+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x7f9e00035020 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cac90 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x7f9e00035020 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x7f9e00035020 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8d40c0 2024-03-20T13:37:57.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.958+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6a40 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d2ca0 con 0x55ac1e8cac90 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d30e0 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d34c0 con 0x55ac1e8cac90 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 zone default found 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 4 Realm: () 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 zonegroup default 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d6e80 con 0x7f9e00035020 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d9060 con 0x55ac1e8d40c0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados->read ofs=0 len=0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d93c0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:57.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 started sync module instance, tier type = 2024-03-20T13:37:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.962+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d8630 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94197735328224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d8630 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d9d70 con 0x55ac1e8cac90 2024-03-20T13:37:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94197735331984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d9cb0 con 0x55ac1e8cac90 2024-03-20T13:37:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dac50 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.966+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94197735328224] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94197735331984] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94197735334176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dac10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8db4a0 con 0x7f9e00035020 2024-03-20T13:37:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94197735337984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dac10 con 0x7f9e00035020 2024-03-20T13:37:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dbf90 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94197735334176] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.970+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94197735337984] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94197735340688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dbf50 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dc360 con 0x55ac1e8d40c0 2024-03-20T13:37:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94197735339040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dcbb0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dd560 con 0x55ac1e8d40c0 2024-03-20T13:37:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94197735340688] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94197735339040] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94197735335728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dc710 con 0x55ac1e8d40c0 2024-03-20T13:37:57.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.974+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dddb0 con 0x7f9e00035020 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94197735335728] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94197735346304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dc710 con 0x7f9e00035020 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=0 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=1 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=2 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=3 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=4 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=5 2024-03-20T13:37:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=6 2024-03-20T13:37:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94197735346304] v34'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 20 add_watcher() i=7 2024-03-20T13:37:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8e0f50 con 0x55ac1e8cac90 2024-03-20T13:37:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.978+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94197735348496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8de460 con 0x55ac1e8cac90 2024-03-20T13:37:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94197735348496] v34'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9cb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 5 note: GC not initialized 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9cb67fc640 20 reqs_thread_entry: start 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 20 Filter name: none 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9c27fff640 20 reqs_thread_entry: start 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.982+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8cac90 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8cac90 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e9035d0 con 0x55ac1e8d40c0 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f80 con 0x55ac1e8cac90 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f80 con 0x7f9e00035020 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f80 con 0x55ac1e8d40c0 2024-03-20T13:37:57.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f80 con 0x7f9e00035020 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.986+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f80 con 0x55ac1e8cac90 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f80 con 0x55ac1e8d40c0 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cac90 2024-03-20T13:37:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8d40c0 2024-03-20T13:37:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8d40c0 2024-03-20T13:37:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cac90 2024-03-20T13:37:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.990+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cac90 2024-03-20T13:37:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8d40c0 2024-03-20T13:37:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8d40c0 2024-03-20T13:37:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e904f10 con 0x55ac1e8cac90 2024-03-20T13:37:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.994+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.998+0000 7f9cb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.998+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94197735348496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e901320 con 0x55ac1e8cac90 2024-03-20T13:37:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.998+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94197735348496] v34'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:57.998+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94197735328224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dd910 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94197735328224] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e084e6980 20 remove_watcher() i=0 2024-03-20T13:37:58.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e084e6980 2 removed watcher, disabling cache 2024-03-20T13:37:58.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94197735331984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d89e0 con 0x55ac1e8cac90 2024-03-20T13:37:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94197735331984] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x55ac1e8cac90 2024-03-20T13:37:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e084e6980 20 remove_watcher() i=1 2024-03-20T13:37:58.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.002+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94197735334176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d9890 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94197735334176] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e084e6980 20 remove_watcher() i=2 2024-03-20T13:37:58.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94197735337984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d9890 con 0x7f9e00035020 2024-03-20T13:37:58.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94197735337984] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:58.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e084e6980 20 remove_watcher() i=3 2024-03-20T13:37:58.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94197735340688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8d9890 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e06802640 1 -- 172.21.15.123:0/3411101085 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94197735340688] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e0005f040 con 0x55ac1e8cf0b0 2024-03-20T13:37:58.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e084e6980 20 remove_watcher() i=4 2024-03-20T13:37:58.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.006+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94197735339040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dba90 con 0x55ac1e8d40c0 2024-03-20T13:37:58.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94197735339040] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:58.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e084e6980 20 remove_watcher() i=5 2024-03-20T13:37:58.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94197735335728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dba90 con 0x55ac1e8d40c0 2024-03-20T13:37:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e06001640 1 -- 172.21.15.123:0/3411101085 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94197735335728] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df80b4c00 con 0x55ac1e8d40c0 2024-03-20T13:37:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e084e6980 20 remove_watcher() i=6 2024-03-20T13:37:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94197735346304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55ac1e8dba90 con 0x7f9e00035020 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94197735346304] v34'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9df0028040 con 0x7f9e00035020 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.010+0000 7f9e084e6980 20 remove_watcher() i=7 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e8cf0b0 msgr2=0x55ac1e8d14a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e8cf0b0 0x55ac1e8d14a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e8cac90 msgr2=0x55ac1e8cd150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e8cac90 0x55ac1e8cd150 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9e00035020 msgr2=0x7f9e0004aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9e00035020 0x7f9e0004aa60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ac1e8d40c0 msgr2=0x55ac1e8d64b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55ac1e8d40c0 0x55ac1e8d64b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cd00342b0 msgr2=0x7f9cd0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cd00342b0 0x7f9cd0036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9df80e3b40 tx=0x7f9df80e4000 comp rx=0 tx=0).stop 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 msgr2=0x55ac1e8bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e05800640 1 -- 172.21.15.123:0/3411101085 reap_dead start 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8bf580 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9e000077a0 tx=0x7f9e000489a0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 shutdown_connections 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/3411101085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8b8720 0x55ac1e8bf580 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 >> 172.21.15.123:0/3411101085 conn(0x55ac1e8b4a60 msgr2=0x55ac1e8b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 shutdown_connections 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/3411101085 wait complete. 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9ce00342b0 msgr2=0x7f9ce0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9ce00342b0 0x7f9ce0036770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55ac1e89bca0 tx=0x7f9df80b4f50 comp rx=0 tx=0).stop 2024-03-20T13:37:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 msgr2=0x55ac1e8abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 0x55ac1e8abbc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000aae0 tx=0x7f9e00008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 shutdown_connections 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9ce00342b0 0x7f9ce0036770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/897669339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e8ab7a0 0x55ac1e8abbc0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 >> 172.21.15.123:0/897669339 conn(0x55ac1e8a05b0 msgr2=0x55ac1e8a10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 shutdown_connections 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/897669339 wait complete. 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e898d80 msgr2=0x55ac1e89b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e898d80 0x55ac1e89b170 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e7a0a50 msgr2=0x55ac1e897fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e7a0a50 0x55ac1e897fd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cec0342b0 msgr2=0x7f9cec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cec0342b0 0x7f9cec036770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9df0001e20 tx=0x7f9df00013a0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 msgr2=0x55ac1e8913a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e8913a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9df801aec0 tx=0x7f9df8017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 shutdown_connections 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55ac1e898d80 0x55ac1e89b170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55ac1e7a0a50 0x55ac1e897fd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9cec0342b0 0x7f9cec036770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 --2- 172.21.15.123:0/1595031318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac1e7a0130 0x55ac1e8913a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 >> 172.21.15.123:0/1595031318 conn(0x55ac1e713850 msgr2=0x55ac1e884cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 shutdown_connections 2024-03-20T13:37:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.014+0000 7f9e084e6980 1 -- 172.21.15.123:0/1595031318 wait complete. 2024-03-20T13:37:58.030 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-03-20T13:37:58.030 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-03-20T13:37:58.030 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-03-20T13:37:58.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-03-20T13:37:58.030 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-03-20T13:37:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.098+0000 7fa5ede31980 1 Processor -- start 2024-03-20T13:37:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.098+0000 7fa5ede31980 1 -- start start 2024-03-20T13:37:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.098+0000 7fa5ede31980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5638a3eba0a0 0x5638a3f4afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.098+0000 7fa5ede31980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5638a3e92510 con 0x5638a3f4b4e0 2024-03-20T13:37:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.098+0000 7fa5ede31980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638a3e590f0 con 0x5638a3eba0a0 2024-03-20T13:37:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb94c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5638a3eba0a0 0x5638a3f4afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb94c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5638a3eba0a0 0x5638a3f4afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49318/0 (socket says 172.21.15.123:49318) 2024-03-20T13:37:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb14b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5638a3f4b4e0 0x5638a3f4d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:51922/0 (socket says 172.21.15.123:51922) 2024-03-20T13:37:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb94c640 1 -- 172.21.15.123:0/3117355687 learned_addr learned my addr 172.21.15.123:0/3117355687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb94c640 1 -- 172.21.15.123:0/3117355687 >> v1:172.21.15.89:6789/0 conn(0x5638a3f4b4e0 legacy=0x5638a3f4d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb94c640 1 -- 172.21.15.123:0/3117355687 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638a3f50000 con 0x5638a3eba0a0 2024-03-20T13:37:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/3117355687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a3f4afa0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00a4e0 tx=0x7fa5dc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13db176a5a509a4e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5ea94a640 1 -- 172.21.15.123:0/3117355687 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5dc0aa540 con 0x5638a3eba0a0 2024-03-20T13:37:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5ea94a640 1 -- 172.21.15.123:0/3117355687 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0a6070 con 0x5638a3eba0a0 2024-03-20T13:37:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.102+0000 7fa5ea94a640 1 -- 172.21.15.123:0/3117355687 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5dc0aa850 con 0x5638a3eba0a0 2024-03-20T13:37:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 -- 172.21.15.123:0/3117355687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 msgr2=0x5638a3f4afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 --2- 172.21.15.123:0/3117355687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a3f4afa0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00a4e0 tx=0x7fa5dc01b090 comp rx=0 tx=0).stop 2024-03-20T13:37:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 -- 172.21.15.123:0/3117355687 shutdown_connections 2024-03-20T13:37:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 --2- 172.21.15.123:0/3117355687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a3f4afa0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 -- 172.21.15.123:0/3117355687 >> 172.21.15.123:0/3117355687 conn(0x5638a3f406c0 msgr2=0x5638a3f42ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 -- 172.21.15.123:0/3117355687 shutdown_connections 2024-03-20T13:37:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.106+0000 7fa5ede31980 1 -- 172.21.15.123:0/3117355687 wait complete. 2024-03-20T13:37:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 Processor -- start 2024-03-20T13:37:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- start start 2024-03-20T13:37:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a40320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638a3e56620 con 0x5638a3eba0a0 2024-03-20T13:37:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5eb94c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a40320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5eb94c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a40320d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49334/0 (socket says 172.21.15.123:49334) 2024-03-20T13:37:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5eb94c640 1 -- 172.21.15.123:0/391849192 learned_addr learned my addr 172.21.15.123:0/391849192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5eb94c640 1 -- 172.21.15.123:0/391849192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc00a1c0 con 0x5638a3eba0a0 2024-03-20T13:37:58.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/391849192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a40320d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc017ca0 tx=0x7fa5dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f666e817e4e088 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa4d9e0b640 1 -- 172.21.15.123:0/391849192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5dc0aa780 con 0x5638a3eba0a0 2024-03-20T13:37:58.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa4d9e0b640 1 -- 172.21.15.123:0/391849192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc0aa8e0 con 0x5638a3eba0a0 2024-03-20T13:37:58.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa4d9e0b640 1 -- 172.21.15.123:0/391849192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5dc0aab80 con 0x5638a3eba0a0 2024-03-20T13:37:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- 172.21.15.123:0/391849192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 msgr2=0x5638a40320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 --2- 172.21.15.123:0/391849192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a40320d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc017ca0 tx=0x7fa5dc0033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- 172.21.15.123:0/391849192 shutdown_connections 2024-03-20T13:37:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 --2- 172.21.15.123:0/391849192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a40320d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- 172.21.15.123:0/391849192 >> 172.21.15.123:0/391849192 conn(0x5638a3f406c0 msgr2=0x5638a402dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- 172.21.15.123:0/391849192 shutdown_connections 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 -- 172.21.15.123:0/391849192 wait complete. 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.122+0000 7fa5ede31980 1 Processor -- start 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 -- start start 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a4038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638a3e51e00 con 0x5638a3eba0a0 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5eb94c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a4038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5eb94c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a4038e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49338/0 (socket says 172.21.15.123:49338) 2024-03-20T13:37:58.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2614385502 learned_addr learned my addr 172.21.15.123:0/2614385502 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638a3f50000 con 0x5638a3eba0a0 2024-03-20T13:37:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a4038e20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc01aec0 tx=0x7fa5dc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa4d3fff640 1 -- 172.21.15.123:0/2614385502 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5dc0c4070 con 0x5638a3eba0a0 2024-03-20T13:37:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638a4039360 con 0x5638a3eba0a0 2024-03-20T13:37:58.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa4d3fff640 1 -- 172.21.15.123:0/2614385502 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc005150 con 0x5638a3eba0a0 2024-03-20T13:37:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638a4039790 con 0x5638a3eba0a0 2024-03-20T13:37:58.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa4d3fff640 1 -- 172.21.15.123:0/2614385502 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5dc0053f0 con 0x5638a3eba0a0 2024-03-20T13:37:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa4d3fff640 1 -- 172.21.15.123:0/2614385502 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa5dc0a8070 con 0x5638a3eba0a0 2024-03-20T13:37:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa4d3fff640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4d4034300 0x7fa4d40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa4d3fff640 1 -- 172.21.15.123:0/2614385502 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa5dc0e36d0 con 0x5638a3eba0a0 2024-03-20T13:37:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5eb14b640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4d4034300 0x7fa4d40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a3f4b4e0 0x5638a403fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a403ff90 con 0x5638a3f4b4e0 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.126+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a3f4b4e0 0x5638a403fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5eb14b640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4d4034300 0x7fa4d40367c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000f70 tx=0x7fa5e0001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a3f4b4e0 0x5638a403fa50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2614385502 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa5e40083f0 con 0x5638a3f4b4e0 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4040800 0x5638a4042bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4043320 con 0x5638a4040800 2024-03-20T13:37:58.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4040800 0x5638a4042bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4040800 0x5638a4042bf0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2614385502 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a4040800 2024-03-20T13:37:58.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4044b60 con 0x5638a4040800 2024-03-20T13:37:58.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2614385502 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a4040800 2024-03-20T13:37:58.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.130+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4043d60 con 0x5638a4040800 2024-03-20T13:37:58.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2614385502 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a4040800 2024-03-20T13:37:58.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4044170 con 0x5638a3f4b4e0 2024-03-20T13:37:58.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2614385502 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa5e40083f0 con 0x5638a3f4b4e0 2024-03-20T13:37:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 Processor -- start 2024-03-20T13:37:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 -- start start 2024-03-20T13:37:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 0x5638a4053710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638a3deae30 con 0x5638a40532f0 2024-03-20T13:37:58.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ec14d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 0x5638a4053710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ec14d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 0x5638a4053710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49342/0 (socket says 172.21.15.123:49342) 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2200484553 learned_addr learned my addr 172.21.15.123:0/2200484553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2200484553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638a4053c50 con 0x5638a40532f0 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 0x5638a4053710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400aae0 tx=0x7fa5e4008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa4d17fa640 1 -- 172.21.15.123:0/2200484553 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5e401d070 con 0x5638a40532f0 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa4d17fa640 1 -- 172.21.15.123:0/2200484553 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4010040 con 0x5638a40532f0 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638a4053ea0 con 0x5638a40532f0 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa4d17fa640 1 -- 172.21.15.123:0/2200484553 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5e4007e70 con 0x5638a40532f0 2024-03-20T13:37:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638a40549f0 con 0x5638a40532f0 2024-03-20T13:37:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.134+0000 7fa4d17fa640 1 -- 172.21.15.123:0/2200484553 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa5e4018430 con 0x5638a40532f0 2024-03-20T13:37:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa4d17fa640 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4c40342b0 0x7fa4c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa4d17fa640 1 -- 172.21.15.123:0/2200484553 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa5e404a790 con 0x5638a40532f0 2024-03-20T13:37:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4c40342b0 0x7fa4c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 Processor -- start 2024-03-20T13:37:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- start start 2024-03-20T13:37:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4c40342b0 0x7fa4c4036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5638a40437a0 tx=0x7fa5dc0e18f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a40606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638a3dde790 con 0x5638a4060290 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a40606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a40606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49352/0 (socket says 172.21.15.123:49352) 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2311302633 learned_addr learned my addr 172.21.15.123:0/2311302633 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2311302633 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638a4060c80 con 0x5638a4060290 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2311302633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a40606b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4048a20 tx=0x7fa5e4020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab5a3ab0b4530d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa4caffd640 1 -- 172.21.15.123:0/2311302633 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5e4021790 con 0x5638a4060290 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa4caffd640 1 -- 172.21.15.123:0/2311302633 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e403f030 con 0x5638a4060290 2024-03-20T13:37:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa4caffd640 1 -- 172.21.15.123:0/2311302633 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5e4022410 con 0x5638a4060290 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- 172.21.15.123:0/2311302633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 msgr2=0x5638a40606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2311302633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a40606b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4048a20 tx=0x7fa5e4020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- 172.21.15.123:0/2311302633 shutdown_connections 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2311302633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a40606b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- 172.21.15.123:0/2311302633 >> 172.21.15.123:0/2311302633 conn(0x5638a405c5d0 msgr2=0x5638a405a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- 172.21.15.123:0/2311302633 shutdown_connections 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- 172.21.15.123:0/2311302633 wait complete. 2024-03-20T13:37:58.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 Processor -- start 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- start start 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a4067140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ede31980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638a4067680 con 0x5638a4060290 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a4067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a4067140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49354/0 (socket says 172.21.15.123:49354) 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.138+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 learned_addr learned my addr 172.21.15.123:0/2549026581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638a40549f0 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a4067140 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40077a0 tx=0x7fa5e40489b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa4c97fa640 1 -- 172.21.15.123:0/2549026581 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5e4048c20 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa4c97fa640 1 -- 172.21.15.123:0/2549026581 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4047290 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638a4067880 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa4c97fa640 1 -- 172.21.15.123:0/2549026581 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5e4047550 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638a4067cb0 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa4c97fa640 1 -- 172.21.15.123:0/2549026581 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa5e4032020 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa4c97fa640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4b40342b0 0x7fa4b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa4c97fa640 1 -- 172.21.15.123:0/2549026581 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa5e4036d40 con 0x5638a4060290 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4b40342b0 0x7fa4b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a4072850 0x5638a4074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4075460 con 0x5638a4072850 2024-03-20T13:37:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5eb14b640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a4072850 0x5638a4074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4b40342b0 0x7fa4b4036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0b49b0 tx=0x7fa5dc0c9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5eb14b640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a4072850 0x5638a4074d10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 20 realm 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4071cf0 con 0x5638a4072850 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.142+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4075ee0 con 0x5638a4072850 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4076a50 0x5638a4078f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4079680 con 0x5638a4076a50 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4076a50 0x5638a4078f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4076a50 0x5638a4078f10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa5e401f070 con 0x5638a4076a50 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4079ed0 con 0x5638a4076a50 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa5e401f070 con 0x5638a4076a50 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 20 searching for the correct realm 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5638a407bbf0 0x5638a407dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a407bbf0 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5638a407bbf0 0x5638a407dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5eb94c640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5638a407bbf0 0x5638a407dfe0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.146+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4076a50 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e401f070 con 0x5638a4076a50 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa5e402bbc0 0x7fa5e4017710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x7fa5e402bbc0 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa5e402bbc0 0x7fa5e4017710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa5e402bbc0 0x7fa5e4017710 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4072850 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4072850 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a407bbf0 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4072850 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4076a50 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e401f070 con 0x5638a4076a50 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4076a50 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e401f070 con 0x5638a4076a50 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.150+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4072850 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x7fa5e402bbc0 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407e5c0 con 0x5638a4072850 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x7fa5e402bbc0 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4076a50 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a407bbf0 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4072850 2024-03-20T13:37:58.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4076a50 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a407bbf0 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4072850 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.154+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4072850 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4072850 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a407bbf0 2024-03-20T13:37:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x7fa5e402bbc0 2024-03-20T13:37:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4072850 2024-03-20T13:37:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x7fa5e402bbc0 2024-03-20T13:37:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a407bbf0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x7fa5e402bbc0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4076a50 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4076a50 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a407bbf0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.158+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4076a50 2024-03-20T13:37:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa5e002d080 con 0x5638a4076a50 2024-03-20T13:37:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407a800 con 0x5638a4072850 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407ac10 con 0x5638a4076a50 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407ac10 con 0x5638a4072850 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 zone default found 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 4 Realm: () 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 zonegroup default 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a407ea00 con 0x7fa5e402bbc0 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080be0 con 0x5638a407bbf0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080f40 con 0x5638a407bbf0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 started sync module instance, tier type = 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.162+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080160 con 0x5638a4076a50 2024-03-20T13:37:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801270146320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080160 con 0x5638a4076a50 2024-03-20T13:37:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4081930 con 0x5638a4072850 2024-03-20T13:37:58.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801270150160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40818f0 con 0x5638a4072850 2024-03-20T13:37:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4082840 con 0x5638a4076a50 2024-03-20T13:37:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.166+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801270146320] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801270150160] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801270154112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4082840 con 0x5638a4076a50 2024-03-20T13:37:58.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4081e50 con 0x7fa5e402bbc0 2024-03-20T13:37:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801270156272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4081e50 con 0x7fa5e402bbc0 2024-03-20T13:37:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4083b60 con 0x5638a4076a50 2024-03-20T13:37:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801270154112] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.170+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801270156272] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801270157328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4083b60 con 0x5638a4076a50 2024-03-20T13:37:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4083f10 con 0x5638a407bbf0 2024-03-20T13:37:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801270158928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4084790 con 0x5638a407bbf0 2024-03-20T13:37:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4085140 con 0x5638a407bbf0 2024-03-20T13:37:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801270157328] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801270158928] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801270144192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40842f0 con 0x5638a407bbf0 2024-03-20T13:37:58.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.174+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4085990 con 0x7fa5e402bbc0 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801270144192] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801270164576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40842f0 con 0x7fa5e402bbc0 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=0 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=1 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=2 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=3 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=4 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=5 2024-03-20T13:37:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=6 2024-03-20T13:37:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801270164576] v34'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 20 add_watcher() i=7 2024-03-20T13:37:58.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:58.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4088ab0 con 0x5638a4072850 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.178+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801270166768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4085fc0 con 0x5638a4072850 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801270166768] v34'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa4a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 5 note: GC not initialized 2024-03-20T13:37:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa4a0fe1640 20 reqs_thread_entry: start 2024-03-20T13:37:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 20 Filter name: none 2024-03-20T13:37:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa41a7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a4076a50 2024-03-20T13:37:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a4076a50 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a4076a50 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a407bbf0 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.182+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a4076a50 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a407bbf0 2024-03-20T13:37:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a4072850 2024-03-20T13:37:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a4072850 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a407bbf0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a407bbf0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40ab1a0 con 0x5638a407bbf0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40acb30 con 0x5638a4072850 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40acb30 con 0x7fa5e402bbc0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40acb30 con 0x5638a407bbf0 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40acb30 con 0x7fa5e402bbc0 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40acb30 con 0x5638a4072850 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40acb30 con 0x5638a407bbf0 2024-03-20T13:37:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.186+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4072850 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a407bbf0 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a407bbf0 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4072850 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.190+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4072850 2024-03-20T13:37:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a407bbf0 2024-03-20T13:37:58.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a407bbf0 2024-03-20T13:37:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4076a50 2024-03-20T13:37:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40aca70 con 0x5638a4072850 2024-03-20T13:37:58.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa4a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.194+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801270166768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40a9880 con 0x5638a4072850 2024-03-20T13:37:58.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.198+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94801270166768] v34'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.198+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801270146320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a40854f0 con 0x5638a4076a50 2024-03-20T13:37:58.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.198+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94801270146320] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.198+0000 7fa5ede31980 20 remove_watcher() i=0 2024-03-20T13:37:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.198+0000 7fa5ede31980 2 removed watcher, disabling cache 2024-03-20T13:37:58.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.198+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801270150160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080510 con 0x5638a4072850 2024-03-20T13:37:58.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.202+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94801270150160] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x5638a4072850 2024-03-20T13:37:58.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.202+0000 7fa5ede31980 20 remove_watcher() i=1 2024-03-20T13:37:58.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.202+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801270154112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080510 con 0x5638a4076a50 2024-03-20T13:37:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.202+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94801270154112] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.202+0000 7fa5ede31980 20 remove_watcher() i=2 2024-03-20T13:37:58.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.202+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801270156272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4082380 con 0x7fa5e402bbc0 2024-03-20T13:37:58.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94801270156272] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ede31980 20 remove_watcher() i=3 2024-03-20T13:37:58.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801270157328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4080510 con 0x5638a4076a50 2024-03-20T13:37:58.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ec14d640 1 -- 172.21.15.123:0/2549026581 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94801270157328] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e405e040 con 0x5638a4076a50 2024-03-20T13:37:58.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ede31980 20 remove_watcher() i=4 2024-03-20T13:37:58.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801270158928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4083090 con 0x5638a407bbf0 2024-03-20T13:37:58.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94801270158928] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ede31980 20 remove_watcher() i=5 2024-03-20T13:37:58.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.206+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801270144192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4083090 con 0x5638a407bbf0 2024-03-20T13:37:58.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5eb94c640 1 -- 172.21.15.123:0/2549026581 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94801270144192] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5dc0b4a00 con 0x5638a407bbf0 2024-03-20T13:37:58.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 20 remove_watcher() i=6 2024-03-20T13:37:58.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801270164576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5638a4082380 con 0x7fa5e402bbc0 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94801270164576] v34'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5e000f620 con 0x7fa5e402bbc0 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 20 remove_watcher() i=7 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4076a50 msgr2=0x5638a4078f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4076a50 0x5638a4078f10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a4072850 msgr2=0x5638a4074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a4072850 0x5638a4074d10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa5e402bbc0 msgr2=0x7fa5e4017710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa5e402bbc0 0x7fa5e4017710 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5638a407bbf0 msgr2=0x5638a407dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5638a407bbf0 0x5638a407dfe0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4b40342b0 msgr2=0x7fa4b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4b40342b0 0x7fa4b4036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0b49b0 tx=0x7fa5dc0c9000 comp rx=0 tx=0).stop 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 msgr2=0x5638a4067140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5eb14b640 1 -- 172.21.15.123:0/2549026581 reap_dead start 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a4067140 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40077a0 tx=0x7fa5e40489b0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 shutdown_connections 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2549026581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a4060290 0x5638a4067140 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 >> 172.21.15.123:0/2549026581 conn(0x5638a405c5d0 msgr2=0x5638a4059c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 shutdown_connections 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2549026581 wait complete. 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4c40342b0 msgr2=0x7fa4c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4c40342b0 0x7fa4c4036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5638a40437a0 tx=0x7fa5dc0e18f0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 msgr2=0x5638a4053710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 0x5638a4053710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400aae0 tx=0x7fa5e4008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 shutdown_connections 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4c40342b0 0x7fa4c4036770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2200484553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a40532f0 0x5638a4053710 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 >> 172.21.15.123:0/2200484553 conn(0x5638a4048100 msgr2=0x5638a4048c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 shutdown_connections 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2200484553 wait complete. 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4040800 msgr2=0x5638a4042bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4040800 0x5638a4042bf0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a3f4b4e0 msgr2=0x5638a403fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a3f4b4e0 0x5638a403fa50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4d4034300 msgr2=0x7fa4d40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4d4034300 0x7fa4d40367c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000f70 tx=0x7fa5e0001380 comp rx=0 tx=0).stop 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 msgr2=0x5638a4038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a4038e20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc01aec0 tx=0x7fa5dc017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 shutdown_connections 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5638a4040800 0x5638a4042bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5638a3f4b4e0 0x5638a403fa50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa4d4034300 0x7fa4d40367c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 --2- 172.21.15.123:0/2614385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638a3eba0a0 0x5638a4038e20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 >> 172.21.15.123:0/2614385502 conn(0x5638a3f406c0 msgr2=0x5638a402c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 shutdown_connections 2024-03-20T13:37:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.210+0000 7fa5ede31980 1 -- 172.21.15.123:0/2614385502 wait complete. 2024-03-20T13:37:58.227 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-03-20T13:37:58.227 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-03-20T13:37:58.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-03-20T13:37:58.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-03-20T13:37:58.228 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-03-20T13:37:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca74c0980 1 Processor -- start 2024-03-20T13:37:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca74c0980 1 -- start start 2024-03-20T13:37:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca74c0980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556a23476130 0x556a23476510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca74c0980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556a233c0520 con 0x556a23476a50 2024-03-20T13:37:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca74c0980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x556a233870f0 con 0x556a23476130 2024-03-20T13:37:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca4fdb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556a23476130 0x556a23476510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca4fdb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x556a23476130 0x556a23476510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49358/0 (socket says 172.21.15.123:49358) 2024-03-20T13:37:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca47da640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x556a23476a50 0x556a23477400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:51938/0 (socket says 172.21.15.123:51938) 2024-03-20T13:37:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/1098191876 learned_addr learned my addr 172.21.15.123:0/1098191876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/1098191876 >> v1:172.21.15.89:6789/0 conn(0x556a23476a50 legacy=0x556a23477400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.298+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/1098191876 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a23477c30 con 0x556a23476130 2024-03-20T13:37:58.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/1098191876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23476510 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400a4e0 tx=0x7f3c9401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a7a95cac24567c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca3fd9640 1 -- 172.21.15.123:0/1098191876 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c940aa540 con 0x556a23476130 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca3fd9640 1 -- 172.21.15.123:0/1098191876 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940a6070 con 0x556a23476130 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca3fd9640 1 -- 172.21.15.123:0/1098191876 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c940aa850 con 0x556a23476130 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1098191876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 msgr2=0x556a23476510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/1098191876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23476510 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400a4e0 tx=0x7f3c9401b090 comp rx=0 tx=0).stop 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1098191876 shutdown_connections 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/1098191876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23476510 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1098191876 >> 172.21.15.123:0/1098191876 conn(0x556a233e9850 msgr2=0x556a233e9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1098191876 shutdown_connections 2024-03-20T13:37:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.302+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1098191876 wait complete. 2024-03-20T13:37:58.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca74c0980 1 Processor -- start 2024-03-20T13:37:58.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca74c0980 1 -- start start 2024-03-20T13:37:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca74c0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23560600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca74c0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a23384620 con 0x556a23476130 2024-03-20T13:37:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca4fdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23560600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca4fdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23560600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49368/0 (socket says 172.21.15.123:49368) 2024-03-20T13:37:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/1591059379 learned_addr learned my addr 172.21.15.123:0/1591059379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/1591059379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9400a1c0 con 0x556a23476130 2024-03-20T13:37:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/1591059379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23560600 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3c94017ca0 tx=0x7f3c940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ed7e493e49379d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3b92e0d640 1 -- 172.21.15.123:0/1591059379 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c940aa780 con 0x556a23476130 2024-03-20T13:37:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3b92e0d640 1 -- 172.21.15.123:0/1591059379 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940aa8e0 con 0x556a23476130 2024-03-20T13:37:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.318+0000 7f3b92e0d640 1 -- 172.21.15.123:0/1591059379 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c940aab80 con 0x556a23476130 2024-03-20T13:37:58.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1591059379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 msgr2=0x556a23560600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/1591059379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23560600 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3c94017ca0 tx=0x7f3c940033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1591059379 shutdown_connections 2024-03-20T13:37:58.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/1591059379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23560600 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1591059379 >> 172.21.15.123:0/1591059379 conn(0x556a233e9850 msgr2=0x556a2355c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1591059379 shutdown_connections 2024-03-20T13:37:58.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/1591059379 wait complete. 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 Processor -- start 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- start start 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23567350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2337fe00 con 0x556a23476130 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca4fdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23567350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca4fdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23567350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49378/0 (socket says 172.21.15.123:49378) 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/883662098 learned_addr learned my addr 172.21.15.123:0/883662098 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a23477c30 con 0x556a23476130 2024-03-20T13:37:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23567350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3c9401aec0 tx=0x7f3c94017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3b9160a640 1 -- 172.21.15.123:0/883662098 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c940c4070 con 0x556a23476130 2024-03-20T13:37:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a23567890 con 0x556a23476130 2024-03-20T13:37:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3b9160a640 1 -- 172.21.15.123:0/883662098 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940b5650 con 0x556a23476130 2024-03-20T13:37:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3b9160a640 1 -- 172.21.15.123:0/883662098 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c940b5910 con 0x556a23476130 2024-03-20T13:37:58.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.322+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a23567cc0 con 0x556a23476130 2024-03-20T13:37:58.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3b9160a640 1 -- 172.21.15.123:0/883662098 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c940a8070 con 0x556a23476130 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3b9160a640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b8c0342b0 0x7f3b8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3b9160a640 1 -- 172.21.15.123:0/883662098 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3c940e3860 con 0x556a23476130 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca47da640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b8c0342b0 0x7f3b8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a23476a50 0x556a2356df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a2356e4c0 con 0x556a23476a50 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a23476a50 0x556a2356df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca47da640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b8c0342b0 0x7f3b8c036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3c98000f70 tx=0x7f3c98001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a23476a50 0x556a2356df80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca57dc640 1 -- 172.21.15.123:0/883662098 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c9c0083f0 con 0x556a23476a50 2024-03-20T13:37:58.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a2356ed30 0x556a23571120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235717e0 con 0x556a2356ed30 2024-03-20T13:37:58.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a2356ed30 0x556a23571120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a2356ed30 0x556a23571120 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/883662098 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c940d1790 con 0x556a2356ed30 2024-03-20T13:37:58.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.326+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a23573040 con 0x556a2356ed30 2024-03-20T13:37:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/883662098 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3c940d1790 con 0x556a2356ed30 2024-03-20T13:37:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a23572180 con 0x556a2356ed30 2024-03-20T13:37:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/883662098 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c940d1790 con 0x556a2356ed30 2024-03-20T13:37:58.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a23572590 con 0x556a23476a50 2024-03-20T13:37:58.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca57dc640 1 -- 172.21.15.123:0/883662098 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3c9c0083f0 con 0x556a23476a50 2024-03-20T13:37:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 Processor -- start 2024-03-20T13:37:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 -- start start 2024-03-20T13:37:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 0x556a23581ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a23318e30 con 0x556a23581780 2024-03-20T13:37:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca57dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 0x556a23581ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca57dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 0x556a23581ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49386/0 (socket says 172.21.15.123:49386) 2024-03-20T13:37:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca57dc640 1 -- 172.21.15.123:0/2348198976 learned_addr learned my addr 172.21.15.123:0/2348198976 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca57dc640 1 -- 172.21.15.123:0/2348198976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a235820e0 con 0x556a23581780 2024-03-20T13:37:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 0x556a23581ba0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00aab0 tx=0x7f3c9c00af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3b8a7fc640 1 -- 172.21.15.123:0/2348198976 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c01d070 con 0x556a23581780 2024-03-20T13:37:58.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3b8a7fc640 1 -- 172.21.15.123:0/2348198976 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c010040 con 0x556a23581780 2024-03-20T13:37:58.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3b8a7fc640 1 -- 172.21.15.123:0/2348198976 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c007e70 con 0x556a23581780 2024-03-20T13:37:58.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a23582330 con 0x556a23581780 2024-03-20T13:37:58.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.330+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a23582e80 con 0x556a23581780 2024-03-20T13:37:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3b8a7fc640 1 -- 172.21.15.123:0/2348198976 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c9c018430 con 0x556a23581780 2024-03-20T13:37:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3b8a7fc640 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b7c0342b0 0x7f3b7c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3b8a7fc640 1 -- 172.21.15.123:0/2348198976 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3c9c04a610 con 0x556a23581780 2024-03-20T13:37:58.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b7c0342b0 0x7f3b7c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 Processor -- start 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 -- start start 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b7c0342b0 0x7f3b7c036770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x556a23571c80 tx=0x7f3c940c7c70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a2358eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2330c790 con 0x556a2358e730 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca57dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a2358eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca57dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a2358eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49388/0 (socket says 172.21.15.123:49388) 2024-03-20T13:37:58.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3375223964 learned_addr learned my addr 172.21.15.123:0/3375223964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3375223964 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2358f120 con 0x556a2358e730 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/3375223964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a2358eb50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c048960 tx=0x7f3c9c020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668d8b18131c009 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3b7bfff640 1 -- 172.21.15.123:0/3375223964 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c047070 con 0x556a2358e730 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3b7bfff640 1 -- 172.21.15.123:0/3375223964 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c0215f0 con 0x556a2358e730 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3b7bfff640 1 -- 172.21.15.123:0/3375223964 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c022560 con 0x556a2358e730 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3375223964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 msgr2=0x556a2358eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3375223964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a2358eb50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c048960 tx=0x7f3c9c020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3375223964 shutdown_connections 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3375223964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a2358eb50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.334+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3375223964 >> 172.21.15.123:0/3375223964 conn(0x556a2358aac0 msgr2=0x556a23588b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3375223964 shutdown_connections 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3375223964 wait complete. 2024-03-20T13:37:58.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 Processor -- start 2024-03-20T13:37:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 -- start start 2024-03-20T13:37:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a23595770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a23595cb0 con 0x556a2358e730 2024-03-20T13:37:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca57dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a23595770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca57dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a23595770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49390/0 (socket says 172.21.15.123:49390) 2024-03-20T13:37:58.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 learned_addr learned my addr 172.21.15.123:0/3145070113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a23582e80 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a23595770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0077a0 tx=0x7f3c9c0488f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3b7a7fc640 1 -- 172.21.15.123:0/3145070113 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c021c60 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3b7a7fc640 1 -- 172.21.15.123:0/3145070113 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c021dc0 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a23595eb0 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3b7a7fc640 1 -- 172.21.15.123:0/3145070113 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c018880 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a235962e0 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3b7a7fc640 1 -- 172.21.15.123:0/3145070113 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c9c018a70 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3b7a7fc640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b70034300 0x7f3b700367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3b7a7fc640 1 -- 172.21.15.123:0/3145070113 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3c9c035d10 con 0x556a2358e730 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b70034300 0x7f3b700367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.338+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a235a0e80 0x556a235a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a3a90 con 0x556a235a0e80 2024-03-20T13:37:58.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca47da640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a235a0e80 0x556a235a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b70034300 0x7f3b700367c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c940c8040 tx=0x7f3c940d0fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca47da640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a235a0e80 0x556a235a3340 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 realm 2024-03-20T13:37:58.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a0360 con 0x556a235a0e80 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a4510 con 0x556a235a0e80 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a235a50d0 0x556a235a7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a7d00 con 0x556a235a50d0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a235a50d0 0x556a235a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a235a50d0 0x556a235a7590 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c9c01f070 con 0x556a235a50d0 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.342+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a8550 con 0x556a235a50d0 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3c9c01f070 con 0x556a235a50d0 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca74c0980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca74c0980 20 searching for the correct realm 2024-03-20T13:37:58.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a235aa270 0x556a235ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235aa270 2024-03-20T13:37:58.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a235aa270 0x556a235ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca4fdb640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a235aa270 0x556a235ac660 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a50d0 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c01f070 con 0x556a235a50d0 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca57dc640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3c9c0497d0 0x7f3c9c016890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x7f3c9c0497d0 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3c9c0497d0 0x7f3c9c016890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3c9c0497d0 0x7f3c9c016890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a0e80 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a0e80 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235aa270 2024-03-20T13:37:58.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a0e80 2024-03-20T13:37:58.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.346+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a50d0 2024-03-20T13:37:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c01f070 con 0x556a235a50d0 2024-03-20T13:37:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a50d0 2024-03-20T13:37:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c01f070 con 0x556a235a50d0 2024-03-20T13:37:58.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a0e80 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x7f3c9c0497d0 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235acc40 con 0x556a235a0e80 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x7f3c9c0497d0 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a50d0 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235aa270 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a0e80 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.350+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a50d0 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235aa270 2024-03-20T13:37:58.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a0e80 2024-03-20T13:37:58.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a0e80 2024-03-20T13:37:58.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a0e80 2024-03-20T13:37:58.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235aa270 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x7f3c9c0497d0 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a0e80 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x7f3c9c0497d0 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235aa270 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x7f3c9c0497d0 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.354+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a50d0 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a50d0 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235aa270 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a50d0 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f3c9802d080 con 0x556a235a50d0 2024-03-20T13:37:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a8e50 con 0x556a235a0e80 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a9260 con 0x556a235a50d0 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.358+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235a9640 con 0x556a235a0e80 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 zone default found 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 4 Realm: () 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 zonegroup default 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235ad520 con 0x7f3c9c0497d0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235ad1a0 con 0x556a235aa270 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235af7f0 con 0x556a235aa270 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 started sync module instance, tier type = 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235aecd0 con 0x556a235a50d0 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914348056704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235aecd0 con 0x556a235a50d0 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.362+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b0260 con 0x556a235a0e80 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914348060032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b01e0 con 0x556a235a0e80 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b1170 con 0x556a235a50d0 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914348056704] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914348060032] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914348062224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b1130 con 0x556a235a50d0 2024-03-20T13:37:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.366+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b19c0 con 0x7f3c9c0497d0 2024-03-20T13:37:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914348066080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b1130 con 0x7f3c9c0497d0 2024-03-20T13:37:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b2470 con 0x556a235a50d0 2024-03-20T13:37:58.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914348066080] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914348062224] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914348063824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b2470 con 0x556a235a50d0 2024-03-20T13:37:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.370+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b2820 con 0x556a235aa270 2024-03-20T13:37:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914348067136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b3070 con 0x556a235aa270 2024-03-20T13:37:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b3a40 con 0x556a235aa270 2024-03-20T13:37:58.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914348063824] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914348067136] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914348074304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b2bd0 con 0x556a235aa270 2024-03-20T13:37:58.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b4290 con 0x7f3c9c0497d0 2024-03-20T13:37:58.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914348074304] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914348068784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b4290 con 0x7f3c9c0497d0 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=0 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=1 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=2 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=3 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=4 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=5 2024-03-20T13:37:58.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.374+0000 7f3ca74c0980 20 add_watcher() i=6 2024-03-20T13:37:58.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914348068784] v34'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 20 add_watcher() i=7 2024-03-20T13:37:58.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:58.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b7450 con 0x556a235a0e80 2024-03-20T13:37:58.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914348076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235b46b0 con 0x556a235a0e80 2024-03-20T13:37:58.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914348076528] v34'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3b5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 5 note: GC not initialized 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3b59fe3640 20 reqs_thread_entry: start 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3ca74c0980 20 Filter name: none 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.378+0000 7f3acb7fe640 20 reqs_thread_entry: start 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca74c0980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f40 con 0x556a235a0e80 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca74c0980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f40 con 0x556a235aa270 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3b5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.382+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914348076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235a0e80 2024-03-20T13:37:58.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93914348076528] v34'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914348056704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235a50d0 2024-03-20T13:37:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93914348056704] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca74c0980 20 remove_watcher() i=0 2024-03-20T13:37:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca74c0980 2 removed watcher, disabling cache 2024-03-20T13:37:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914348060032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235a0e80 2024-03-20T13:37:58.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93914348060032] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x556a235a0e80 2024-03-20T13:37:58.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca74c0980 20 remove_watcher() i=1 2024-03-20T13:37:58.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.386+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914348062224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235a50d0 2024-03-20T13:37:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.390+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93914348062224] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.390+0000 7f3ca74c0980 20 remove_watcher() i=2 2024-03-20T13:37:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.390+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914348066080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x7f3c9c0497d0 2024-03-20T13:37:58.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.390+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93914348066080] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.390+0000 7f3ca74c0980 20 remove_watcher() i=3 2024-03-20T13:37:58.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.390+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914348063824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235a50d0 2024-03-20T13:37:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca57dc640 1 -- 172.21.15.123:0/3145070113 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93914348063824] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9c05d040 con 0x556a235a50d0 2024-03-20T13:37:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca74c0980 20 remove_watcher() i=4 2024-03-20T13:37:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914348067136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235aa270 2024-03-20T13:37:58.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93914348067136] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca74c0980 20 remove_watcher() i=5 2024-03-20T13:37:58.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914348074304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x556a235aa270 2024-03-20T13:37:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca4fdb640 1 -- 172.21.15.123:0/3145070113 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93914348074304] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c940d1790 con 0x556a235aa270 2024-03-20T13:37:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca74c0980 20 remove_watcher() i=6 2024-03-20T13:37:58.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.394+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914348068784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x556a235d8f00 con 0x7f3c9c0497d0 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93914348068784] v34'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c9800f620 con 0x7f3c9c0497d0 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 20 remove_watcher() i=7 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a235a50d0 msgr2=0x556a235a7590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a235a50d0 0x556a235a7590 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a235a0e80 msgr2=0x556a235a3340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a235a0e80 0x556a235a3340 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3c9c0497d0 msgr2=0x7f3c9c016890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f3c9c0497d0 0x7f3c9c016890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a235aa270 msgr2=0x556a235ac660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x556a235aa270 0x556a235ac660 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b70034300 msgr2=0x7f3b700367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b70034300 0x7f3b700367c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c940c8040 tx=0x7f3c940d0fb0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 msgr2=0x556a23595770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/3145070113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a2358e730 0x556a23595770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0077a0 tx=0x7f3c9c0488f0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 reap_dead start 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca47da640 1 -- 172.21.15.123:0/3145070113 reap_dead start 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 shutdown_connections 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 >> 172.21.15.123:0/3145070113 conn(0x556a2358aac0 msgr2=0x556a23588120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 shutdown_connections 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/3145070113 wait complete. 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b7c0342b0 msgr2=0x7f3b7c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b7c0342b0 0x7f3b7c036770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x556a23571c80 tx=0x7f3c940c7c70 comp rx=0 tx=0).stop 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 msgr2=0x556a23581ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 0x556a23581ba0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00aab0 tx=0x7f3c9c00af70 comp rx=0 tx=0).stop 2024-03-20T13:37:58.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 shutdown_connections 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b7c0342b0 0x7f3b7c036770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/2348198976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23581780 0x556a23581ba0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 >> 172.21.15.123:0/2348198976 conn(0x556a23576590 msgr2=0x556a235770a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 shutdown_connections 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/2348198976 wait complete. 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a2356ed30 msgr2=0x556a23571120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a2356ed30 0x556a23571120 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a23476a50 msgr2=0x556a2356df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a23476a50 0x556a2356df80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b8c0342b0 msgr2=0x7f3b8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b8c0342b0 0x7f3b8c036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3c98000f70 tx=0x7f3c98001380 comp rx=0 tx=0).stop 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 msgr2=0x556a23567350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23567350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3c9401aec0 tx=0x7f3c94017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 shutdown_connections 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x556a2356ed30 0x556a23571120 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x556a23476a50 0x556a2356df80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3b8c0342b0 0x7f3b8c036770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 --2- 172.21.15.123:0/883662098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556a23476130 0x556a23567350 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 >> 172.21.15.123:0/883662098 conn(0x556a233e9850 msgr2=0x556a2355aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 shutdown_connections 2024-03-20T13:37:58.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.398+0000 7f3ca74c0980 1 -- 172.21.15.123:0/883662098 wait complete. 2024-03-20T13:37:58.414 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-03-20T13:37:58.414 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-03-20T13:37:58.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-03-20T13:37:58.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-03-20T13:37:58.414 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-03-20T13:37:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:58.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32aee6f980 1 Processor -- start 2024-03-20T13:37:58.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32aee6f980 1 -- start start 2024-03-20T13:37:58.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32aee6f980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b02304cf50 0x55b02304d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32aee6f980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b022f994c0 con 0x55b02304d870 2024-03-20T13:37:58.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32aee6f980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b022f600f0 con 0x55b02304cf50 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32ac98a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b02304cf50 0x55b02304d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32ac189640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55b02304d870 0x55b02304e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:51952/0 (socket says 172.21.15.123:51952) 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32ac98a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b02304cf50 0x55b02304d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49396/0 (socket says 172.21.15.123:49396) 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32ac189640 1 -- 172.21.15.123:0/3202985345 learned_addr learned my addr 172.21.15.123:0/3202985345 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32ab988640 1 -- 172.21.15.123:0/3202985345 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329838139 0 0) 0x55b022f994c0 con 0x55b02304d870 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.490+0000 7f32ab988640 1 -- 172.21.15.123:0/3202985345 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3294001e20 con 0x55b02304d870 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32ac98a640 1 -- 172.21.15.123:0/3202985345 >> v1:172.21.15.89:6789/0 conn(0x55b02304d870 legacy=0x55b02304e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32ac98a640 1 -- 172.21.15.123:0/3202985345 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b02304ea60 con 0x55b02304cf50 2024-03-20T13:37:58.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32ac98a640 1 --2- 172.21.15.123:0/3202985345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b02304d330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a480 tx=0x7f329c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e990d91d22fc5b19 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32ab988640 1 -- 172.21.15.123:0/3202985345 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329c0ab540 con 0x55b02304cf50 2024-03-20T13:37:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32ab988640 1 -- 172.21.15.123:0/3202985345 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c0ab6a0 con 0x55b02304cf50 2024-03-20T13:37:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32ab988640 1 -- 172.21.15.123:0/3202985345 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329c0ab960 con 0x55b02304cf50 2024-03-20T13:37:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 -- 172.21.15.123:0/3202985345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 msgr2=0x55b02304d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3202985345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b02304d330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a480 tx=0x7f329c01b280 comp rx=0 tx=0).stop 2024-03-20T13:37:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 -- 172.21.15.123:0/3202985345 shutdown_connections 2024-03-20T13:37:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3202985345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b02304d330 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 -- 172.21.15.123:0/3202985345 >> 172.21.15.123:0/3202985345 conn(0x55b023048820 msgr2=0x55b02304ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 -- 172.21.15.123:0/3202985345 shutdown_connections 2024-03-20T13:37:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.494+0000 7f32aee6f980 1 -- 172.21.15.123:0/3202985345 wait complete. 2024-03-20T13:37:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32aee6f980 1 Processor -- start 2024-03-20T13:37:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32aee6f980 1 -- start start 2024-03-20T13:37:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32aee6f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b023137300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32aee6f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b022f5d620 con 0x55b02304cf50 2024-03-20T13:37:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32ac98a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b023137300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32ac98a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b023137300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49398/0 (socket says 172.21.15.123:49398) 2024-03-20T13:37:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.510+0000 7f32ac98a640 1 -- 172.21.15.123:0/179280560 learned_addr learned my addr 172.21.15.123:0/179280560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32ac98a640 1 -- 172.21.15.123:0/179280560 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c005d30 con 0x55b02304cf50 2024-03-20T13:37:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32ac98a640 1 --2- 172.21.15.123:0/179280560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b023137300 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f329c018eb0 tx=0x7f329c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c567fef947d54f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f319ae0d640 1 -- 172.21.15.123:0/179280560 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329c0ab810 con 0x55b02304cf50 2024-03-20T13:37:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f319ae0d640 1 -- 172.21.15.123:0/179280560 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c0ab970 con 0x55b02304cf50 2024-03-20T13:37:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f319ae0d640 1 -- 172.21.15.123:0/179280560 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329c0abc10 con 0x55b02304cf50 2024-03-20T13:37:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- 172.21.15.123:0/179280560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 msgr2=0x55b023137300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 --2- 172.21.15.123:0/179280560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b023137300 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f329c018eb0 tx=0x7f329c003030 comp rx=0 tx=0).stop 2024-03-20T13:37:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- 172.21.15.123:0/179280560 shutdown_connections 2024-03-20T13:37:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 --2- 172.21.15.123:0/179280560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b023137300 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- 172.21.15.123:0/179280560 >> 172.21.15.123:0/179280560 conn(0x55b023048820 msgr2=0x55b023132e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- 172.21.15.123:0/179280560 shutdown_connections 2024-03-20T13:37:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- 172.21.15.123:0/179280560 wait complete. 2024-03-20T13:37:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 Processor -- start 2024-03-20T13:37:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- start start 2024-03-20T13:37:58.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b022fc2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32aee6f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b022f58e00 con 0x55b02304cf50 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32ac98a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b022fc2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32ac98a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b022fc2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49410/0 (socket says 172.21.15.123:49410) 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32ac98a640 1 -- 172.21.15.123:0/3272935546 learned_addr learned my addr 172.21.15.123:0/3272935546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.514+0000 7f32ac98a640 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b02304ea60 con 0x55b02304cf50 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ac98a640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b022fc2e40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a480 tx=0x7f329c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f319960a640 1 -- 172.21.15.123:0/3272935546 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329c0c3070 con 0x55b02304cf50 2024-03-20T13:37:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b022fc3380 con 0x55b02304cf50 2024-03-20T13:37:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f319960a640 1 -- 172.21.15.123:0/3272935546 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c0be970 con 0x55b02304cf50 2024-03-20T13:37:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b022fc18c0 con 0x55b02304cf50 2024-03-20T13:37:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f319960a640 1 -- 172.21.15.123:0/3272935546 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329c0bec10 con 0x55b02304cf50 2024-03-20T13:37:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f319960a640 1 -- 172.21.15.123:0/3272935546 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f329c0b2070 con 0x55b02304cf50 2024-03-20T13:37:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f319960a640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f31940342b0 0x7f3194036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f319960a640 1 -- 172.21.15.123:0/3272935546 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f329c0e3810 con 0x55b02304cf50 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ac189640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f31940342b0 0x7f3194036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b02304d870 0x55b023146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231474b0 con 0x55b02304d870 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ad18b640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b02304d870 0x55b023146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ac189640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f31940342b0 0x7f3194036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000f70 tx=0x7f32a00010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ad18b640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b02304d870 0x55b023146f70 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ad18b640 1 -- 172.21.15.123:0/3272935546 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x55b02304d870 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b023147d20 0x55b02314a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02314a6c0 con 0x55b023147d20 2024-03-20T13:37:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.518+0000 7f32ac98a640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b023147d20 0x55b02314a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32ac98a640 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b023147d20 0x55b02314a110 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32ac98a640 1 -- 172.21.15.123:0/3272935546 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023147d20 2024-03-20T13:37:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02314bf20 con 0x55b023147d20 2024-03-20T13:37:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32ac98a640 1 -- 172.21.15.123:0/3272935546 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023147d20 2024-03-20T13:37:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02314b120 con 0x55b023147d20 2024-03-20T13:37:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32ac98a640 1 -- 172.21.15.123:0/3272935546 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023147d20 2024-03-20T13:37:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02314b530 con 0x55b02304d870 2024-03-20T13:37:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32ad18b640 1 -- 172.21.15.123:0/3272935546 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f32a400a4d0 con 0x55b02304d870 2024-03-20T13:37:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 Processor -- start 2024-03-20T13:37:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 -- start start 2024-03-20T13:37:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 0x55b02315aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.522+0000 7f32aee6f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b022ef1e30 con 0x55b02315a6b0 2024-03-20T13:37:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 0x55b02315aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 0x55b02315aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49418/0 (socket says 172.21.15.123:49418) 2024-03-20T13:37:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 -- 172.21.15.123:0/3107942391 learned_addr learned my addr 172.21.15.123:0/3107942391 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 -- 172.21.15.123:0/3107942391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b02315b010 con 0x55b02315a6b0 2024-03-20T13:37:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 0x55b02315aad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f32a4016cf0 tx=0x7f32a400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f31927fc640 1 -- 172.21.15.123:0/3107942391 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32a4017660 con 0x55b02315a6b0 2024-03-20T13:37:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f31927fc640 1 -- 172.21.15.123:0/3107942391 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a40177c0 con 0x55b02315a6b0 2024-03-20T13:37:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b02315b260 con 0x55b02315a6b0 2024-03-20T13:37:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f31927fc640 1 -- 172.21.15.123:0/3107942391 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32a4017a60 con 0x55b02315a6b0 2024-03-20T13:37:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b02315bdb0 con 0x55b02315a6b0 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f31927fc640 1 -- 172.21.15.123:0/3107942391 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f32a401d020 con 0x55b02315a6b0 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f31927fc640 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3184034300 0x7f31840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f31927fc640 1 -- 172.21.15.123:0/3107942391 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f32a404b2d0 con 0x55b02315a6b0 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ac98a640 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3184034300 0x7f31840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32aee6f980 1 Processor -- start 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32aee6f980 1 -- start start 2024-03-20T13:37:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ac98a640 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3184034300 0x7f31840367c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b02314ab60 tx=0x7f329c0d8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32aee6f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b023167990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32aee6f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b022ee5790 con 0x55b023167570 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b023167990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b023167990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49420/0 (socket says 172.21.15.123:49420) 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.526+0000 7f32ad18b640 1 -- 172.21.15.123:0/3538823436 learned_addr learned my addr 172.21.15.123:0/3538823436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 -- 172.21.15.123:0/3538823436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b023167f60 con 0x55b023167570 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 --2- 172.21.15.123:0/3538823436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b023167990 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f32a401ffd0 tx=0x7f32a4049810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feabf4731bcf9b41 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f3183fff640 1 -- 172.21.15.123:0/3538823436 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32a403b170 con 0x55b023167570 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f3183fff640 1 -- 172.21.15.123:0/3538823436 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a403b2d0 con 0x55b023167570 2024-03-20T13:37:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f3183fff640 1 -- 172.21.15.123:0/3538823436 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32a4017cf0 con 0x55b023167570 2024-03-20T13:37:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- 172.21.15.123:0/3538823436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 msgr2=0x55b023167990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3538823436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b023167990 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f32a401ffd0 tx=0x7f32a4049810 comp rx=0 tx=0).stop 2024-03-20T13:37:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- 172.21.15.123:0/3538823436 shutdown_connections 2024-03-20T13:37:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3538823436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b023167990 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- 172.21.15.123:0/3538823436 >> 172.21.15.123:0/3538823436 conn(0x55b0231638c0 msgr2=0x55b0231619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- 172.21.15.123:0/3538823436 shutdown_connections 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- 172.21.15.123:0/3538823436 wait complete. 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 Processor -- start 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- start start 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b02316e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32aee6f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02316eba0 con 0x55b023167570 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b02316e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b02316e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49436/0 (socket says 172.21.15.123:49436) 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 learned_addr learned my addr 172.21.15.123:0/988764600 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b02315bdb0 con 0x55b023167570 2024-03-20T13:37:58.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.530+0000 7f32ad18b640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b02316e660 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f32a401ffd0 tx=0x7f32a40494f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f31827fc640 1 -- 172.21.15.123:0/988764600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32a403b170 con 0x55b023167570 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f31827fc640 1 -- 172.21.15.123:0/988764600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4028860 con 0x55b023167570 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b02316eda0 con 0x55b023167570 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f31827fc640 1 -- 172.21.15.123:0/988764600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32a4049b80 con 0x55b023167570 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b02316f1d0 con 0x55b023167570 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f31827fc640 1 -- 172.21.15.123:0/988764600 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f32a4049ce0 con 0x55b023167570 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f31827fc640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3178034300 0x7f31780367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f31827fc640 1 -- 172.21.15.123:0/988764600 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f32a403a020 con 0x55b023167570 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac98a640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3178034300 0x7f31780367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b023179d90 0x55b02317c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02317c9a0 con 0x55b023179d90 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac189640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b023179d90 0x55b02317c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac98a640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3178034300 0x7f31780367c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f329c0e3b40 tx=0x7f329c0e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac189640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b023179d90 0x55b02317c250 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 realm 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023179270 con 0x55b023179d90 2024-03-20T13:37:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02317d420 con 0x55b023179d90 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b02317dfe0 0x55b0231804a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023180c10 con 0x55b02317dfe0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.534+0000 7f32ad18b640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b02317dfe0 0x55b0231804a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ad18b640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b02317dfe0 0x55b0231804a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023181460 con 0x55b02317dfe0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 20 searching for the correct realm 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b023183180 0x55b023185570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ac98a640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b023183180 0x55b023185570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ac98a640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b023183180 0x55b023185570 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ad18b640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f32a4033020 0x7f32a404da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x7f32a4033020 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.538+0000 7f32ac189640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f32a4033020 0x7f32a404da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f32a4033020 0x7f32a404da30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x7f32a4033020 2024-03-20T13:37:58.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.542+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x7f32a4033020 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.546+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x7f32a4033020 2024-03-20T13:37:58.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023179d90 2024-03-20T13:37:58.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x7f32a4033020 2024-03-20T13:37:58.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x7f32a4033020 2024-03-20T13:37:58.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b023183180 2024-03-20T13:37:58.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.550+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185b00 con 0x55b02317dfe0 2024-03-20T13:37:58.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:58.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:58.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023181d90 con 0x55b023179d90 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231821d0 con 0x55b02317dfe0 2024-03-20T13:37:58.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231825b0 con 0x55b023179d90 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f32a000e640 con 0x55b023179d90 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 zone default found 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 4 Realm: () 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 zonegroup default 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023185f40 con 0x7f32a4033020 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f32a000e640 con 0x7f32a4033020 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023188120 con 0x55b023183180 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023188480 con 0x55b023183180 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 started sync module instance, tier type = 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:58.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.554+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231876f0 con 0x55b02317dfe0 2024-03-20T13:37:58.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214991411872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231876f0 con 0x55b02317dfe0 2024-03-20T13:37:58.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023188df0 con 0x55b023179d90 2024-03-20T13:37:58.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214991415632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023189640 con 0x55b023179d90 2024-03-20T13:37:58.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318a040 con 0x55b02317dfe0 2024-03-20T13:37:58.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.558+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214991411872] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214991415632] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214991420224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231891a0 con 0x55b02317dfe0 2024-03-20T13:37:58.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318a8c0 con 0x7f32a4033020 2024-03-20T13:37:58.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x7f32a4033020 2024-03-20T13:37:58.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214991422496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231891a0 con 0x7f32a4033020 2024-03-20T13:37:58.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318b350 con 0x55b02317dfe0 2024-03-20T13:37:58.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214991420224] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.562+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214991422496] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x7f32a4033020 2024-03-20T13:37:58.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214991423552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318b310 con 0x55b02317dfe0 2024-03-20T13:37:58.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318b700 con 0x55b023183180 2024-03-20T13:37:58.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214991409744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318bf50 con 0x55b023183180 2024-03-20T13:37:58.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318c940 con 0x55b023183180 2024-03-20T13:37:58.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214991423552] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214991409744] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214991430688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318bab0 con 0x55b023183180 2024-03-20T13:37:58.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.566+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318d190 con 0x7f32a4033020 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x7f32a4033020 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214991430688] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214991425104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318bab0 con 0x7f32a4033020 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=0 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=1 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=2 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=3 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=4 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=5 2024-03-20T13:37:58.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=6 2024-03-20T13:37:58.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214991425104] v34'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x7f32a4033020 2024-03-20T13:37:58.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 20 add_watcher() i=7 2024-03-20T13:37:58.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:58.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b023190250 con 0x55b023179d90 2024-03-20T13:37:58.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.570+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214991432944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b02318d690 con 0x55b023179d90 2024-03-20T13:37:58.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214991432944] v34'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f3162fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:58.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:58.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 5 note: GC not initialized 2024-03-20T13:37:58.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f3161fe3640 20 reqs_thread_entry: start 2024-03-20T13:37:58.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 20 Filter name: none 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f30d37fe640 20 reqs_thread_entry: start 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b023179d90 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b023183180 2024-03-20T13:37:58.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.574+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.578+0000 7f3162fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.578+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214991432944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b023179d90 2024-03-20T13:37:58.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.578+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94214991432944] v34'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.578+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214991411872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b02317dfe0 2024-03-20T13:37:58.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94214991411872] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 20 remove_watcher() i=0 2024-03-20T13:37:58.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 2 removed watcher, disabling cache 2024-03-20T13:37:58.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214991415632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b023179d90 2024-03-20T13:37:58.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94214991415632] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x55b023179d90 2024-03-20T13:37:58.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 20 remove_watcher() i=1 2024-03-20T13:37:58.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214991420224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b02317dfe0 2024-03-20T13:37:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94214991420224] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 20 remove_watcher() i=2 2024-03-20T13:37:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.582+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214991422496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x7f32a4033020 2024-03-20T13:37:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.586+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94214991422496] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x7f32a4033020 2024-03-20T13:37:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.586+0000 7f32aee6f980 20 remove_watcher() i=3 2024-03-20T13:37:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.586+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214991423552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b02317dfe0 2024-03-20T13:37:58.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.586+0000 7f32ad18b640 1 -- 172.21.15.123:0/988764600 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94214991423552] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a4030070 con 0x55b02317dfe0 2024-03-20T13:37:58.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.586+0000 7f32aee6f980 20 remove_watcher() i=4 2024-03-20T13:37:58.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.586+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214991409744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b023183180 2024-03-20T13:37:58.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94214991409744] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 20 remove_watcher() i=5 2024-03-20T13:37:58.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214991430688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x55b023183180 2024-03-20T13:37:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32ac98a640 1 -- 172.21.15.123:0/988764600 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94214991430688] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329c0c6dc0 con 0x55b023183180 2024-03-20T13:37:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 20 remove_watcher() i=6 2024-03-20T13:37:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214991425104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55b0231b1d20 con 0x7f32a4033020 2024-03-20T13:37:58.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94214991425104] v34'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f32a0043040 con 0x7f32a4033020 2024-03-20T13:37:58.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 20 remove_watcher() i=7 2024-03-20T13:37:58.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b02317dfe0 msgr2=0x55b0231804a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b02317dfe0 0x55b0231804a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b023179d90 msgr2=0x55b02317c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b023179d90 0x55b02317c250 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f32a4033020 msgr2=0x7f32a404da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f32a4033020 0x7f32a404da30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b023183180 msgr2=0x55b023185570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55b023183180 0x55b023185570 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3178034300 msgr2=0x7f31780367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3178034300 0x7f31780367c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f329c0e3b40 tx=0x7f329c0e4000 comp rx=0 tx=0).stop 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 msgr2=0x55b02316e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 --2- 172.21.15.123:0/988764600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b023167570 0x55b02316e660 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f32a401ffd0 tx=0x7f32a40494f0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32ac189640 1 -- 172.21.15.123:0/988764600 reap_dead start 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 shutdown_connections 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 >> 172.21.15.123:0/988764600 conn(0x55b0231638c0 msgr2=0x55b023160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 shutdown_connections 2024-03-20T13:37:58.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/988764600 wait complete. 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.590+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3184034300 msgr2=0x7f31840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3184034300 0x7f31840367c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b02314ab60 tx=0x7f329c0d8040 comp rx=0 tx=0).stop 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 msgr2=0x55b02315aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 0x55b02315aad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f32a4016cf0 tx=0x7f32a400d790 comp rx=0 tx=0).stop 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 shutdown_connections 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f3184034300 0x7f31840367c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3107942391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02315a6b0 0x55b02315aad0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 >> 172.21.15.123:0/3107942391 conn(0x55b02314f4c0 msgr2=0x55b02314ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 shutdown_connections 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3107942391 wait complete. 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b023147d20 msgr2=0x55b02314a110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b023147d20 0x55b02314a110 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b02304d870 msgr2=0x55b023146f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b02304d870 0x55b023146f70 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f31940342b0 msgr2=0x7f3194036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f31940342b0 0x7f3194036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000f70 tx=0x7f32a00010b0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 msgr2=0x55b022fc2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b022fc2e40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f329c00a480 tx=0x7f329c018020 comp rx=0 tx=0).stop 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 shutdown_connections 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55b023147d20 0x55b02314a110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55b02304d870 0x55b023146f70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f31940342b0 0x7f3194036770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 --2- 172.21.15.123:0/3272935546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b02304cf50 0x55b022fc2e40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 >> 172.21.15.123:0/3272935546 conn(0x55b023048820 msgr2=0x55b0231319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 shutdown_connections 2024-03-20T13:37:58.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.594+0000 7f32aee6f980 1 -- 172.21.15.123:0/3272935546 wait complete. 2024-03-20T13:37:58.608 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-03-20T13:37:58.608 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-03-20T13:37:58.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-03-20T13:37:58.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-03-20T13:37:58.609 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-03-20T13:37:58.688 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:58.688 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff012550980 1 Processor -- start 2024-03-20T13:37:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff012550980 1 -- start start 2024-03-20T13:37:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff012550980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5602bf387460 0x5602bf389850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff012550980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5602bf2cf4c0 con 0x5602bf382f50 2024-03-20T13:37:58.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff012550980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5602bf2960f0 con 0x5602bf387460 2024-03-20T13:37:58.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f86a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5602bf387460 0x5602bf389850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f86a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5602bf387460 0x5602bf389850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49450/0 (socket says 172.21.15.123:49450) 2024-03-20T13:37:58.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f86a640 1 -- 172.21.15.123:0/1868645271 learned_addr learned my addr 172.21.15.123:0/1868645271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f86a640 1 -- 172.21.15.123:0/1868645271 >> v1:172.21.15.89:6789/0 conn(0x5602bf382f50 legacy=0x5602bf383330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f86a640 1 -- 172.21.15.123:0/1868645271 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602bf38ada0 con 0x5602bf387460 2024-03-20T13:37:58.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f069640 1 -- 172.21.15.123:0/1868645271 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097879275 0 0) 0x5602bf2cf4c0 con 0x5602bf382f50 2024-03-20T13:37:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.686+0000 7ff00f86a640 1 --2- 172.21.15.123:0/1868645271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf387460 0x5602bf389850 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feff800a5c0 tx=0x7feff801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e06c2fe83e2dd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff00f069640 1 -- 172.21.15.123:0/1868645271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feff80aa470 con 0x5602bf387460 2024-03-20T13:37:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff00f069640 1 -- 172.21.15.123:0/1868645271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80aa5d0 con 0x5602bf387460 2024-03-20T13:37:58.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff00f069640 1 -- 172.21.15.123:0/1868645271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feff80aa890 con 0x5602bf387460 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 -- 172.21.15.123:0/1868645271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf387460 msgr2=0x5602bf389850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 --2- 172.21.15.123:0/1868645271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf387460 0x5602bf389850 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feff800a5c0 tx=0x7feff801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 -- 172.21.15.123:0/1868645271 shutdown_connections 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 --2- 172.21.15.123:0/1868645271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf387460 0x5602bf389850 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 -- 172.21.15.123:0/1868645271 >> 172.21.15.123:0/1868645271 conn(0x5602bf37e820 msgr2=0x5602bf380c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 -- 172.21.15.123:0/1868645271 shutdown_connections 2024-03-20T13:37:58.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.690+0000 7ff012550980 1 -- 172.21.15.123:0/1868645271 wait complete. 2024-03-20T13:37:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.702+0000 7ff012550980 1 Processor -- start 2024-03-20T13:37:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- start start 2024-03-20T13:37:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf46cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bf293620 con 0x5602bf382f50 2024-03-20T13:37:58.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf46cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf46cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49462/0 (socket says 172.21.15.123:49462) 2024-03-20T13:37:58.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 -- 172.21.15.123:0/1183198072 learned_addr learned my addr 172.21.15.123:0/1183198072 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 -- 172.21.15.123:0/1183198072 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8005df0 con 0x5602bf382f50 2024-03-20T13:37:58.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 --2- 172.21.15.123:0/1183198072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf46cc40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff000001670 tx=0x7ff000001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa02b0e9a568806 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7feefe60c640 1 -- 172.21.15.123:0/1183198072 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0000025d0 con 0x5602bf382f50 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7feefe60c640 1 -- 172.21.15.123:0/1183198072 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000002730 con 0x5602bf382f50 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7feefe60c640 1 -- 172.21.15.123:0/1183198072 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff000002a30 con 0x5602bf382f50 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- 172.21.15.123:0/1183198072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 msgr2=0x5602bf46cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 --2- 172.21.15.123:0/1183198072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf46cc40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff000001670 tx=0x7ff000001b30 comp rx=0 tx=0).stop 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- 172.21.15.123:0/1183198072 shutdown_connections 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 --2- 172.21.15.123:0/1183198072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf46cc40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- 172.21.15.123:0/1183198072 >> 172.21.15.123:0/1183198072 conn(0x5602bf37e820 msgr2=0x5602bf4687d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- 172.21.15.123:0/1183198072 shutdown_connections 2024-03-20T13:37:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- 172.21.15.123:0/1183198072 wait complete. 2024-03-20T13:37:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 Processor -- start 2024-03-20T13:37:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- start start 2024-03-20T13:37:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf473b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff012550980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bf28ee00 con 0x5602bf382f50 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf473b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf473b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49470/0 (socket says 172.21.15.123:49470) 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.706+0000 7ff01006b640 1 -- 172.21.15.123:0/1365961769 learned_addr learned my addr 172.21.15.123:0/1365961769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff01006b640 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000006cc0 con 0x5602bf382f50 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff01006b640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf473b20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff000006fb0 tx=0x7ff000001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7feefce09640 1 -- 172.21.15.123:0/1365961769 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff000012860 con 0x5602bf382f50 2024-03-20T13:37:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602bf474060 con 0x5602bf382f50 2024-03-20T13:37:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7feefce09640 1 -- 172.21.15.123:0/1365961769 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0000129c0 con 0x5602bf382f50 2024-03-20T13:37:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7feefce09640 1 -- 172.21.15.123:0/1365961769 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff000012c60 con 0x5602bf382f50 2024-03-20T13:37:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602bf474490 con 0x5602bf382f50 2024-03-20T13:37:58.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7feefce09640 1 -- 172.21.15.123:0/1365961769 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff000019070 con 0x5602bf382f50 2024-03-20T13:37:58.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7feefce09640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feef80342b0 0x7feef8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7feefce09640 1 -- 172.21.15.123:0/1365961769 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff000049370 con 0x5602bf382f50 2024-03-20T13:37:58.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff00f86a640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feef80342b0 0x7feef8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf387460 0x5602bf47a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf47ac90 con 0x5602bf387460 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff01086c640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf387460 0x5602bf47a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff00f86a640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feef80342b0 0x7feef8036770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feff80ae000 tx=0x7feff80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff01086c640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf387460 0x5602bf47a750 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff01086c640 1 -- 172.21.15.123:0/1365961769 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0080083f0 con 0x5602bf387460 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf47b500 0x5602bf47d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf47e060 con 0x5602bf47b500 2024-03-20T13:37:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.710+0000 7ff01006b640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf47b500 0x5602bf47d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff01006b640 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf47b500 0x5602bf47d8f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff01006b640 1 -- 172.21.15.123:0/1365961769 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff000049050 con 0x5602bf47b500 2024-03-20T13:37:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf47f8c0 con 0x5602bf47b500 2024-03-20T13:37:58.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff01006b640 1 -- 172.21.15.123:0/1365961769 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff000049050 con 0x5602bf47b500 2024-03-20T13:37:58.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf47eac0 con 0x5602bf47b500 2024-03-20T13:37:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff01006b640 1 -- 172.21.15.123:0/1365961769 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff000049050 con 0x5602bf47b500 2024-03-20T13:37:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf47eed0 con 0x5602bf387460 2024-03-20T13:37:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff01086c640 1 -- 172.21.15.123:0/1365961769 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff0080083f0 con 0x5602bf387460 2024-03-20T13:37:58.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.714+0000 7ff012550980 1 Processor -- start 2024-03-20T13:37:58.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 -- start start 2024-03-20T13:37:58.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 0x5602bf48e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bf227e30 con 0x5602bf48dfa0 2024-03-20T13:37:58.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01086c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 0x5602bf48e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01086c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 0x5602bf48e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49484/0 (socket says 172.21.15.123:49484) 2024-03-20T13:37:58.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01086c640 1 -- 172.21.15.123:0/3684694087 learned_addr learned my addr 172.21.15.123:0/3684694087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01086c640 1 -- 172.21.15.123:0/3684694087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602bf48e900 con 0x5602bf48dfa0 2024-03-20T13:37:58.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01086c640 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 0x5602bf48e3c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff00800aae0 tx=0x7ff008008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7feef5ffb640 1 -- 172.21.15.123:0/3684694087 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff00801d070 con 0x5602bf48dfa0 2024-03-20T13:37:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602bf48eb50 con 0x5602bf48dfa0 2024-03-20T13:37:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7feef5ffb640 1 -- 172.21.15.123:0/3684694087 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008010040 con 0x5602bf48dfa0 2024-03-20T13:37:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602bf48f6a0 con 0x5602bf48dfa0 2024-03-20T13:37:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7feef5ffb640 1 -- 172.21.15.123:0/3684694087 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff008007e50 con 0x5602bf48dfa0 2024-03-20T13:37:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7feef5ffb640 1 -- 172.21.15.123:0/3684694087 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff008018430 con 0x5602bf48dfa0 2024-03-20T13:37:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7feef5ffb640 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee8034260 0x7feee8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7feef5ffb640 1 -- 172.21.15.123:0/3684694087 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff00804a6f0 con 0x5602bf48dfa0 2024-03-20T13:37:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01006b640 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee8034260 0x7feee8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 Processor -- start 2024-03-20T13:37:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff012550980 1 -- start start 2024-03-20T13:37:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.718+0000 7ff01006b640 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee8034260 0x7feee8036720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5602bf47e5c0 tx=0x7ff000047650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf2f9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bf21b790 con 0x5602bf2f8d50 2024-03-20T13:37:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf2f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf2f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49500/0 (socket says 172.21.15.123:49500) 2024-03-20T13:37:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 -- 172.21.15.123:0/567229596 learned_addr learned my addr 172.21.15.123:0/567229596 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 -- 172.21.15.123:0/567229596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602bf2f7580 con 0x5602bf2f8d50 2024-03-20T13:37:58.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 --2- 172.21.15.123:0/567229596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf2f9170 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff008020480 tx=0x7ff0080218e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923479679d4d6fee server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7feeef7fe640 1 -- 172.21.15.123:0/567229596 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff008047070 con 0x5602bf2f8d50 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7feeef7fe640 1 -- 172.21.15.123:0/567229596 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008022590 con 0x5602bf2f8d50 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7feeef7fe640 1 -- 172.21.15.123:0/567229596 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff008016460 con 0x5602bf2f8d50 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- 172.21.15.123:0/567229596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 msgr2=0x5602bf2f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 --2- 172.21.15.123:0/567229596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf2f9170 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff008020480 tx=0x7ff0080218e0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- 172.21.15.123:0/567229596 shutdown_connections 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 --2- 172.21.15.123:0/567229596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf2f9170 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- 172.21.15.123:0/567229596 >> 172.21.15.123:0/567229596 conn(0x5602bf497280 msgr2=0x5602bf4952e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- 172.21.15.123:0/567229596 shutdown_connections 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- 172.21.15.123:0/567229596 wait complete. 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 Processor -- start 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- start start 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf4a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff012550980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bf4a4420 con 0x5602bf2f8d50 2024-03-20T13:37:58.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf4a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf4a3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49514/0 (socket says 172.21.15.123:49514) 2024-03-20T13:37:58.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 learned_addr learned my addr 172.21.15.123:0/3959295488 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602bf48f6a0 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.722+0000 7ff01086c640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf4a3ee0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff008021920 tx=0x7ff0080489d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7feeedffb640 1 -- 172.21.15.123:0/3959295488 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff008021b60 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7feeedffb640 1 -- 172.21.15.123:0/3959295488 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008021cc0 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602bf4a4620 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7feeedffb640 1 -- 172.21.15.123:0/3959295488 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff00804a0d0 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602bf4a4ab0 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7feeedffb640 1 -- 172.21.15.123:0/3959295488 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff00804a2c0 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7feeedffb640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee00342b0 0x7feee0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7feeedffb640 1 -- 172.21.15.123:0/3959295488 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff008036d20 con 0x5602bf2f8d50 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff01006b640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee00342b0 0x7feee0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf4af610 0x5602bf4b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b2220 con 0x5602bf4af610 2024-03-20T13:37:58.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff00f86a640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf4af610 0x5602bf4b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff01006b640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee00342b0 0x7feee0036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0000496a0 tx=0x7ff00003c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff00f86a640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf4af610 0x5602bf4b1ad0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 realm 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b2610 con 0x5602bf4af610 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b2e60 con 0x5602bf4af610 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf4b3840 0x5602bf4b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b63e0 con 0x5602bf4b3840 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.726+0000 7ff01086c640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf4b3840 0x5602bf4b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01086c640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf4b3840 0x5602bf4b5c70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff008032070 con 0x5602bf4b3840 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b6c30 con 0x5602bf4b3840 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff008032070 con 0x5602bf4b3840 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 20 searching for the correct realm 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5602bf4b8950 0x5602bf4bad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01006b640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5602bf4b8950 0x5602bf4bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01006b640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5602bf4b8950 0x5602bf4bad40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff008032070 con 0x5602bf4b3840 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01086c640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff008035020 0x7ff008024240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x7ff008035020 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff00f86a640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff008035020 0x7ff008024240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.730+0000 7ff00f86a640 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff008035020 0x7ff008024240 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x7ff008035020 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff008032070 con 0x5602bf4b3840 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff008032070 con 0x5602bf4b3840 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x7ff008035020 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x7ff008035020 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x7ff008035020 2024-03-20T13:37:58.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7feff80b0020 con 0x7ff008035020 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.734+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80b0020 con 0x5602bf4af610 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x7ff008035020 2024-03-20T13:37:58.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.738+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4af610 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x7ff008035020 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x7ff008035020 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b8950 2024-03-20T13:37:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.742+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb2d0 con 0x5602bf4b3840 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b7560 con 0x5602bf4af610 2024-03-20T13:37:58.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b7910 con 0x5602bf4b3840 2024-03-20T13:37:58.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4b7910 con 0x5602bf4af610 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 zone default found 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 4 Realm: () 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 zonegroup default 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bb710 con 0x7ff008035020 2024-03-20T13:37:58.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bd590 con 0x5602bf4b8950 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bd8f0 con 0x5602bf4b8950 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 started sync module instance, tier type = 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:58.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.746+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bcb60 con 0x5602bf4b3840 2024-03-20T13:37:58.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569799339792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bcb60 con 0x5602bf4b3840 2024-03-20T13:37:58.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4be260 con 0x5602bf4af610 2024-03-20T13:37:58.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569799343552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4be680 con 0x5602bf4af610 2024-03-20T13:37:58.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bf100 con 0x5602bf4b3840 2024-03-20T13:37:58.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.750+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569799339792] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569799343552] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569799347200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4be1e0 con 0x5602bf4b3840 2024-03-20T13:37:58.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bf950 con 0x7ff008035020 2024-03-20T13:37:58.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569799349424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4be1e0 con 0x7ff008035020 2024-03-20T13:37:58.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c0460 con 0x5602bf4b3840 2024-03-20T13:37:58.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569799347200] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.754+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569799349424] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569799352128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c0420 con 0x5602bf4b3840 2024-03-20T13:37:58.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4bfa40 con 0x5602bf4b8950 2024-03-20T13:37:58.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569799354384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c10d0 con 0x5602bf4b8950 2024-03-20T13:37:58.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c1a40 con 0x5602bf4b8950 2024-03-20T13:37:58.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569799352128] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569799337664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c1a40 con 0x5602bf4b8950 2024-03-20T13:37:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c2480 con 0x7ff008035020 2024-03-20T13:37:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.758+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569799354384] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569799337664] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569799360352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c2440 con 0x7ff008035020 2024-03-20T13:37:58.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=0 2024-03-20T13:37:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=1 2024-03-20T13:37:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=2 2024-03-20T13:37:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=3 2024-03-20T13:37:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=4 2024-03-20T13:37:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=5 2024-03-20T13:37:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=6 2024-03-20T13:37:58.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569799360352] v34'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 20 add_watcher() i=7 2024-03-20T13:37:58.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:58.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c1670 con 0x5602bf4af610 2024-03-20T13:37:58.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.762+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569799355440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4c1670 con 0x5602bf4af610 2024-03-20T13:37:58.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569799355440] v34'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7feec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 5 note: GC not initialized 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7feec5fe3640 20 reqs_thread_entry: start 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 20 Filter name: none 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7feebf7fe640 20 reqs_thread_entry: start 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6f20 con 0x5602bf4af610 2024-03-20T13:37:58.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:58.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4b8950 2024-03-20T13:37:58.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7feec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.766+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569799355440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4af610 2024-03-20T13:37:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.770+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94569799355440] v34'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.770+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569799339792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4b3840 2024-03-20T13:37:58.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.770+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94569799339792] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.770+0000 7ff012550980 20 remove_watcher() i=0 2024-03-20T13:37:58.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.770+0000 7ff012550980 2 removed watcher, disabling cache 2024-03-20T13:37:58.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.770+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569799343552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4af610 2024-03-20T13:37:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.774+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94569799343552] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x5602bf4af610 2024-03-20T13:37:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.774+0000 7ff012550980 20 remove_watcher() i=1 2024-03-20T13:37:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.774+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569799347200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4b3840 2024-03-20T13:37:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.774+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94569799347200] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.774+0000 7ff012550980 20 remove_watcher() i=2 2024-03-20T13:37:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.774+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569799349424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x7ff008035020 2024-03-20T13:37:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94569799349424] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff012550980 20 remove_watcher() i=3 2024-03-20T13:37:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569799352128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4b3840 2024-03-20T13:37:58.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff01086c640 1 -- 172.21.15.123:0/3959295488 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94569799352128] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff00805d040 con 0x5602bf4b3840 2024-03-20T13:37:58.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff012550980 20 remove_watcher() i=4 2024-03-20T13:37:58.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569799354384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4b8950 2024-03-20T13:37:58.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94569799354384] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff012550980 20 remove_watcher() i=5 2024-03-20T13:37:58.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.778+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569799337664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x5602bf4b8950 2024-03-20T13:37:58.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff01006b640 1 -- 172.21.15.123:0/3959295488 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94569799337664] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff000049050 con 0x5602bf4b8950 2024-03-20T13:37:58.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 20 remove_watcher() i=6 2024-03-20T13:37:58.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569799360352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5602bf4e6ee0 con 0x7ff008035020 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94569799360352] v34'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feff80d5060 con 0x7ff008035020 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 20 remove_watcher() i=7 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf4b3840 msgr2=0x5602bf4b5c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf4b3840 0x5602bf4b5c70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf4af610 msgr2=0x5602bf4b1ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf4af610 0x5602bf4b1ad0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff008035020 msgr2=0x7ff008024240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff008035020 0x7ff008024240 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5602bf4b8950 msgr2=0x5602bf4bad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5602bf4b8950 0x5602bf4bad40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee00342b0 msgr2=0x7feee0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee00342b0 0x7feee0036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0000496a0 tx=0x7ff00003c000 comp rx=0 tx=0).stop 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff00f86a640 1 -- 172.21.15.123:0/3959295488 reap_dead start 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 msgr2=0x5602bf4a3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf4a3ee0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff008021920 tx=0x7ff0080489d0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 shutdown_connections 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3959295488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf2f8d50 0x5602bf4a3ee0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 >> 172.21.15.123:0/3959295488 conn(0x5602bf497280 msgr2=0x5602bf4948e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 shutdown_connections 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3959295488 wait complete. 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee8034260 msgr2=0x7feee8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee8034260 0x7feee8036720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5602bf47e5c0 tx=0x7ff000047650 comp rx=0 tx=0).stop 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 msgr2=0x5602bf48e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 0x5602bf48e3c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff00800aae0 tx=0x7ff008008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 shutdown_connections 2024-03-20T13:37:58.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feee8034260 0x7feee8036720 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/3684694087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf48dfa0 0x5602bf48e3c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 >> 172.21.15.123:0/3684694087 conn(0x5602bf482db0 msgr2=0x5602bf4838c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 shutdown_connections 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/3684694087 wait complete. 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf47b500 msgr2=0x5602bf47d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf47b500 0x5602bf47d8f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf387460 msgr2=0x5602bf47a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf387460 0x5602bf47a750 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feef80342b0 msgr2=0x7feef8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feef80342b0 0x7feef8036770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feff80ae000 tx=0x7feff80a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 msgr2=0x5602bf473b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf473b20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff000006fb0 tx=0x7ff000001260 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 shutdown_connections 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5602bf47b500 0x5602bf47d8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5602bf387460 0x5602bf47a750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7feef80342b0 0x7feef8036770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 --2- 172.21.15.123:0/1365961769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602bf382f50 0x5602bf473b20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 >> 172.21.15.123:0/1365961769 conn(0x5602bf37e820 msgr2=0x5602bf4672e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 shutdown_connections 2024-03-20T13:37:58.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.782+0000 7ff012550980 1 -- 172.21.15.123:0/1365961769 wait complete. 2024-03-20T13:37:58.798 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-03-20T13:37:58.799 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-03-20T13:37:58.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-03-20T13:37:58.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-03-20T13:37:58.799 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-03-20T13:37:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f286c33c980 1 Processor -- start 2024-03-20T13:37:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f286c33c980 1 -- start start 2024-03-20T13:37:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f286c33c980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55cdfcce8640 0x55cdfcceaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f286c33c980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cdfcc2e4c0 con 0x55cdfcce4140 2024-03-20T13:37:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f286c33c980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cdfcbf50f0 con 0x55cdfcce8640 2024-03-20T13:37:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f2869656640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55cdfcce8640 0x55cdfcceaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f2869e57640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55cdfcce4140 0x55cdfcce4520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:51970/0 (socket says 172.21.15.123:51970) 2024-03-20T13:37:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f2869e57640 1 -- 172.21.15.123:0/1937958911 learned_addr learned my addr 172.21.15.123:0/1937958911 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:37:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f2869656640 1 -- 172.21.15.123:0/1937958911 >> v1:172.21.15.89:6789/0 conn(0x55cdfcce4140 legacy=0x55cdfcce4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.874+0000 7f2869656640 1 -- 172.21.15.123:0/1937958911 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdfccebf80 con 0x55cdfcce8640 2024-03-20T13:37:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f2869656640 1 --2- 172.21.15.123:0/1937958911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce8640 0x55cdfcceaa30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f286000a480 tx=0x7f286001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f4e87dd9c725a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f2868e55640 1 -- 172.21.15.123:0/1937958911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28600ab540 con 0x55cdfcce8640 2024-03-20T13:37:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f2868e55640 1 -- 172.21.15.123:0/1937958911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28600ab6a0 con 0x55cdfcce8640 2024-03-20T13:37:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f2868e55640 1 -- 172.21.15.123:0/1937958911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28600ab960 con 0x55cdfcce8640 2024-03-20T13:37:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 -- 172.21.15.123:0/1937958911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce8640 msgr2=0x55cdfcceaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 --2- 172.21.15.123:0/1937958911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce8640 0x55cdfcceaa30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f286000a480 tx=0x7f286001b280 comp rx=0 tx=0).stop 2024-03-20T13:37:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 -- 172.21.15.123:0/1937958911 shutdown_connections 2024-03-20T13:37:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 --2- 172.21.15.123:0/1937958911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce8640 0x55cdfcceaa30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 -- 172.21.15.123:0/1937958911 >> 172.21.15.123:0/1937958911 conn(0x55cdfcc57860 msgr2=0x55cdfcc57c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 -- 172.21.15.123:0/1937958911 shutdown_connections 2024-03-20T13:37:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.878+0000 7f286c33c980 1 -- 172.21.15.123:0/1937958911 wait complete. 2024-03-20T13:37:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.894+0000 7f286c33c980 1 Processor -- start 2024-03-20T13:37:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.894+0000 7f286c33c980 1 -- start start 2024-03-20T13:37:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.894+0000 7f286c33c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.894+0000 7f286c33c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdfcbf2620 con 0x55cdfcce4140 2024-03-20T13:37:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49518/0 (socket says 172.21.15.123:49518) 2024-03-20T13:37:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 -- 172.21.15.123:0/27511181 learned_addr learned my addr 172.21.15.123:0/27511181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 -- 172.21.15.123:0/27511181 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860005d30 con 0x55cdfcce4140 2024-03-20T13:37:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 --2- 172.21.15.123:0/27511181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdce040 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2864001c00 tx=0x7f286400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b34360634bd5f59 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2757e07640 1 -- 172.21.15.123:0/27511181 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f286400e690 con 0x55cdfcce4140 2024-03-20T13:37:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2757e07640 1 -- 172.21.15.123:0/27511181 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400e810 con 0x55cdfcce4140 2024-03-20T13:37:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2757e07640 1 -- 172.21.15.123:0/27511181 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f286400eb30 con 0x55cdfcce4140 2024-03-20T13:37:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- 172.21.15.123:0/27511181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 msgr2=0x55cdfcdce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 --2- 172.21.15.123:0/27511181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdce040 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2864001c00 tx=0x7f286400b6d0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- 172.21.15.123:0/27511181 shutdown_connections 2024-03-20T13:37:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 --2- 172.21.15.123:0/27511181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdce040 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- 172.21.15.123:0/27511181 >> 172.21.15.123:0/27511181 conn(0x55cdfcc57860 msgr2=0x55cdfcdc9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- 172.21.15.123:0/27511181 shutdown_connections 2024-03-20T13:37:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- 172.21.15.123:0/27511181 wait complete. 2024-03-20T13:37:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 Processor -- start 2024-03-20T13:37:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- start start 2024-03-20T13:37:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdd4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f286c33c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdfcbede00 con 0x55cdfcce4140 2024-03-20T13:37:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdd4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdd4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49526/0 (socket says 172.21.15.123:49526) 2024-03-20T13:37:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 -- 172.21.15.123:0/2159175128 learned_addr learned my addr 172.21.15.123:0/2159175128 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdfcc2e4c0 con 0x55cdfcce4140 2024-03-20T13:37:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.898+0000 7f2869e57640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdd4e90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f286400b710 tx=0x7f2864000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2756604640 1 -- 172.21.15.123:0/2159175128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f286401f070 con 0x55cdfcce4140 2024-03-20T13:37:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdfcdd53d0 con 0x55cdfcce4140 2024-03-20T13:37:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2756604640 1 -- 172.21.15.123:0/2159175128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286401a910 con 0x55cdfcce4140 2024-03-20T13:37:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2756604640 1 -- 172.21.15.123:0/2159175128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f286401abf0 con 0x55cdfcce4140 2024-03-20T13:37:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdfcdd5800 con 0x55cdfcce4140 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2756604640 1 -- 172.21.15.123:0/2159175128 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f286400a040 con 0x55cdfcce4140 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2756604640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2750034300 0x7f27500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2756604640 1 -- 172.21.15.123:0/2159175128 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2864049ef0 con 0x55cdfcce4140 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2869656640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2750034300 0x7f27500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfcce8640 0x55cdfcddbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfcddc050 con 0x55cdfcce8640 2024-03-20T13:37:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286a658640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfcce8640 0x55cdfcddbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2869656640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2750034300 0x7f27500367c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28600ad000 tx=0x7f28600a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286a658640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfcce8640 0x55cdfcddbb10 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286a658640 1 -- 172.21.15.123:0/2159175128 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfcce8640 2024-03-20T13:37:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfcddc8c0 0x55cdfcddecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfcddf400 con 0x55cdfcddc8c0 2024-03-20T13:37:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2869e57640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfcddc8c0 0x55cdfcddecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.902+0000 7f2869e57640 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfcddc8c0 0x55cdfcddecb0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f2869e57640 1 -- 172.21.15.123:0/2159175128 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f286402e9a0 con 0x55cdfcddc8c0 2024-03-20T13:37:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfcde0c60 con 0x55cdfcddc8c0 2024-03-20T13:37:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f2869e57640 1 -- 172.21.15.123:0/2159175128 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f286402e3f0 con 0x55cdfcddc8c0 2024-03-20T13:37:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfcddfe60 con 0x55cdfcddc8c0 2024-03-20T13:37:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f2869e57640 1 -- 172.21.15.123:0/2159175128 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f286402e3f0 con 0x55cdfcddc8c0 2024-03-20T13:37:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfcde0270 con 0x55cdfcce8640 2024-03-20T13:37:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286a658640 1 -- 172.21.15.123:0/2159175128 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfcce8640 2024-03-20T13:37:58.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 Processor -- start 2024-03-20T13:37:58.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 -- start start 2024-03-20T13:37:58.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 0x55cdfcdef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286c33c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdfcb86e30 con 0x55cdfcdef360 2024-03-20T13:37:58.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286a658640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 0x55cdfcdef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286a658640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 0x55cdfcdef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49528/0 (socket says 172.21.15.123:49528) 2024-03-20T13:37:58.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.906+0000 7f286a658640 1 -- 172.21.15.123:0/3663509384 learned_addr learned my addr 172.21.15.123:0/3663509384 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286a658640 1 -- 172.21.15.123:0/3663509384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdfcdefcc0 con 0x55cdfcdef360 2024-03-20T13:37:58.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286a658640 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 0x55cdfcdef780 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f285c016cf0 tx=0x7f285c00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f274f7fe640 1 -- 172.21.15.123:0/3663509384 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f285c017660 con 0x55cdfcdef360 2024-03-20T13:37:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f274f7fe640 1 -- 172.21.15.123:0/3663509384 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c0177c0 con 0x55cdfcdef360 2024-03-20T13:37:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdfcdeff10 con 0x55cdfcdef360 2024-03-20T13:37:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f274f7fe640 1 -- 172.21.15.123:0/3663509384 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f285c017a60 con 0x55cdfcdef360 2024-03-20T13:37:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdfcdf0a60 con 0x55cdfcdef360 2024-03-20T13:37:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f274f7fe640 1 -- 172.21.15.123:0/3663509384 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f285c01d020 con 0x55cdfcdef360 2024-03-20T13:37:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f274f7fe640 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27440342b0 0x7f2744036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f274f7fe640 1 -- 172.21.15.123:0/3663509384 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f285c04b250 con 0x55cdfcdef360 2024-03-20T13:37:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f2869e57640 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27440342b0 0x7f2744036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286c33c980 1 Processor -- start 2024-03-20T13:37:58.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286c33c980 1 -- start start 2024-03-20T13:37:58.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f2869e57640 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27440342b0 0x7f2744036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55cdfcddf960 tx=0x7f2864024c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286c33c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfcdfc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286c33c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdfcb7a790 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286a658640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfcdfc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286a658640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfcdfc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49542/0 (socket says 172.21.15.123:49542) 2024-03-20T13:37:58.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286a658640 1 -- 172.21.15.123:0/322528784 learned_addr learned my addr 172.21.15.123:0/322528784 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.910+0000 7f286a658640 1 -- 172.21.15.123:0/322528784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdfcdfccb0 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286a658640 1 --2- 172.21.15.123:0/322528784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfcdfc6e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f285c0495a0 tx=0x7f285c014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5425012d424dfc90 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f274d7fa640 1 -- 172.21.15.123:0/322528784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f285c03b070 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f274d7fa640 1 -- 172.21.15.123:0/322528784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c011e30 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f274d7fa640 1 -- 172.21.15.123:0/322528784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f285c03b1d0 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/322528784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 msgr2=0x55cdfcdfc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 --2- 172.21.15.123:0/322528784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfcdfc6e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f285c0495a0 tx=0x7f285c014740 comp rx=0 tx=0).stop 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/322528784 shutdown_connections 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 --2- 172.21.15.123:0/322528784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfcdfc6e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/322528784 >> 172.21.15.123:0/322528784 conn(0x55cdfcdf8620 msgr2=0x55cdfcdf6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/322528784 shutdown_connections 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/322528784 wait complete. 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 Processor -- start 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- start start 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfce03160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdfce036a0 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286a658640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfce03160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286a658640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfce03160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49548/0 (socket says 172.21.15.123:49548) 2024-03-20T13:37:58.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 learned_addr learned my addr 172.21.15.123:0/3043870058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdfcdf0a60 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286a658640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfce03160 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f285c00dce0 tx=0x7f285c049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f273b7fe640 1 -- 172.21.15.123:0/3043870058 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f285c01fac0 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdfce038a0 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f273b7fe640 1 -- 172.21.15.123:0/3043870058 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c01fc60 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f273b7fe640 1 -- 172.21.15.123:0/3043870058 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f285c0113d0 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdfce03d30 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.914+0000 7f273b7fe640 1 -- 172.21.15.123:0/3043870058 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f285c011530 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f273b7fe640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27340342b0 0x7f2734036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f273b7fe640 1 -- 172.21.15.123:0/3043870058 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f285c044780 con 0x55cdfcdfc2e0 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869e57640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27340342b0 0x7f2734036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfce0e820 0x55cdfce10cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce11400 con 0x55cdfce0e820 2024-03-20T13:37:58.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869656640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfce0e820 0x55cdfce10cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869e57640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27340342b0 0x7f2734036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2864000f70 tx=0x7f286403f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869656640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfce0e820 0x55cdfce10cb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f28600abb90 con 0x55cdfce0e820 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 realm 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce117f0 con 0x55cdfce0e820 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f28600abb90 con 0x55cdfce0e820 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce12040 con 0x55cdfce0e820 2024-03-20T13:37:58.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f28600abb90 con 0x55cdfce0e820 2024-03-20T13:37:58.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfce12a20 0x55cdfce14e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce155c0 con 0x55cdfce12a20 2024-03-20T13:37:58.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286a658640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfce12a20 0x55cdfce14e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286a658640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfce12a20 0x55cdfce14e50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.918+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce15e10 con 0x55cdfce12a20 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286c33c980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286c33c980 20 searching for the correct realm 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55cdfce17b30 0x55cdfce19f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869e57640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55cdfce17b30 0x55cdfce19f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869e57640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55cdfce17b30 0x55cdfce19f20 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286a658640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f285c033070 0x7f285c03b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x7f285c033070 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f285c033070 0x7f285c03b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f285c033070 0x7f285c03b4d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600abb90 con 0x7f285c033070 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.922+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x7f285c033070 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x7f285c033070 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x7f285c033070 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f28600c8040 con 0x7f285c033070 2024-03-20T13:37:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.926+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600c8040 con 0x55cdfce0e820 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x7f285c033070 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce0e820 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x7f285c033070 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.930+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x7f285c033070 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce17b30 2024-03-20T13:37:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a4b0 con 0x55cdfce12a20 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce16740 con 0x55cdfce0e820 2024-03-20T13:37:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.934+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce16af0 con 0x55cdfce12a20 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce16af0 con 0x55cdfce0e820 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 zone default found 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 4 Realm: () 2024-03-20T13:37:58.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 zonegroup default 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1a8f0 con 0x7f285c033070 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1cad0 con 0x55cdfce17b30 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1ce30 con 0x55cdfce17b30 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 started sync module instance, tier type = 2024-03-20T13:37:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.938+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1c0a0 con 0x55cdfce12a20 2024-03-20T13:37:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94343199310928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1c0a0 con 0x55cdfce12a20 2024-03-20T13:37:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1d7a0 con 0x55cdfce0e820 2024-03-20T13:37:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94343199314688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1dbc0 con 0x55cdfce0e820 2024-03-20T13:37:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1e620 con 0x55cdfce12a20 2024-03-20T13:37:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.942+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94343199310928] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94343199314688] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94343199308800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1e140 con 0x55cdfce12a20 2024-03-20T13:37:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1eaf0 con 0x7f285c033070 2024-03-20T13:37:58.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94343199319568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1ea30 con 0x7f285c033070 2024-03-20T13:37:58.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1f9d0 con 0x55cdfce12a20 2024-03-20T13:37:58.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94343199308800] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.946+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94343199319568] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94343199321760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1f990 con 0x55cdfce12a20 2024-03-20T13:37:58.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce1d890 con 0x55cdfce17b30 2024-03-20T13:37:58.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94343199325568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce20640 con 0x55cdfce17b30 2024-03-20T13:37:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce20fb0 con 0x55cdfce17b30 2024-03-20T13:37:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94343199321760] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94343199329040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce20f30 con 0x55cdfce17b30 2024-03-20T13:37:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce21e10 con 0x7f285c033070 2024-03-20T13:37:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.950+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94343199325568] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94343199326624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce21e10 con 0x7f285c033070 2024-03-20T13:37:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=0 2024-03-20T13:37:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=1 2024-03-20T13:37:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=2 2024-03-20T13:37:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=3 2024-03-20T13:37:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=4 2024-03-20T13:37:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94343199329040] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=5 2024-03-20T13:37:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=6 2024-03-20T13:37:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94343199326624] v34'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 20 add_watcher() i=7 2024-03-20T13:37:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce21e10 con 0x55cdfce0e820 2024-03-20T13:37:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.954+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94343199332720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce21d90 con 0x55cdfce0e820 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94343199332720] v34'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f271b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 5 note: GC not initialized 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f271a7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 20 Filter name: none 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f268ffff640 20 reqs_thread_entry: start 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 20 rados->read ofs=0 len=0 2024-03-20T13:37:58.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46890 con 0x55cdfce0e820 2024-03-20T13:37:58.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:58.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46890 con 0x55cdfce17b30 2024-03-20T13:37:58.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f271b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:58.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.958+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94343199332720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce0e820 2024-03-20T13:37:58.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.962+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94343199332720] v34'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.962+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94343199310928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce12a20 2024-03-20T13:37:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.962+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94343199310928] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.962+0000 7f286c33c980 20 remove_watcher() i=0 2024-03-20T13:37:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.962+0000 7f286c33c980 2 removed watcher, disabling cache 2024-03-20T13:37:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.962+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94343199314688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce0e820 2024-03-20T13:37:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.966+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94343199314688] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x55cdfce0e820 2024-03-20T13:37:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.966+0000 7f286c33c980 20 remove_watcher() i=1 2024-03-20T13:37:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.966+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94343199308800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce12a20 2024-03-20T13:37:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.966+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94343199308800] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.966+0000 7f286c33c980 20 remove_watcher() i=2 2024-03-20T13:37:58.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.966+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94343199319568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x7f285c033070 2024-03-20T13:37:58.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94343199319568] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286c33c980 20 remove_watcher() i=3 2024-03-20T13:37:58.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94343199321760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce12a20 2024-03-20T13:37:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286a658640 1 -- 172.21.15.123:0/3043870058 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94343199321760] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f285c00a4d0 con 0x55cdfce12a20 2024-03-20T13:37:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286c33c980 20 remove_watcher() i=4 2024-03-20T13:37:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94343199325568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce17b30 2024-03-20T13:37:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94343199325568] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286c33c980 20 remove_watcher() i=5 2024-03-20T13:37:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.970+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94343199329040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x55cdfce17b30 2024-03-20T13:37:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f2869e57640 1 -- 172.21.15.123:0/3043870058 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94343199329040] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2864058040 con 0x55cdfce17b30 2024-03-20T13:37:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 20 remove_watcher() i=6 2024-03-20T13:37:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94343199326624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55cdfce46850 con 0x7f285c033070 2024-03-20T13:37:58.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94343199326624] v34'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f28600d5060 con 0x7f285c033070 2024-03-20T13:37:58.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 20 remove_watcher() i=7 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfce12a20 msgr2=0x55cdfce14e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfce12a20 0x55cdfce14e50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfce0e820 msgr2=0x55cdfce10cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfce0e820 0x55cdfce10cb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f285c033070 msgr2=0x7f285c03b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f285c033070 0x7f285c03b4d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55cdfce17b30 msgr2=0x55cdfce19f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55cdfce17b30 0x55cdfce19f20 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27340342b0 msgr2=0x7f2734036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27340342b0 0x7f2734036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2864000f70 tx=0x7f286403f000 comp rx=0 tx=0).stop 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 msgr2=0x55cdfce03160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3043870058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdfc2e0 0x55cdfce03160 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f285c00dce0 tx=0x7f285c049530 comp rx=0 tx=0).stop 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 reap_dead start 2024-03-20T13:37:58.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f2869656640 1 -- 172.21.15.123:0/3043870058 reap_dead start 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 shutdown_connections 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 >> 172.21.15.123:0/3043870058 conn(0x55cdfcdf8620 msgr2=0x55cdfcdf5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 shutdown_connections 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3043870058 wait complete. 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27440342b0 msgr2=0x7f2744036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27440342b0 0x7f2744036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55cdfcddf960 tx=0x7f2864024c60 comp rx=0 tx=0).stop 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 msgr2=0x55cdfcdef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 0x55cdfcdef780 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f285c016cf0 tx=0x7f285c00d790 comp rx=0 tx=0).stop 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 shutdown_connections 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f27440342b0 0x7f2744036770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/3663509384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcdef360 0x55cdfcdef780 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 >> 172.21.15.123:0/3663509384 conn(0x55cdfcde4170 msgr2=0x55cdfcde4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 shutdown_connections 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/3663509384 wait complete. 2024-03-20T13:37:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfcddc8c0 msgr2=0x55cdfcddecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfcddc8c0 0x55cdfcddecb0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfcce8640 msgr2=0x55cdfcddbb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfcce8640 0x55cdfcddbb10 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2750034300 msgr2=0x7f27500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2750034300 0x7f27500367c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28600ad000 tx=0x7f28600a5040 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 msgr2=0x55cdfcdd4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdd4e90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f286400b710 tx=0x7f2864000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 shutdown_connections 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55cdfcddc8c0 0x55cdfcddecb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55cdfcce8640 0x55cdfcddbb10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f2750034300 0x7f27500367c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 --2- 172.21.15.123:0/2159175128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cdfcce4140 0x55cdfcdd4e90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 >> 172.21.15.123:0/2159175128 conn(0x55cdfcc57860 msgr2=0x55cdfcdc86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 shutdown_connections 2024-03-20T13:37:58.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:58.974+0000 7f286c33c980 1 -- 172.21.15.123:0/2159175128 wait complete. 2024-03-20T13:37:58.991 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-03-20T13:37:58.991 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-03-20T13:37:58.991 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-03-20T13:37:58.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-03-20T13:37:58.991 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-03-20T13:37:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f62a004b980 1 Processor -- start 2024-03-20T13:37:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f62a004b980 1 -- start start 2024-03-20T13:37:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f62a004b980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a523b548c0 0x55a523be2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f62a004b980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a523b2c4c0 con 0x55a523be3180 2024-03-20T13:37:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f62a004b980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a523af30f0 con 0x55a523b548c0 2024-03-20T13:37:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f629db66640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a523b548c0 0x55a523be2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f629db66640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a523b548c0 0x55a523be2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49562/0 (socket says 172.21.15.123:49562) 2024-03-20T13:37:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f629db66640 1 -- 172.21.15.123:0/395225934 learned_addr learned my addr 172.21.15.123:0/395225934 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f629db66640 1 -- 172.21.15.123:0/395225934 >> v1:172.21.15.89:6789/0 conn(0x55a523be3180 legacy=0x55a523be5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.062+0000 7f629db66640 1 -- 172.21.15.123:0/395225934 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a523be7cd0 con 0x55a523b548c0 2024-03-20T13:37:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f629db66640 1 --2- 172.21.15.123:0/395225934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523be2c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f629000a5c0 tx=0x7f629001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705cac58e6fd183a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f629d365640 1 -- 172.21.15.123:0/395225934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62900aa470 con 0x55a523b548c0 2024-03-20T13:37:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f629d365640 1 -- 172.21.15.123:0/395225934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900aa5d0 con 0x55a523b548c0 2024-03-20T13:37:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f629d365640 1 -- 172.21.15.123:0/395225934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62900aa890 con 0x55a523b548c0 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 -- 172.21.15.123:0/395225934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 msgr2=0x55a523be2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 --2- 172.21.15.123:0/395225934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523be2c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f629000a5c0 tx=0x7f629001b340 comp rx=0 tx=0).stop 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 -- 172.21.15.123:0/395225934 shutdown_connections 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 --2- 172.21.15.123:0/395225934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523be2c40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 -- 172.21.15.123:0/395225934 >> 172.21.15.123:0/395225934 conn(0x55a523bda720 msgr2=0x55a523bdcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 -- 172.21.15.123:0/395225934 shutdown_connections 2024-03-20T13:37:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.066+0000 7f62a004b980 1 -- 172.21.15.123:0/395225934 wait complete. 2024-03-20T13:37:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 Processor -- start 2024-03-20T13:37:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- start start 2024-03-20T13:37:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cc9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a523af0620 con 0x55a523b548c0 2024-03-20T13:37:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cc9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cc9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49572/0 (socket says 172.21.15.123:49572) 2024-03-20T13:37:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 -- 172.21.15.123:0/1382656744 learned_addr learned my addr 172.21.15.123:0/1382656744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 -- 172.21.15.123:0/1382656744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290005df0 con 0x55a523b548c0 2024-03-20T13:37:59.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 --2- 172.21.15.123:0/1382656744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cc9f10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f62900ac040 tx=0x7f6290003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ebdc931c0e5c46 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f618be07640 1 -- 172.21.15.123:0/1382656744 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62900aa9b0 con 0x55a523b548c0 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f618be07640 1 -- 172.21.15.123:0/1382656744 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900aab30 con 0x55a523b548c0 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f618be07640 1 -- 172.21.15.123:0/1382656744 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62900aae10 con 0x55a523b548c0 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- 172.21.15.123:0/1382656744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 msgr2=0x55a523cc9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 --2- 172.21.15.123:0/1382656744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cc9f10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f62900ac040 tx=0x7f6290003030 comp rx=0 tx=0).stop 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- 172.21.15.123:0/1382656744 shutdown_connections 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 --2- 172.21.15.123:0/1382656744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cc9f10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- 172.21.15.123:0/1382656744 >> 172.21.15.123:0/1382656744 conn(0x55a523bda720 msgr2=0x55a523cc5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- 172.21.15.123:0/1382656744 shutdown_connections 2024-03-20T13:37:59.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- 172.21.15.123:0/1382656744 wait complete. 2024-03-20T13:37:59.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 Processor -- start 2024-03-20T13:37:59.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- start start 2024-03-20T13:37:59.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cd0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f62a004b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a523aebe00 con 0x55a523b548c0 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cd0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cd0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49588/0 (socket says 172.21.15.123:49588) 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.082+0000 7f629db66640 1 -- 172.21.15.123:0/3725471129 learned_addr learned my addr 172.21.15.123:0/3725471129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f629db66640 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a523be7cd0 con 0x55a523b548c0 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f629db66640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cd0bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6290005940 tx=0x7f62900180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f618a604640 1 -- 172.21.15.123:0/3725471129 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62900c6750 con 0x55a523b548c0 2024-03-20T13:37:59.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a523cd1130 con 0x55a523b548c0 2024-03-20T13:37:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a523cd1560 con 0x55a523b548c0 2024-03-20T13:37:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f618a604640 1 -- 172.21.15.123:0/3725471129 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900c68b0 con 0x55a523b548c0 2024-03-20T13:37:59.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f618a604640 1 -- 172.21.15.123:0/3725471129 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62900c6b50 con 0x55a523b548c0 2024-03-20T13:37:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f618a604640 1 -- 172.21.15.123:0/3725471129 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62900c6cb0 con 0x55a523b548c0 2024-03-20T13:37:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f618a604640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61840342b0 0x7f6184036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f618a604640 1 -- 172.21.15.123:0/3725471129 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f62900e4480 con 0x55a523b548c0 2024-03-20T13:37:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f6297fff640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61840342b0 0x7f6184036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523be3180 0x55a523cd7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523cd7db0 con 0x55a523be3180 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f629e367640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523be3180 0x55a523cd7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f6297fff640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61840342b0 0x7f6184036770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6288000f70 tx=0x7f6288001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f629e367640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523be3180 0x55a523cd7870 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f629e367640 1 -- 172.21.15.123:0/3725471129 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523be3180 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523cd8620 0x55a523cdaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.086+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523cdb140 con 0x55a523cd8620 2024-03-20T13:37:59.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f629db66640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523cd8620 0x55a523cdaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f629db66640 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523cd8620 0x55a523cdaa10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f629db66640 1 -- 172.21.15.123:0/3725471129 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62900b0020 con 0x55a523cd8620 2024-03-20T13:37:59.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523cdc980 con 0x55a523cd8620 2024-03-20T13:37:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f629db66640 1 -- 172.21.15.123:0/3725471129 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f62900b0020 con 0x55a523cd8620 2024-03-20T13:37:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523cdba90 con 0x55a523cd8620 2024-03-20T13:37:59.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f629db66640 1 -- 172.21.15.123:0/3725471129 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62900b0020 con 0x55a523cd8620 2024-03-20T13:37:59.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523cdbea0 con 0x55a523be3180 2024-03-20T13:37:59.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f629e367640 1 -- 172.21.15.123:0/3725471129 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523be3180 2024-03-20T13:37:59.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 Processor -- start 2024-03-20T13:37:59.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 -- start start 2024-03-20T13:37:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 0x55a523ceb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.090+0000 7f62a004b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a523a84e30 con 0x55a523ceb000 2024-03-20T13:37:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629e367640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 0x55a523ceb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629e367640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 0x55a523ceb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49598/0 (socket says 172.21.15.123:49598) 2024-03-20T13:37:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629e367640 1 -- 172.21.15.123:0/1431628656 learned_addr learned my addr 172.21.15.123:0/1431628656 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629e367640 1 -- 172.21.15.123:0/1431628656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a523ceb960 con 0x55a523ceb000 2024-03-20T13:37:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629e367640 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 0x55a523ceb420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6298016cf0 tx=0x7f629800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f61837fe640 1 -- 172.21.15.123:0/1431628656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6298017660 con 0x55a523ceb000 2024-03-20T13:37:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f61837fe640 1 -- 172.21.15.123:0/1431628656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62980177c0 con 0x55a523ceb000 2024-03-20T13:37:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f61837fe640 1 -- 172.21.15.123:0/1431628656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6298017a60 con 0x55a523ceb000 2024-03-20T13:37:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a523cebbb0 con 0x55a523ceb000 2024-03-20T13:37:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a523cec700 con 0x55a523ceb000 2024-03-20T13:37:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f61837fe640 1 -- 172.21.15.123:0/1431628656 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f629801d020 con 0x55a523ceb000 2024-03-20T13:37:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f61837fe640 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61780342b0 0x7f6178036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f61837fe640 1 -- 172.21.15.123:0/1431628656 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f629804b250 con 0x55a523ceb000 2024-03-20T13:37:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629db66640 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61780342b0 0x7f6178036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f62a004b980 1 Processor -- start 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f62a004b980 1 -- start start 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f629db66640 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61780342b0 0x7f6178036770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55a523cdb590 tx=0x7f62900de040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f62a004b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523be0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.094+0000 7f62a004b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a523a78790 con 0x55a523be01f0 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523be0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523be0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49612/0 (socket says 172.21.15.123:49612) 2024-03-20T13:37:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 -- 172.21.15.123:0/2851527751 learned_addr learned my addr 172.21.15.123:0/2851527751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 -- 172.21.15.123:0/2851527751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a523bdea20 con 0x55a523be01f0 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 --2- 172.21.15.123:0/2851527751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523be0610 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f62980495a0 tx=0x7f6298014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cc4734cb80818f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f61817fa640 1 -- 172.21.15.123:0/2851527751 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f629803b070 con 0x55a523be01f0 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f61817fa640 1 -- 172.21.15.123:0/2851527751 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6298011e30 con 0x55a523be01f0 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f61817fa640 1 -- 172.21.15.123:0/2851527751 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f629803b1d0 con 0x55a523be01f0 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/2851527751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 msgr2=0x55a523be0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 --2- 172.21.15.123:0/2851527751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523be0610 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f62980495a0 tx=0x7f6298014740 comp rx=0 tx=0).stop 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/2851527751 shutdown_connections 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 --2- 172.21.15.123:0/2851527751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523be0610 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/2851527751 >> 172.21.15.123:0/2851527751 conn(0x55a523cf42c0 msgr2=0x55a523cf2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/2851527751 shutdown_connections 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/2851527751 wait complete. 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 Processor -- start 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- start start 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523d01030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a523d01570 con 0x55a523be01f0 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523d01030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523d01030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49626/0 (socket says 172.21.15.123:49626) 2024-03-20T13:37:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 learned_addr learned my addr 172.21.15.123:0/996344305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a523cec700 con 0x55a523be01f0 2024-03-20T13:37:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f629e367640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523d01030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f629800dce0 tx=0x7f6298049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f616f7fe640 1 -- 172.21.15.123:0/996344305 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62980481d0 con 0x55a523be01f0 2024-03-20T13:37:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f616f7fe640 1 -- 172.21.15.123:0/996344305 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629801fd70 con 0x55a523be01f0 2024-03-20T13:37:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a523d01770 con 0x55a523be01f0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f616f7fe640 1 -- 172.21.15.123:0/996344305 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6298011500 con 0x55a523be01f0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.098+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a523d01c00 con 0x55a523be01f0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f616f7fe640 1 -- 172.21.15.123:0/996344305 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6298011660 con 0x55a523be01f0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f616f7fe640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61680342b0 0x7f6168036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f616f7fe640 1 -- 172.21.15.123:0/996344305 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f6298044020 con 0x55a523be01f0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f629db66640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61680342b0 0x7f6168036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523d0c740 0x55a523d0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d0f330 con 0x55a523d0c740 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f6297fff640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523d0c740 0x55a523d0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f629db66640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61680342b0 0x7f6168036770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62900aa5a0 tx=0x7f62900e8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f6297fff640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523d0c740 0x55a523d0ebe0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 realm 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d0bcb0 con 0x55a523d0c740 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d0fe00 con 0x55a523d0c740 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523d10b90 0x55a523d12f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d13630 con 0x55a523d10b90 2024-03-20T13:37:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f629e367640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523d10b90 0x55a523d12f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.102+0000 7f629e367640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523d10b90 0x55a523d12f80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d13e80 con 0x55a523d10b90 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 20 searching for the correct realm 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a523d15ba0 0x55a523d17f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629db66640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a523d15ba0 0x55a523d17f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629db66640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a523d15ba0 0x55a523d17f90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629e367640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6298033070 0x7f6298020880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x7f6298033070 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6298033070 0x7f6298020880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6298033070 0x7f6298020880 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x7f6298033070 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.106+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x7f6298033070 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x7f6298033070 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x7f6298033070 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f628800bdd0 con 0x7f6298033070 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.110+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628800bdd0 con 0x55a523d0c740 2024-03-20T13:37:59.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x7f6298033070 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d0c740 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x7f6298033070 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x7f6298033070 2024-03-20T13:37:59.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.114+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d15ba0 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18520 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d147b0 con 0x55a523d0c740 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d14bf0 con 0x55a523d10b90 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.118+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d14fd0 con 0x55a523d0c740 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 zone default found 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 4 Realm: () 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 zonegroup default 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d18960 con 0x7f6298033070 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1ab40 con 0x55a523d15ba0 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1aea0 con 0x55a523d15ba0 2024-03-20T13:37:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 started sync module instance, tier type = 2024-03-20T13:37:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:59.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1a110 con 0x55a523d10b90 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94167758906560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1a110 con 0x55a523d10b90 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.122+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1b810 con 0x55a523d0c740 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94167758910320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1b790 con 0x55a523d0c740 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1c720 con 0x55a523d10b90 2024-03-20T13:37:59.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94167758906560] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94167758910320] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94167758912496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1c6e0 con 0x55a523d10b90 2024-03-20T13:37:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1cf70 con 0x7f6298033070 2024-03-20T13:37:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.126+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94167758916304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1c6e0 con 0x7f6298033070 2024-03-20T13:37:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.130+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1da90 con 0x55a523d10b90 2024-03-20T13:37:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.130+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94167758912496] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.130+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94167758916304] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.130+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.130+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94167758917360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1da90 con 0x55a523d10b90 2024-03-20T13:37:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.130+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1de70 con 0x55a523d15ba0 2024-03-20T13:37:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94167758914048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1de70 con 0x55a523d15ba0 2024-03-20T13:37:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1ecd0 con 0x55a523d15ba0 2024-03-20T13:37:59.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94167758917360] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94167758914048] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94167758922272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1e830 con 0x55a523d15ba0 2024-03-20T13:37:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1f520 con 0x7f6298033070 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94167758922272] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94167758919088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1e830 con 0x7f6298033070 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=0 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=1 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=2 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=3 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=4 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=5 2024-03-20T13:37:59.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=6 2024-03-20T13:37:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94167758919088] v34'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 20 add_watcher() i=7 2024-03-20T13:37:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.134+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d226f0 con 0x55a523d0c740 2024-03-20T13:37:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94167758925952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d1fb30 con 0x55a523d0c740 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94167758925952] v34'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f614f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 5 note: GC not initialized 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f614e7fc640 20 reqs_thread_entry: start 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 20 Filter name: none 2024-03-20T13:37:59.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f60bffff640 20 reqs_thread_entry: start 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d0c740 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d15ba0 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.138+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.142+0000 7f614f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:59.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.142+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94167758925952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d0c740 2024-03-20T13:37:59.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.142+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94167758925952] v34'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.142+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94167758906560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d10b90 2024-03-20T13:37:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94167758906560] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f62a004b980 20 remove_watcher() i=0 2024-03-20T13:37:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f62a004b980 2 removed watcher, disabling cache 2024-03-20T13:37:59.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94167758910320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d0c740 2024-03-20T13:37:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94167758910320] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x55a523d0c740 2024-03-20T13:37:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f62a004b980 20 remove_watcher() i=1 2024-03-20T13:37:59.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.146+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94167758912496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d10b90 2024-03-20T13:37:59.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.150+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94167758912496] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.150+0000 7f62a004b980 20 remove_watcher() i=2 2024-03-20T13:37:59.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.150+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94167758916304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x7f6298033070 2024-03-20T13:37:59.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.150+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94167758916304] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.150+0000 7f62a004b980 20 remove_watcher() i=3 2024-03-20T13:37:59.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.150+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94167758917360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d10b90 2024-03-20T13:37:59.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f629e367640 1 -- 172.21.15.123:0/996344305 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94167758917360] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629800a4d0 con 0x55a523d10b90 2024-03-20T13:37:59.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 20 remove_watcher() i=4 2024-03-20T13:37:59.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94167758914048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d15ba0 2024-03-20T13:37:59.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94167758914048] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 20 remove_watcher() i=5 2024-03-20T13:37:59.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94167758922272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x55a523d15ba0 2024-03-20T13:37:59.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f629db66640 1 -- 172.21.15.123:0/996344305 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94167758922272] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62900b0020 con 0x55a523d15ba0 2024-03-20T13:37:59.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 20 remove_watcher() i=6 2024-03-20T13:37:59.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94167758919088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a523d44150 con 0x7f6298033070 2024-03-20T13:37:59.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94167758919088] v34'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288028040 con 0x7f6298033070 2024-03-20T13:37:59.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 20 remove_watcher() i=7 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523d10b90 msgr2=0x55a523d12f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523d10b90 0x55a523d12f80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523d0c740 msgr2=0x55a523d0ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523d0c740 0x55a523d0ebe0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6298033070 msgr2=0x7f6298020880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f6298033070 0x7f6298020880 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a523d15ba0 msgr2=0x55a523d17f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a523d15ba0 0x55a523d17f90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61680342b0 msgr2=0x7f6168036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61680342b0 0x7f6168036770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62900aa5a0 tx=0x7f62900e8000 comp rx=0 tx=0).stop 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 msgr2=0x55a523d01030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f6297fff640 1 -- 172.21.15.123:0/996344305 reap_dead start 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523d01030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f629800dce0 tx=0x7f6298049530 comp rx=0 tx=0).stop 2024-03-20T13:37:59.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 shutdown_connections 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 --2- 172.21.15.123:0/996344305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523be01f0 0x55a523d01030 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 >> 172.21.15.123:0/996344305 conn(0x55a523cf42c0 msgr2=0x55a523cf1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 shutdown_connections 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.154+0000 7f62a004b980 1 -- 172.21.15.123:0/996344305 wait complete. 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61780342b0 msgr2=0x7f6178036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61780342b0 0x7f6178036770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55a523cdb590 tx=0x7f62900de040 comp rx=0 tx=0).stop 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 msgr2=0x55a523ceb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 0x55a523ceb420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6298016cf0 tx=0x7f629800d790 comp rx=0 tx=0).stop 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 shutdown_connections 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61780342b0 0x7f6178036770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/1431628656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523ceb000 0x55a523ceb420 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 >> 172.21.15.123:0/1431628656 conn(0x55a523cdfe10 msgr2=0x55a523ce0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 shutdown_connections 2024-03-20T13:37:59.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/1431628656 wait complete. 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523cd8620 msgr2=0x55a523cdaa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523cd8620 0x55a523cdaa10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523be3180 msgr2=0x55a523cd7870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523be3180 0x55a523cd7870 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61840342b0 msgr2=0x7f6184036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61840342b0 0x7f6184036770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6288000f70 tx=0x7f6288001420 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 msgr2=0x55a523cd0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cd0bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6290005940 tx=0x7f62900180e0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 shutdown_connections 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a523cd8620 0x55a523cdaa10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a523be3180 0x55a523cd7870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f61840342b0 0x7f6184036770 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 --2- 172.21.15.123:0/3725471129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a523b548c0 0x55a523cd0bf0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 >> 172.21.15.123:0/3725471129 conn(0x55a523bda720 msgr2=0x55a523cc45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 shutdown_connections 2024-03-20T13:37:59.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.158+0000 7f62a004b980 1 -- 172.21.15.123:0/3725471129 wait complete. 2024-03-20T13:37:59.170 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-03-20T13:37:59.171 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-03-20T13:37:59.171 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-03-20T13:37:59.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-03-20T13:37:59.171 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-03-20T13:37:59.247 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:59.247 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.242+0000 7fc224ecc980 1 Processor -- start 2024-03-20T13:37:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.242+0000 7fc224ecc980 1 -- start start 2024-03-20T13:37:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.242+0000 7fc224ecc980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557f100f1390 0x557f100f3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.242+0000 7fc224ecc980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557f1003a4c0 con 0x557f100ece80 2024-03-20T13:37:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.242+0000 7fc224ecc980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557f100010f0 con 0x557f100f1390 2024-03-20T13:37:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2221e6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557f100f1390 0x557f100f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2221e6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557f100f1390 0x557f100f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49638/0 (socket says 172.21.15.123:49638) 2024-03-20T13:37:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2221e6640 1 -- 172.21.15.123:0/3256410807 learned_addr learned my addr 172.21.15.123:0/3256410807 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2221e6640 1 -- 172.21.15.123:0/3256410807 >> v1:172.21.15.89:6789/0 conn(0x557f100ece80 legacy=0x557f100ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2221e6640 1 -- 172.21.15.123:0/3256410807 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f100f4cd0 con 0x557f100f1390 2024-03-20T13:37:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2221e6640 1 --2- 172.21.15.123:0/3256410807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100f1390 0x557f100f3780 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc21800a5c0 tx=0x7fc21801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92a6d981c5b30a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2219e5640 1 -- 172.21.15.123:0/3256410807 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2180aa470 con 0x557f100f1390 2024-03-20T13:37:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2219e5640 1 -- 172.21.15.123:0/3256410807 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180aa5d0 con 0x557f100f1390 2024-03-20T13:37:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc2219e5640 1 -- 172.21.15.123:0/3256410807 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2180aa890 con 0x557f100f1390 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 -- 172.21.15.123:0/3256410807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100f1390 msgr2=0x557f100f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3256410807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100f1390 0x557f100f3780 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc21800a5c0 tx=0x7fc21801b340 comp rx=0 tx=0).stop 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 -- 172.21.15.123:0/3256410807 shutdown_connections 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3256410807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100f1390 0x557f100f3780 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 -- 172.21.15.123:0/3256410807 >> 172.21.15.123:0/3256410807 conn(0x557f100e8750 msgr2=0x557f100eab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 -- 172.21.15.123:0/3256410807 shutdown_connections 2024-03-20T13:37:59.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.246+0000 7fc224ecc980 1 -- 172.21.15.123:0/3256410807 wait complete. 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 Processor -- start 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- start start 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101d6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f0fffe620 con 0x557f100ece80 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc2229e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101d6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc2229e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101d6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49640/0 (socket says 172.21.15.123:49640) 2024-03-20T13:37:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc2229e7640 1 -- 172.21.15.123:0/3101285629 learned_addr learned my addr 172.21.15.123:0/3101285629 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc2229e7640 1 -- 172.21.15.123:0/3101285629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218005df0 con 0x557f100ece80 2024-03-20T13:37:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc2229e7640 1 --2- 172.21.15.123:0/3101285629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101d6e20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc214001d10 tx=0x7fc21400d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b7546bab3518fb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc110e09640 1 -- 172.21.15.123:0/3101285629 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21400b7a0 con 0x557f100ece80 2024-03-20T13:37:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc110e09640 1 -- 172.21.15.123:0/3101285629 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400b920 con 0x557f100ece80 2024-03-20T13:37:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc110e09640 1 -- 172.21.15.123:0/3101285629 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21400bc00 con 0x557f100ece80 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- 172.21.15.123:0/3101285629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 msgr2=0x557f101d6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3101285629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101d6e20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc214001d10 tx=0x7fc21400d7d0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- 172.21.15.123:0/3101285629 shutdown_connections 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3101285629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101d6e20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- 172.21.15.123:0/3101285629 >> 172.21.15.123:0/3101285629 conn(0x557f100e8750 msgr2=0x557f101d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- 172.21.15.123:0/3101285629 shutdown_connections 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- 172.21.15.123:0/3101285629 wait complete. 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 Processor -- start 2024-03-20T13:37:59.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- start start 2024-03-20T13:37:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101dcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.262+0000 7fc224ecc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f0fff9e00 con 0x557f100ece80 2024-03-20T13:37:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2229e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101dcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2229e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101dcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49654/0 (socket says 172.21.15.123:49654) 2024-03-20T13:37:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2229e7640 1 -- 172.21.15.123:0/3404387479 learned_addr learned my addr 172.21.15.123:0/3404387479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2229e7640 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1003a4c0 con 0x557f100ece80 2024-03-20T13:37:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2229e7640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101dcbf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc21400d810 tx=0x7fc214000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc10f606640 1 -- 172.21.15.123:0/3404387479 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc214016560 con 0x557f100ece80 2024-03-20T13:37:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f101dd130 con 0x557f100ece80 2024-03-20T13:37:59.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f101dd560 con 0x557f100ece80 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc10f606640 1 -- 172.21.15.123:0/3404387479 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2140166c0 con 0x557f100ece80 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc10f606640 1 -- 172.21.15.123:0/3404387479 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc214016960 con 0x557f100ece80 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc10f606640 1 -- 172.21.15.123:0/3404387479 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc214016ac0 con 0x557f100ece80 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc10f606640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc108034300 0x7fc1080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc10f606640 1 -- 172.21.15.123:0/3404387479 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc21404a760 con 0x557f100ece80 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2221e6640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc108034300 0x7fc1080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f100f1390 0x557f101e3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f101e3db0 con 0x557f100f1390 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2231e8640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f100f1390 0x557f101e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2221e6640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc108034300 0x7fc1080367c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2180ae000 tx=0x7fc2180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2231e8640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f100f1390 0x557f101e3870 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc2231e8640 1 -- 172.21.15.123:0/3404387479 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f100f1390 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f101e4620 0x557f101e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.266+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f101e70d0 con 0x557f101e4620 2024-03-20T13:37:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc2229e7640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f101e4620 0x557f101e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc2229e7640 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f101e4620 0x557f101e6a10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc2229e7640 1 -- 172.21.15.123:0/3404387479 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f101e4620 2024-03-20T13:37:59.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f101e8910 con 0x557f101e4620 2024-03-20T13:37:59.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc2229e7640 1 -- 172.21.15.123:0/3404387479 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f101e4620 2024-03-20T13:37:59.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f101e7b10 con 0x557f101e4620 2024-03-20T13:37:59.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc2229e7640 1 -- 172.21.15.123:0/3404387479 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f101e4620 2024-03-20T13:37:59.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f101e7f20 con 0x557f100f1390 2024-03-20T13:37:59.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc2231e8640 1 -- 172.21.15.123:0/3404387479 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f100f1390 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 Processor -- start 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 -- start start 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 0x557f101fb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.270+0000 7fc224ecc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f0ff92e30 con 0x557f101fb420 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 0x557f101fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 0x557f101fb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49664/0 (socket says 172.21.15.123:49664) 2024-03-20T13:37:59.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 -- 172.21.15.123:0/1315230837 learned_addr learned my addr 172.21.15.123:0/1315230837 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 -- 172.21.15.123:0/1315230837 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f101fbd80 con 0x557f101fb420 2024-03-20T13:37:59.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 0x557f101fb840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc21c016cf0 tx=0x7fc21c00d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc10ce01640 1 -- 172.21.15.123:0/1315230837 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21c017660 con 0x557f101fb420 2024-03-20T13:37:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc10ce01640 1 -- 172.21.15.123:0/1315230837 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0177c0 con 0x557f101fb420 2024-03-20T13:37:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f101fbfd0 con 0x557f101fb420 2024-03-20T13:37:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc10ce01640 1 -- 172.21.15.123:0/1315230837 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21c017a60 con 0x557f101fb420 2024-03-20T13:37:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f101fcb20 con 0x557f101fb420 2024-03-20T13:37:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc10ce01640 1 -- 172.21.15.123:0/1315230837 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc21c01d020 con 0x557f101fb420 2024-03-20T13:37:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc10ce01640 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0fc0342b0 0x7fc0fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc10ce01640 1 -- 172.21.15.123:0/1315230837 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc21c04b5f0 con 0x557f101fb420 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2229e7640 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0fc0342b0 0x7fc0fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc224ecc980 1 Processor -- start 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2229e7640 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0fc0342b0 0x7fc0fc036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x557f101e7610 tx=0x7fc21400af50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc224ecc980 1 -- start start 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc224ecc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f102087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc224ecc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f0ff86790 con 0x557f102083a0 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f102087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f102087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49672/0 (socket says 172.21.15.123:49672) 2024-03-20T13:37:59.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.274+0000 7fc2231e8640 1 -- 172.21.15.123:0/2282755747 learned_addr learned my addr 172.21.15.123:0/2282755747 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 -- 172.21.15.123:0/2282755747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f10208d90 con 0x557f102083a0 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 --2- 172.21.15.123:0/2282755747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f102087c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc21c049970 tx=0x7fc21c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c296baa9645ac server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc1067fc640 1 -- 172.21.15.123:0/2282755747 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21c020510 con 0x557f102083a0 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc1067fc640 1 -- 172.21.15.123:0/2282755747 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c040030 con 0x557f102083a0 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc1067fc640 1 -- 172.21.15.123:0/2282755747 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21c017bc0 con 0x557f102083a0 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2282755747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 msgr2=0x557f102087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2282755747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f102087c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc21c049970 tx=0x7fc21c011ad0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2282755747 shutdown_connections 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2282755747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f102087c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2282755747 >> 172.21.15.123:0/2282755747 conn(0x557f10204690 msgr2=0x557f10202740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2282755747 shutdown_connections 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2282755747 wait complete. 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 Processor -- start 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- start start 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f1020f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1020f730 con 0x557f102083a0 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f1020f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f1020f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49676/0 (socket says 172.21.15.123:49676) 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 learned_addr learned my addr 172.21.15.123:0/2942952238 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f101fcb20 con 0x557f102083a0 2024-03-20T13:37:59.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc2231e8640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f1020f1f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc21c029cf0 tx=0x7fc21c0498d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc104ff9640 1 -- 172.21.15.123:0/2942952238 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21c030070 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f1020f930 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc104ff9640 1 -- 172.21.15.123:0/2942952238 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0484a0 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc104ff9640 1 -- 172.21.15.123:0/2942952238 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc21c04b0d0 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.278+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f1020fd60 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc104ff9640 1 -- 172.21.15.123:0/2942952238 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc21c04b230 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc104ff9640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0ec0342b0 0x7fc0ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc104ff9640 1 -- 172.21.15.123:0/2942952238 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc21c037d50 con 0x557f102083a0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2229e7640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0ec0342b0 0x7fc0ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f1021a930 0x557f1021cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1021d540 con 0x557f1021a930 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2221e6640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f1021a930 0x557f1021cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2229e7640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0ec0342b0 0x7fc0ec036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc21404aa10 tx=0x7fc214032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2221e6640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f1021a930 0x557f1021cdf0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 realm 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1021d930 con 0x557f1021a930 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1021e180 con 0x557f1021a930 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f1021eb60 0x557f10220fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221720 con 0x557f1021eb60 2024-03-20T13:37:59.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2231e8640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f1021eb60 0x557f10220fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2231e8640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f1021eb60 0x557f10220fb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:59.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.282+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc224ecc980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc224ecc980 20 searching for the correct realm 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f10223f60 0x557f10226420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10226af0 con 0x557f10223f60 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2229e7640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f10223f60 0x557f10226420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2229e7640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f10223f60 0x557f10226420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10226af0 con 0x557f1021eb60 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2231e8640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc21c014920 0x7fc21c03b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x7fc21c014920 2024-03-20T13:37:59.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc21c014920 0x7fc21c03b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc21c014920 0x7fc21c03b050 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x7fc21c014920 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f10223f60 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.286+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x7fc21c014920 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x7fc21c014920 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x7fc21c014920 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc2180b0020 con 0x7fc21c014920 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f10223f60 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.290+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f10223f60 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180b0020 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f10223f60 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x7fc21c014920 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021a930 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x7fc21c014920 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f10223f60 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x7fc21c014920 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.294+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f10223f60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10221f20 con 0x557f1021eb60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:59.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102223a0 con 0x557f1021a930 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10222750 con 0x557f1021eb60 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10222750 con 0x557f1021a930 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 zone default found 2024-03-20T13:37:59.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 4 Realm: () 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 zonegroup default 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10222fd0 con 0x7fc21c014920 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10228db0 con 0x557f10223f60 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.298+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10229110 con 0x557f10223f60 2024-03-20T13:37:59.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 20 started sync module instance, tier type = 2024-03-20T13:37:59.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:59.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10228380 con 0x557f1021eb60 2024-03-20T13:37:59.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94004219905888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10228380 con 0x557f1021eb60 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10229a80 con 0x557f1021a930 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94004219909600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10229ea0 con 0x557f1021a930 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.302+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022a8d0 con 0x557f1021eb60 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94004219909600] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94004219905888] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94004219913168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10229a00 con 0x557f1021eb60 2024-03-20T13:37:59.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022b120 con 0x7fc21c014920 2024-03-20T13:37:59.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94004219915392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10229a00 con 0x7fc21c014920 2024-03-20T13:37:59.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.306+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022bbf0 con 0x557f1021eb60 2024-03-20T13:37:59.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94004219915392] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94004219913168] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94004219903712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022bbf0 con 0x557f1021eb60 2024-03-20T13:37:59.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022bfa0 con 0x557f10223f60 2024-03-20T13:37:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94004219918048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022c7f0 con 0x557f10223f60 2024-03-20T13:37:59.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022d1c0 con 0x557f10223f60 2024-03-20T13:37:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94004219903712] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94004219918048] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94004219921232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022b0a0 con 0x557f10223f60 2024-03-20T13:37:59.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.310+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022da10 con 0x7fc21c014920 2024-03-20T13:37:59.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94004219921232] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94004219923648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022da10 con 0x7fc21c014920 2024-03-20T13:37:59.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=0 2024-03-20T13:37:59.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=1 2024-03-20T13:37:59.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=2 2024-03-20T13:37:59.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=3 2024-03-20T13:37:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=4 2024-03-20T13:37:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=5 2024-03-20T13:37:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=6 2024-03-20T13:37:59.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94004219923648] v34'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 20 add_watcher() i=7 2024-03-20T13:37:59.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:59.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10230e60 con 0x557f1021a930 2024-03-20T13:37:59.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.314+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94004219926336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f1022e340 con 0x557f1021a930 2024-03-20T13:37:59.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94004219926336] v34'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc0d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:59.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:59.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 5 note: GC not initialized 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc053fff640 20 reqs_thread_entry: start 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 Filter name: none 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc051ffb640 20 reqs_thread_entry: start 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10252ec0 con 0x7fc21c014920 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-20T13:37:59.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10252ec0 con 0x557f1021a930 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-20T13:37:59.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.318+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10251b80 con 0x7fc21c014920 2024-03-20T13:37:59.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~346] v34'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-03-20T13:37:59.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94004220075840 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10256420 con 0x7fc21c014920 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== watch-notify(notify (1) cookie 94004219923648 notify 146028888077 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fc2180d0040 con 0x7fc21c014920 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94004219923648 notifier 4724 bl.length()=522 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(65 notify.7 [notify cookie 94004220075840 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fc0e8003ea0 con 0x7fc21c014920 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== watch-notify(notify_complete (2) cookie 94004220075840 notify 146028888077 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc2180b9070 con 0x7fc21c014920 2024-03-20T13:37:59.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f10251f40 con 0x557f1021a930 2024-03-20T13:37:59.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94004220075840 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102563d0 con 0x557f10223f60 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 94004219918048 notify 146028888078 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x557f101dd560 con 0x557f10223f60 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94004219918048 notifier 4724 bl.length()=177 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc1067fc640 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fc0e8003ea0 con 0x557f10223f60 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.322+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(68 notify.5 [notify cookie 94004220075840 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.326+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.326+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== watch-notify(notify_complete (2) cookie 94004220075840 notify 146028888078 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f101dd130 con 0x557f10223f60 2024-03-20T13:37:59.331 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.326+0000 7fc0d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.326+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94004219926336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f1021a930 2024-03-20T13:37:59.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.326+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94004219926336] v34'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.326+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94004219905888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f1021eb60 2024-03-20T13:37:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94004219905888] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc224ecc980 20 remove_watcher() i=0 2024-03-20T13:37:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc224ecc980 2 removed watcher, disabling cache 2024-03-20T13:37:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94004219909600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f1021a930 2024-03-20T13:37:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94004219909600] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x557f1021a930 2024-03-20T13:37:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc224ecc980 20 remove_watcher() i=1 2024-03-20T13:37:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.330+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94004219913168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f1021eb60 2024-03-20T13:37:59.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.334+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94004219913168] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.334+0000 7fc224ecc980 20 remove_watcher() i=2 2024-03-20T13:37:59.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.334+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94004219915392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x7fc21c014920 2024-03-20T13:37:59.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.334+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94004219915392] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.334+0000 7fc224ecc980 20 remove_watcher() i=3 2024-03-20T13:37:59.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.334+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94004219903712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f1021eb60 2024-03-20T13:37:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc2231e8640 1 -- 172.21.15.123:0/2942952238 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94004219903712] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21c00a4d0 con 0x557f1021eb60 2024-03-20T13:37:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 20 remove_watcher() i=4 2024-03-20T13:37:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94004219918048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f10223f60 2024-03-20T13:37:59.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94004219918048] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 20 remove_watcher() i=5 2024-03-20T13:37:59.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94004219921232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x557f10223f60 2024-03-20T13:37:59.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc2229e7640 1 -- 172.21.15.123:0/2942952238 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94004219921232] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc21400a9c0 con 0x557f10223f60 2024-03-20T13:37:59.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 20 remove_watcher() i=6 2024-03-20T13:37:59.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94004219923648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x557f102518e0 con 0x7fc21c014920 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94004219923648] v34'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2180d5060 con 0x7fc21c014920 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.338+0000 7fc224ecc980 20 remove_watcher() i=7 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f1021eb60 msgr2=0x557f10220fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f1021eb60 0x557f10220fb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f1021a930 msgr2=0x557f1021cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f1021a930 0x557f1021cdf0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc21c014920 msgr2=0x7fc21c03b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fc21c014920 0x7fc21c03b050 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f10223f60 msgr2=0x557f10226420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x557f10223f60 0x557f10226420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0ec0342b0 msgr2=0x7fc0ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0ec0342b0 0x7fc0ec036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc21404aa10 tx=0x7fc214032000 comp rx=0 tx=0).stop 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 msgr2=0x557f1020f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc2221e6640 1 -- 172.21.15.123:0/2942952238 reap_dead start 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f1020f1f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc21c029cf0 tx=0x7fc21c0498d0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 shutdown_connections 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/2942952238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f102083a0 0x557f1020f1f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 >> 172.21.15.123:0/2942952238 conn(0x557f10204690 msgr2=0x557f10201d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 shutdown_connections 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/2942952238 wait complete. 2024-03-20T13:37:59.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0fc0342b0 msgr2=0x7fc0fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0fc0342b0 0x7fc0fc036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x557f101e7610 tx=0x7fc21400af50 comp rx=0 tx=0).stop 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 msgr2=0x557f101fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 0x557f101fb840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc21c016cf0 tx=0x7fc21c00d790 comp rx=0 tx=0).stop 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 shutdown_connections 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0fc0342b0 0x7fc0fc036770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/1315230837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f101fb420 0x557f101fb840 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 >> 172.21.15.123:0/1315230837 conn(0x557f101ebe20 msgr2=0x557f101ec930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 shutdown_connections 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/1315230837 wait complete. 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f101e4620 msgr2=0x557f101e6a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f101e4620 0x557f101e6a10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f100f1390 msgr2=0x557f101e3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f100f1390 0x557f101e3870 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc108034300 msgr2=0x7fc1080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc108034300 0x7fc1080367c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2180ae000 tx=0x7fc2180a6000 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 msgr2=0x557f101dcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101dcbf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc21400d810 tx=0x7fc214000bd0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 shutdown_connections 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x557f101e4620 0x557f101e6a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x557f100f1390 0x557f101e3870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc108034300 0x7fc1080367c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 --2- 172.21.15.123:0/3404387479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557f100ece80 0x557f101dcbf0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 >> 172.21.15.123:0/3404387479 conn(0x557f100e8750 msgr2=0x557f101d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 shutdown_connections 2024-03-20T13:37:59.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.342+0000 7fc224ecc980 1 -- 172.21.15.123:0/3404387479 wait complete. 2024-03-20T13:37:59.356 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:37:59.377 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:37:59.384 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-03-20T13:37:59.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-03-20T13:37:59.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-03-20T13:37:59.385 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-03-20T13:37:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:37:59.425 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:37:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba396fb980 1 Processor -- start 2024-03-20T13:37:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba396fb980 1 -- start start 2024-03-20T13:37:59.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba396fb980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x559e8ba06e10 0x559e8ba071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba396fb980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559e8b9544c0 con 0x559e8ba07730 2024-03-20T13:37:59.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba396fb980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x559e8b91b0f0 con 0x559e8ba06e10 2024-03-20T13:37:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba37216640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x559e8ba06e10 0x559e8ba071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba37216640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x559e8ba06e10 0x559e8ba071f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49690/0 (socket says 172.21.15.123:49690) 2024-03-20T13:37:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba37216640 1 -- 172.21.15.123:0/682788712 learned_addr learned my addr 172.21.15.123:0/682788712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba36a15640 1 --1- 172.21.15.123:0/682788712 >> v1:172.21.15.89:6789/0 conn(0x559e8ba07730 0x559e8ba08140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:52000/0 (socket says 172.21.15.123:52000) 2024-03-20T13:37:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba37216640 1 -- 172.21.15.123:0/682788712 >> v1:172.21.15.89:6789/0 conn(0x559e8ba07730 legacy=0x559e8ba08140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.422+0000 7fba37216640 1 -- 172.21.15.123:0/682788712 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8ba08970 con 0x559e8ba06e10 2024-03-20T13:37:59.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba37216640 1 --2- 172.21.15.123:0/682788712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8ba071f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba3000a4e0 tx=0x7fba3001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28990199080c6e2b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba36214640 1 -- 172.21.15.123:0/682788712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300aa540 con 0x559e8ba06e10 2024-03-20T13:37:59.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba36214640 1 -- 172.21.15.123:0/682788712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300a6070 con 0x559e8ba06e10 2024-03-20T13:37:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba36214640 1 -- 172.21.15.123:0/682788712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300aa850 con 0x559e8ba06e10 2024-03-20T13:37:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 -- 172.21.15.123:0/682788712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 msgr2=0x559e8ba071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 --2- 172.21.15.123:0/682788712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8ba071f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba3000a4e0 tx=0x7fba3001b090 comp rx=0 tx=0).stop 2024-03-20T13:37:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 -- 172.21.15.123:0/682788712 shutdown_connections 2024-03-20T13:37:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 --2- 172.21.15.123:0/682788712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8ba071f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 -- 172.21.15.123:0/682788712 >> 172.21.15.123:0/682788712 conn(0x559e8ba026e0 msgr2=0x559e8ba04b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 -- 172.21.15.123:0/682788712 shutdown_connections 2024-03-20T13:37:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.426+0000 7fba396fb980 1 -- 172.21.15.123:0/682788712 wait complete. 2024-03-20T13:37:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba396fb980 1 Processor -- start 2024-03-20T13:37:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba396fb980 1 -- start start 2024-03-20T13:37:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba396fb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba396fb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b918620 con 0x559e8ba06e10 2024-03-20T13:37:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba37216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba37216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49700/0 (socket says 172.21.15.123:49700) 2024-03-20T13:37:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.438+0000 7fba37216640 1 -- 172.21.15.123:0/4126269251 learned_addr learned my addr 172.21.15.123:0/4126269251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 -- 172.21.15.123:0/4126269251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3000a1c0 con 0x559e8ba06e10 2024-03-20T13:37:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 --2- 172.21.15.123:0/4126269251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf1330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba30018cc0 tx=0x7fba300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d660938563745b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fb92560a640 1 -- 172.21.15.123:0/4126269251 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300aa700 con 0x559e8ba06e10 2024-03-20T13:37:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fb92560a640 1 -- 172.21.15.123:0/4126269251 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300aa860 con 0x559e8ba06e10 2024-03-20T13:37:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fb92560a640 1 -- 172.21.15.123:0/4126269251 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300aab20 con 0x559e8ba06e10 2024-03-20T13:37:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/4126269251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 msgr2=0x559e8baf1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 --2- 172.21.15.123:0/4126269251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf1330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba30018cc0 tx=0x7fba300033b0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/4126269251 shutdown_connections 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 --2- 172.21.15.123:0/4126269251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf1330 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/4126269251 >> 172.21.15.123:0/4126269251 conn(0x559e8ba026e0 msgr2=0x559e8baecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/4126269251 shutdown_connections 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/4126269251 wait complete. 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 Processor -- start 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- start start 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b913e00 con 0x559e8ba06e10 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49702/0 (socket says 172.21.15.123:49702) 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 -- 172.21.15.123:0/1810097101 learned_addr learned my addr 172.21.15.123:0/1810097101 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8ba08970 con 0x559e8ba06e10 2024-03-20T13:37:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba37216640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf8080 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba30018cc0 tx=0x7fba30017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fb923e07640 1 -- 172.21.15.123:0/1810097101 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300c4070 con 0x559e8ba06e10 2024-03-20T13:37:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e8baf85c0 con 0x559e8ba06e10 2024-03-20T13:37:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e8baf89f0 con 0x559e8ba06e10 2024-03-20T13:37:59.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fb923e07640 1 -- 172.21.15.123:0/1810097101 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300b5650 con 0x559e8ba06e10 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.442+0000 7fb923e07640 1 -- 172.21.15.123:0/1810097101 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300b58f0 con 0x559e8ba06e10 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fb923e07640 1 -- 172.21.15.123:0/1810097101 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba300a8070 con 0x559e8ba06e10 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fb923e07640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb91c0342b0 0x7fb91c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fb923e07640 1 -- 172.21.15.123:0/1810097101 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fba300e3c20 con 0x559e8ba06e10 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba36a15640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb91c0342b0 0x7fb91c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8ba07730 0x559e8bafecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8baff1f0 con 0x559e8ba07730 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba37a17640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8ba07730 0x559e8bafecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba36a15640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb91c0342b0 0x7fb91c036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fba20000f70 tx=0x7fba20001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba37a17640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8ba07730 0x559e8bafecb0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba37a17640 1 -- 172.21.15.123:0/1810097101 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba280083f0 con 0x559e8ba07730 2024-03-20T13:37:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8baffa60 0x559e8bb01e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb02520 con 0x559e8baffa60 2024-03-20T13:37:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba37216640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8baffa60 0x559e8bb01e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba37216640 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8baffa60 0x559e8bb01e50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba37216640 1 -- 172.21.15.123:0/1810097101 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8baffa60 2024-03-20T13:37:59.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.446+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb03d80 con 0x559e8baffa60 2024-03-20T13:37:59.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37216640 1 -- 172.21.15.123:0/1810097101 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8baffa60 2024-03-20T13:37:59.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb02f80 con 0x559e8baffa60 2024-03-20T13:37:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37216640 1 -- 172.21.15.123:0/1810097101 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8baffa60 2024-03-20T13:37:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb03390 con 0x559e8ba07730 2024-03-20T13:37:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37a17640 1 -- 172.21.15.123:0/1810097101 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fba280083f0 con 0x559e8ba07730 2024-03-20T13:37:59.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 Processor -- start 2024-03-20T13:37:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 -- start start 2024-03-20T13:37:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 0x559e8bb13a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b8ace30 con 0x559e8bb13600 2024-03-20T13:37:59.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 0x559e8bb13a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 0x559e8bb13a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49712/0 (socket says 172.21.15.123:49712) 2024-03-20T13:37:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37a17640 1 -- 172.21.15.123:0/4066780111 learned_addr learned my addr 172.21.15.123:0/4066780111 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37a17640 1 -- 172.21.15.123:0/4066780111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8bb13f60 con 0x559e8bb13600 2024-03-20T13:37:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba37a17640 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 0x559e8bb13a20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fba2800aae0 tx=0x7fba28008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fb921602640 1 -- 172.21.15.123:0/4066780111 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba2801d070 con 0x559e8bb13600 2024-03-20T13:37:59.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fb921602640 1 -- 172.21.15.123:0/4066780111 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28010040 con 0x559e8bb13600 2024-03-20T13:37:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e8bb141b0 con 0x559e8bb13600 2024-03-20T13:37:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fb921602640 1 -- 172.21.15.123:0/4066780111 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba28007e70 con 0x559e8bb13600 2024-03-20T13:37:59.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.450+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e8bb14d00 con 0x559e8bb13600 2024-03-20T13:37:59.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fb921602640 1 -- 172.21.15.123:0/4066780111 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba28018430 con 0x559e8bb13600 2024-03-20T13:37:59.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fb921602640 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9100342b0 0x7fb910036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fb921602640 1 -- 172.21.15.123:0/4066780111 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fba2804a760 con 0x559e8bb13600 2024-03-20T13:37:59.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37216640 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9100342b0 0x7fb910036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 Processor -- start 2024-03-20T13:37:59.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- start start 2024-03-20T13:37:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37216640 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9100342b0 0x7fb910036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559e8bb029c0 tx=0x7fba300db040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8b8a0790 con 0x559e8bb205a0 2024-03-20T13:37:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb209c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49716/0 (socket says 172.21.15.123:49716) 2024-03-20T13:37:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37a17640 1 -- 172.21.15.123:0/2671744 learned_addr learned my addr 172.21.15.123:0/2671744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37a17640 1 -- 172.21.15.123:0/2671744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8bb20f90 con 0x559e8bb205a0 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba37a17640 1 --2- 172.21.15.123:0/2671744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb209c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fba280489f0 tx=0x7fba28020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6ae5147e201647 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fb91affd640 1 -- 172.21.15.123:0/2671744 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba28047070 con 0x559e8bb205a0 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fb91affd640 1 -- 172.21.15.123:0/2671744 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28021790 con 0x559e8bb205a0 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fb91affd640 1 -- 172.21.15.123:0/2671744 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba28022580 con 0x559e8bb205a0 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- 172.21.15.123:0/2671744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 msgr2=0x559e8bb209c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 --2- 172.21.15.123:0/2671744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb209c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fba280489f0 tx=0x7fba28020f00 comp rx=0 tx=0).stop 2024-03-20T13:37:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- 172.21.15.123:0/2671744 shutdown_connections 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 --2- 172.21.15.123:0/2671744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb209c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- 172.21.15.123:0/2671744 >> 172.21.15.123:0/2671744 conn(0x559e8bb1c8e0 msgr2=0x559e8bb1a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- 172.21.15.123:0/2671744 shutdown_connections 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- 172.21.15.123:0/2671744 wait complete. 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 Processor -- start 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- start start 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb273f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.454+0000 7fba396fb980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8bb27930 con 0x559e8bb205a0 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:49726/0 (socket says 172.21.15.123:49726) 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 learned_addr learned my addr 172.21.15.123:0/3118813516 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:37:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8bb14d00 con 0x559e8bb205a0 2024-03-20T13:37:59.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37a17640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb273f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fba280077a0 tx=0x7fba28048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fb9197fa640 1 -- 172.21.15.123:0/3118813516 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba28016540 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e8bb27b30 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fb9197fa640 1 -- 172.21.15.123:0/3118813516 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28018730 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fb9197fa640 1 -- 172.21.15.123:0/3118813516 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba280189d0 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e8bb27fc0 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fb9197fa640 1 -- 172.21.15.123:0/3118813516 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fba28018b30 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fb9197fa640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9000342b0 0x7fb900036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fb9197fa640 1 -- 172.21.15.123:0/3118813516 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fba28037d20 con 0x559e8bb205a0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37216640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9000342b0 0x7fb900036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8bb32b90 0x559e8bb35050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb357a0 con 0x559e8bb32b90 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba36a15640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8bb32b90 0x559e8bb35050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba37216640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9000342b0 0x7fb900036770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fba30005df0 tx=0x7fba300e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba36a15640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8bb32b90 0x559e8bb35050 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 realm 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb32030 con 0x559e8bb32b90 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb36220 con 0x559e8bb32b90 2024-03-20T13:37:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8bb36dc0 0x559e8bb39280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.458+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb399f0 con 0x559e8bb36dc0 2024-03-20T13:37:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8bb36dc0 0x559e8bb39280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8bb36dc0 0x559e8bb39280 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fba28033070 con 0x559e8bb36dc0 2024-03-20T13:37:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3a1f0 con 0x559e8bb36dc0 2024-03-20T13:37:59.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fba28033070 con 0x559e8bb36dc0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 20 searching for the correct realm 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559e8bb3c130 0x559e8bb3e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb3c130 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37216640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559e8bb3c130 0x559e8bb3e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37216640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559e8bb3c130 0x559e8bb3e5f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb36dc0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba28033070 con 0x559e8bb36dc0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fba28036020 0x7fba2800c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.462+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x7fba28036020 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fba28036020 0x7fba2800c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fba28036020 0x7fba2800c0b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:59.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb32b90 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb32b90 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb3c130 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb32b90 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb36dc0 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba28033070 con 0x559e8bb36dc0 2024-03-20T13:37:59.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb36dc0 2024-03-20T13:37:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba28033070 con 0x559e8bb36dc0 2024-03-20T13:37:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb32b90 2024-03-20T13:37:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x7fba28036020 2024-03-20T13:37:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3ecc0 con 0x559e8bb32b90 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.466+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x7fba28036020 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb36dc0 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb3c130 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb32b90 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb36dc0 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb3c130 2024-03-20T13:37:59.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb3c130 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x7fba28036020 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x7fba28036020 2024-03-20T13:37:59.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.470+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb3c130 2024-03-20T13:37:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x7fba28036020 2024-03-20T13:37:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb36dc0 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb36dc0 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb3c130 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb36dc0 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb36dc0 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3b6c0 con 0x559e8bb32b90 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.474+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3a670 con 0x559e8bb36dc0 2024-03-20T13:37:59.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3af60 con 0x559e8bb32b90 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 zone default found 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 4 Realm: () 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 zonegroup default 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb3f5a0 con 0x7fba28036020 2024-03-20T13:37:59.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb412e0 con 0x559e8bb3c130 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb41640 con 0x559e8bb3c130 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 started sync module instance, tier type = 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:37:59.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.478+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb40bc0 con 0x559e8bb36dc0 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139437025056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb40f70 con 0x559e8bb36dc0 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb42350 con 0x559e8bb32b90 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94139437031088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb42b90 con 0x559e8bb32b90 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb43640 con 0x559e8bb36dc0 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94139437025056] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94139437031088] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94139437035840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb43600 con 0x559e8bb36dc0 2024-03-20T13:37:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.482+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb42820 con 0x7fba28036020 2024-03-20T13:37:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94139437038064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb442b0 con 0x7fba28036020 2024-03-20T13:37:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb44cd0 con 0x559e8bb36dc0 2024-03-20T13:37:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94139437038064] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94139437035840] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94139437041584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb43e10 con 0x559e8bb36dc0 2024-03-20T13:37:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb45520 con 0x559e8bb3c130 2024-03-20T13:37:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.486+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94139437043840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb43e10 con 0x559e8bb3c130 2024-03-20T13:37:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb45f50 con 0x559e8bb3c130 2024-03-20T13:37:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94139437041584] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94139437043840] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94139437044896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb45ab0 con 0x559e8bb3c130 2024-03-20T13:37:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb467a0 con 0x7fba28036020 2024-03-20T13:37:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94139437044896] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94139437029904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb45ab0 con 0x7fba28036020 2024-03-20T13:37:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=0 2024-03-20T13:37:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=1 2024-03-20T13:37:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=2 2024-03-20T13:37:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=3 2024-03-20T13:37:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=4 2024-03-20T13:37:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=5 2024-03-20T13:37:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=6 2024-03-20T13:37:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94139437029904] v34'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 20 add_watcher() i=7 2024-03-20T13:37:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 2 all 8 watchers are set, enabling cache 2024-03-20T13:37:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb49860 con 0x559e8bb32b90 2024-03-20T13:37:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.490+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94139437048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb46d40 con 0x559e8bb32b90 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94139437048576] v34'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fb8edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 5 note: GC not initialized 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fb8ecfe1640 20 reqs_thread_entry: start 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 20 init_complete bucket index max shards: 11 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 20 Filter name: none 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fb8667fc640 20 reqs_thread_entry: start 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6b7b0 con 0x7fba28036020 2024-03-20T13:37:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 bar [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:37:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-03-20T13:37:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:37:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.494+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6f4c0 con 0x7fba28036020 2024-03-20T13:37:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v34'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94139437211600 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6ff60 con 0x559e8bb3c130 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== watch-notify(notify (1) cookie 94139437043840 notify 146028888079 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x559e8baf89f0 con 0x559e8bb3c130 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(64 notify.5 [notify cookie 94139437211600 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94139437043840 notifier 4731 bl.length()=357 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:37:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fb86c003430 con 0x559e8bb3c130 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== watch-notify(notify_complete (2) cookie 94139437211600 notify 146028888079 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e8baf85c0 con 0x559e8bb3c130 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6ff00 con 0x559e8bb32b90 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 : miss 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 8.9 8:971d366d:root::.bucket.meta.myfoo6%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6d640 con 0x7fba28036020 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv44 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=353 2024-03-20T13:37:59.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 info.flags=0x17 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 to cache LRU end 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 8.9 8:971d366d:root::.bucket.meta.myfoo6%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76ca0 con 0x7fba28036020 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v34'45 uv45 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 info.flags=0x17 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 to cache LRU end 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9, ofs0, ns] 2024-03-20T13:37:59.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify cookie 94139437210288 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb71360 con 0x559e8bb36dc0 2024-03-20T13:37:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94139437041584 notify 146028888103 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x559e8bb27fc0 con 0x559e8bb36dc0 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94139437041584 notifier 4731 bl.length()=721 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 info.flags=0x17 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 to cache LRU end 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fb91a7fc640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fb86c003560 con 0x559e8bb36dc0 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.498+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(69 notify.4 [notify cookie 94139437210288 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(70 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94139437210288 notify 146028888103 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fba2804e020 con 0x559e8bb36dc0 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 20 handle_bi_update(): bucket=:myfoo6[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9]): orig_sources= new_sources= 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 20 handle_bi_update(): bucket=:myfoo6[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9]): potential sources added=[] removed=[] 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 20 handle_bi_update(): bucket=:myfoo6[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9]): orig_dests= new_dests= 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 20 handle_bi_update(): bucket=:myfoo6[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9]): potential dests added=[] removed=[] 2024-03-20T13:37:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6dab0 con 0x559e8bb36dc0 2024-03-20T13:37:59.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 bud.buckets [call] v34'5 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-03-20T13:37:59.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 20 rados->read ofs=0 len=0 2024-03-20T13:37:59.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb75470 con 0x559e8bb32b90 2024-03-20T13:37:59.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 20 rados_obj.operate() r=0 bl.length=166 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.502+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:73 4.1e 4:791055de:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb32b90 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(73 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 4.23 4:c462a4b2:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x7fba28036020 2024-03-20T13:37:59.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(74 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 4.f 4:f14b3ecf:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb32b90 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(75 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 4.2 4:426727bd:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb32b90 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(76 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:77 4.4 4:2150aa91:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb32b90 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(77 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:78 4.19 4:98ea7ef2:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb3c130 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(78 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.5 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:79 4.3f 4:fc06a442:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x7fba28036020 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(79 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 4.2b 4:d5f830a7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb36dc0 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(80 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:81 4.2d 4:b527e1c3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x7fba28036020 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(81 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:82 4.3a 4:5fcbd1b3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb3c130 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(82 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9 [call out=377b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 10 cls_bucket_list_unordered: got thirteen 2024-03-20T13:37:59.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.506+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 4.32 4:4f211485:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb36dc0 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(83 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 get_obj_state: octx=0x559e8bb6f9e0 obj=myfoo6:thirteen state=0x559e8bb75b18 s->prefetch_data=0 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 3.9s0 3:915075e1:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb76480 con 0x559e8bb3c130 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(84 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 10 manifest: total_size = 8 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.2089879940753372606 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.acl 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.content_type 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.etag 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.idtag 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.manifest 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-03-20T13:37:59.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 get_obj_state: octx=0x559e8bb6f9e0 obj=myfoo6:thirteen state=0x559e8bb75b18 s->prefetch_data=0 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 : hit (requested=0x17, cached=0x17) 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:85 4.3a 4:5fcbd1b3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb7a430 con 0x559e8bb3c130 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(85 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9 [stat,call,call] v34'12 uv12 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.510+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 3.9s0 3:915075e1:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb78350 con 0x559e8bb3c130 2024-03-20T13:37:59.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(86 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 4.3a 4:5fcbd1b3:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb798e0 con 0x559e8bb3c130 2024-03-20T13:37:59.519 INFO:teuthology.orchestra.run.smithi123.stderr:1 objects processed in :myfoo6[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9]). Next marker thirteen 2024-03-20T13:37:59.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb798e0 con 0x7fba28036020 2024-03-20T13:37:59.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~346] v34'4 uv4 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94139437218864 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb75470 con 0x559e8bb3c130 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== watch-notify(notify (1) cookie 94139437043840 notify 146028888080 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fba300fd000 con 0x559e8bb3c130 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fb91affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94139437043840 notifier 4731 bl.length()=522 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fb91affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fb91affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fb91affd640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fb8fc003ea0 con 0x559e8bb3c130 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(89 notify.5 [notify cookie 94139437218864 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== watch-notify(notify_complete (2) cookie 94139437218864 notify 146028888080 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e8baf85c0 con 0x559e8bb3c130 2024-03-20T13:37:59.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6fc30 con 0x559e8bb32b90 2024-03-20T13:37:59.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(87 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.9.9 [stat,call,call] v34'13 uv13 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.514+0000 7fb91a7fc640 20 handle_completion(): completion ok for obj=thirteen 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94139437239936 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6fc30 con 0x559e8bb3c130 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== watch-notify(notify (1) cookie 94139437043840 notify 146028888081 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x559e8baf85c0 con 0x559e8bb3c130 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fb91affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94139437043840 notifier 4731 bl.length()=177 2024-03-20T13:37:59.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fb91affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fb91affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fb91affd640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fb8fc003ea0 con 0x559e8bb3c130 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(92 notify.5 [notify cookie 94139437239936 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== watch-notify(notify_complete (2) cookie 94139437239936 notify 146028888081 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e8ba08970 con 0x559e8bb3c130 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 10 removing user index: bar 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 10 removing default.rgw.meta+users.uid+bar from cache 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94139437239872 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb6fc30 con 0x7fba28036020 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== watch-notify(notify (1) cookie 94139437029904 notify 146028888079 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fba20053040 con 0x7fba28036020 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fb91a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94139437029904 notifier 4731 bl.length()=152 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fb91a7fc640 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fb86c0038c0 con 0x7fba28036020 2024-03-20T13:37:59.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(94 notify.7 [notify cookie 94139437239872 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 22 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 23 ==== watch-notify(notify_complete (2) cookie 94139437239872 notify 146028888079 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e8b9544c0 con 0x7fba28036020 2024-03-20T13:37:59.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.518+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb79de0 con 0x7fba28036020 2024-03-20T13:37:59.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.522+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 24 ==== osd_op_reply(96 bar [delete] v34'6 uv6 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.526 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:37:59.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.522+0000 7fb8edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:37:59.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.522+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94139437048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb49830 con 0x559e8bb32b90 2024-03-20T13:37:59.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.522+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94139437048576] v34'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.522+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94139437025056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb462e0 con 0x559e8bb36dc0 2024-03-20T13:37:59.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94139437025056] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba396fb980 20 remove_watcher() i=0 2024-03-20T13:37:59.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba396fb980 2 removed watcher, disabling cache 2024-03-20T13:37:59.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94139437031088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fba2002d080 con 0x559e8bb32b90 2024-03-20T13:37:59.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94139437031088] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x559e8bb32b90 2024-03-20T13:37:59.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba396fb980 20 remove_watcher() i=1 2024-03-20T13:37:59.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.526+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94139437035840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb40720 con 0x559e8bb36dc0 2024-03-20T13:37:59.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.530+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94139437035840] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.530+0000 7fba396fb980 20 remove_watcher() i=2 2024-03-20T13:37:59.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.530+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94139437038064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb40720 con 0x7fba28036020 2024-03-20T13:37:59.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.530+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 25 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94139437038064] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.530+0000 7fba396fb980 20 remove_watcher() i=3 2024-03-20T13:37:59.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.530+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94139437041584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb439f0 con 0x559e8bb36dc0 2024-03-20T13:37:59.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba37a17640 1 -- 172.21.15.123:0/3118813516 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94139437041584] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2805f040 con 0x559e8bb36dc0 2024-03-20T13:37:59.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 20 remove_watcher() i=4 2024-03-20T13:37:59.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94139437043840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb40720 con 0x559e8bb3c130 2024-03-20T13:37:59.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94139437043840] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 20 remove_watcher() i=5 2024-03-20T13:37:59.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94139437044896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb447b0 con 0x559e8bb3c130 2024-03-20T13:37:59.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba37216640 1 -- 172.21.15.123:0/3118813516 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94139437044896] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba300c87f0 con 0x559e8bb3c130 2024-03-20T13:37:59.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 20 remove_watcher() i=6 2024-03-20T13:37:59.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94139437029904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x559e8bb40720 con 0x7fba28036020 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 <== osd.2 v2:172.21.15.123:6803/1251286685 26 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94139437029904] v34'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba2000f620 con 0x7fba28036020 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 20 remove_watcher() i=7 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8bb36dc0 msgr2=0x559e8bb39280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8bb36dc0 0x559e8bb39280 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8bb32b90 msgr2=0x559e8bb35050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8bb32b90 0x559e8bb35050 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fba28036020 msgr2=0x7fba2800c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fba28036020 0x7fba2800c0b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559e8bb3c130 msgr2=0x559e8bb3e5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x559e8bb3c130 0x559e8bb3e5f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9000342b0 msgr2=0x7fb900036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9000342b0 0x7fb900036770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fba30005df0 tx=0x7fba300e4000 comp rx=0 tx=0).stop 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 msgr2=0x559e8bb273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/3118813516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb205a0 0x559e8bb273f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fba280077a0 tx=0x7fba28048980 comp rx=0 tx=0).stop 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba36a15640 1 -- 172.21.15.123:0/3118813516 reap_dead start 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 shutdown_connections 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 >> 172.21.15.123:0/3118813516 conn(0x559e8bb1c8e0 msgr2=0x559e8bb19f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 shutdown_connections 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/3118813516 wait complete. 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9100342b0 msgr2=0x7fb910036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9100342b0 0x7fb910036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559e8bb029c0 tx=0x7fba300db040 comp rx=0 tx=0).stop 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 msgr2=0x559e8bb13a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.534+0000 7fba396fb980 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 0x559e8bb13a20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fba2800aae0 tx=0x7fba28008e70 comp rx=0 tx=0).stop 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 shutdown_connections 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb9100342b0 0x7fb910036770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/4066780111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8bb13600 0x559e8bb13a20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 >> 172.21.15.123:0/4066780111 conn(0x559e8bb08c50 msgr2=0x559e8bb0b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 shutdown_connections 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/4066780111 wait complete. 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8baffa60 msgr2=0x559e8bb01e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8baffa60 0x559e8bb01e50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8ba07730 msgr2=0x559e8bafecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8ba07730 0x559e8bafecb0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb91c0342b0 msgr2=0x7fb91c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb91c0342b0 0x7fb91c036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fba20000f70 tx=0x7fba20001380 comp rx=0 tx=0).stop 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 msgr2=0x559e8baf8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf8080 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba30018cc0 tx=0x7fba30017e30 comp rx=0 tx=0).stop 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 shutdown_connections 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x559e8baffa60 0x559e8bb01e50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x559e8ba07730 0x559e8bafecb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb91c0342b0 0x7fb91c036770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 --2- 172.21.15.123:0/1810097101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e8ba06e10 0x559e8baf8080 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 >> 172.21.15.123:0/1810097101 conn(0x559e8ba026e0 msgr2=0x559e8baeb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 shutdown_connections 2024-03-20T13:37:59.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:37:59.538+0000 7fba396fb980 1 -- 172.21.15.123:0/1810097101 wait complete. 2024-03-20T13:37:59.553 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:38:04.564 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:38:04.565 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-03-20T13:38:04.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-03-20T13:38:04.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-03-20T13:38:04.565 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-03-20T13:38:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:04.612 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:04.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d8445980 1 Processor -- start 2024-03-20T13:38:04.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d8445980 1 -- start start 2024-03-20T13:38:04.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d8445980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55898d3c8670 0x55898d3caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d8445980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55898d30e4c0 con 0x55898d3c4170 2024-03-20T13:38:04.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d8445980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55898d2d50f0 con 0x55898d3c8670 2024-03-20T13:38:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d575f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55898d3c8670 0x55898d3caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d575f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55898d3c8670 0x55898d3caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33256/0 (socket says 172.21.15.123:33256) 2024-03-20T13:38:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d5f60640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55898d3c4170 0x55898d3c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59296/0 (socket says 172.21.15.123:59296) 2024-03-20T13:38:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d575f640 1 -- 172.21.15.123:0/3368102940 learned_addr learned my addr 172.21.15.123:0/3368102940 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d575f640 1 -- 172.21.15.123:0/3368102940 >> v1:172.21.15.89:6789/0 conn(0x55898d3c4170 legacy=0x55898d3c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.610+0000 7f46d575f640 1 -- 172.21.15.123:0/3368102940 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d3cbfb0 con 0x55898d3c8670 2024-03-20T13:38:04.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d575f640 1 --2- 172.21.15.123:0/3368102940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c8670 0x55898d3caa60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f46c000a5c0 tx=0x7f46c001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac33efd45abfcec1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d4f5e640 1 -- 172.21.15.123:0/3368102940 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c00aa470 con 0x55898d3c8670 2024-03-20T13:38:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d4f5e640 1 -- 172.21.15.123:0/3368102940 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c00aa5d0 con 0x55898d3c8670 2024-03-20T13:38:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d4f5e640 1 -- 172.21.15.123:0/3368102940 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c00aa890 con 0x55898d3c8670 2024-03-20T13:38:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 -- 172.21.15.123:0/3368102940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c8670 msgr2=0x55898d3caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 --2- 172.21.15.123:0/3368102940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c8670 0x55898d3caa60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f46c000a5c0 tx=0x7f46c001b340 comp rx=0 tx=0).stop 2024-03-20T13:38:04.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 -- 172.21.15.123:0/3368102940 shutdown_connections 2024-03-20T13:38:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 --2- 172.21.15.123:0/3368102940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c8670 0x55898d3caa60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 -- 172.21.15.123:0/3368102940 >> 172.21.15.123:0/3368102940 conn(0x55898d337890 msgr2=0x55898d337ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 -- 172.21.15.123:0/3368102940 shutdown_connections 2024-03-20T13:38:04.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.614+0000 7f46d8445980 1 -- 172.21.15.123:0/3368102940 wait complete. 2024-03-20T13:38:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d8445980 1 Processor -- start 2024-03-20T13:38:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d8445980 1 -- start start 2024-03-20T13:38:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d8445980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d8445980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d2d2620 con 0x55898d3c4170 2024-03-20T13:38:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d5f60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d5f60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33264/0 (socket says 172.21.15.123:33264) 2024-03-20T13:38:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d5f60640 1 -- 172.21.15.123:0/1724784860 learned_addr learned my addr 172.21.15.123:0/1724784860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d5f60640 1 -- 172.21.15.123:0/1724784860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0005df0 con 0x55898d3c4170 2024-03-20T13:38:04.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d5f60640 1 --2- 172.21.15.123:0/1724784860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4ae0e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f46d0006fb0 tx=0x7f46d0001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde53f7373bfe5fc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f45c3e07640 1 -- 172.21.15.123:0/1724784860 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d0013420 con 0x55898d3c4170 2024-03-20T13:38:04.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f45c3e07640 1 -- 172.21.15.123:0/1724784860 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d0013580 con 0x55898d3c4170 2024-03-20T13:38:04.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f45c3e07640 1 -- 172.21.15.123:0/1724784860 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d0013860 con 0x55898d3c4170 2024-03-20T13:38:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d8445980 1 -- 172.21.15.123:0/1724784860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 msgr2=0x55898d4ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.630+0000 7f46d8445980 1 --2- 172.21.15.123:0/1724784860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4ae0e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f46d0006fb0 tx=0x7f46d0001940 comp rx=0 tx=0).stop 2024-03-20T13:38:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/1724784860 shutdown_connections 2024-03-20T13:38:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 --2- 172.21.15.123:0/1724784860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4ae0e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/1724784860 >> 172.21.15.123:0/1724784860 conn(0x55898d337890 msgr2=0x55898d4a9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/1724784860 shutdown_connections 2024-03-20T13:38:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/1724784860 wait complete. 2024-03-20T13:38:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 Processor -- start 2024-03-20T13:38:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- start start 2024-03-20T13:38:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d2cde00 con 0x55898d3c4170 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d5f60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d5f60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33280/0 (socket says 172.21.15.123:33280) 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d5f60640 1 -- 172.21.15.123:0/2746504398 learned_addr learned my addr 172.21.15.123:0/2746504398 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d5f60640 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d30e4c0 con 0x55898d3c4170 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d5f60640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4b4f30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55898d4aef70 tx=0x7f46d0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f45c2604640 1 -- 172.21.15.123:0/2746504398 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d00037a0 con 0x55898d3c4170 2024-03-20T13:38:04.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55898d4b5470 con 0x55898d3c4170 2024-03-20T13:38:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f45c2604640 1 -- 172.21.15.123:0/2746504398 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d0003900 con 0x55898d3c4170 2024-03-20T13:38:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55898d4b58a0 con 0x55898d3c4170 2024-03-20T13:38:04.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f45c2604640 1 -- 172.21.15.123:0/2746504398 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46d0003ba0 con 0x55898d3c4170 2024-03-20T13:38:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f45c2604640 1 -- 172.21.15.123:0/2746504398 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f46d0003d00 con 0x55898d3c4170 2024-03-20T13:38:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f45c2604640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45bc034300 0x7f45bc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f45c2604640 1 -- 172.21.15.123:0/2746504398 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f46d0049680 con 0x55898d3c4170 2024-03-20T13:38:04.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d575f640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45bc034300 0x7f45bc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d3c8670 0x55898d4bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.634+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4bc0f0 con 0x55898d3c8670 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d6761640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d3c8670 0x55898d4bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d575f640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45bc034300 0x7f45bc0367c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f46c00ae000 tx=0x7f46c00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d6761640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d3c8670 0x55898d4bbbb0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d6761640 1 -- 172.21.15.123:0/2746504398 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46c80083f0 con 0x55898d3c8670 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4bc960 0x55898d4bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4bf470 con 0x55898d4bc960 2024-03-20T13:38:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d5f60640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4bc960 0x55898d4bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d5f60640 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4bc960 0x55898d4bed50 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d5f60640 1 -- 172.21.15.123:0/2746504398 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4bc960 2024-03-20T13:38:04.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4c0cd0 con 0x55898d4bc960 2024-03-20T13:38:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d5f60640 1 -- 172.21.15.123:0/2746504398 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4bc960 2024-03-20T13:38:04.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.638+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4bfed0 con 0x55898d4bc960 2024-03-20T13:38:04.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d5f60640 1 -- 172.21.15.123:0/2746504398 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4bc960 2024-03-20T13:38:04.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4c02e0 con 0x55898d3c8670 2024-03-20T13:38:04.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d6761640 1 -- 172.21.15.123:0/2746504398 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f46c80083f0 con 0x55898d3c8670 2024-03-20T13:38:04.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 Processor -- start 2024-03-20T13:38:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 -- start start 2024-03-20T13:38:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 0x55898d4cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d266e30 con 0x55898d4cf3d0 2024-03-20T13:38:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d6761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 0x55898d4cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d6761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 0x55898d4cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33296/0 (socket says 172.21.15.123:33296) 2024-03-20T13:38:04.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d6761640 1 -- 172.21.15.123:0/1011852677 learned_addr learned my addr 172.21.15.123:0/1011852677 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d6761640 1 -- 172.21.15.123:0/1011852677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d4cfd30 con 0x55898d4cf3d0 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d6761640 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 0x55898d4cf7f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f46c800aae0 tx=0x7f46c8008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f45bb7fe640 1 -- 172.21.15.123:0/1011852677 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c801d070 con 0x55898d4cf3d0 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f45bb7fe640 1 -- 172.21.15.123:0/1011852677 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c8010040 con 0x55898d4cf3d0 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55898d4cff80 con 0x55898d4cf3d0 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f45bb7fe640 1 -- 172.21.15.123:0/1011852677 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c8007e70 con 0x55898d4cf3d0 2024-03-20T13:38:04.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.642+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55898d4d0ad0 con 0x55898d4cf3d0 2024-03-20T13:38:04.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f45bb7fe640 1 -- 172.21.15.123:0/1011852677 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f46c8018430 con 0x55898d4cf3d0 2024-03-20T13:38:04.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f45bb7fe640 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45b00342b0 0x7f45b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f45bb7fe640 1 -- 172.21.15.123:0/1011852677 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f46c804a6a0 con 0x55898d4cf3d0 2024-03-20T13:38:04.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d5f60640 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45b00342b0 0x7f45b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 Processor -- start 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- start start 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4dc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d25a790 con 0x55898d4dc350 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d5f60640 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45b00342b0 0x7f45b0036770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55898d4bf9d0 tx=0x7f46d0012f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4dc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4dc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33298/0 (socket says 172.21.15.123:33298) 2024-03-20T13:38:04.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 -- 172.21.15.123:0/3276529790 learned_addr learned my addr 172.21.15.123:0/3276529790 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 -- 172.21.15.123:0/3276529790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d4dcd40 con 0x55898d4dc350 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 --2- 172.21.15.123:0/3276529790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4dc770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f46c80489f0 tx=0x7f46c8020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9581e77cb104047 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f45b97fa640 1 -- 172.21.15.123:0/3276529790 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c8020310 con 0x55898d4dc350 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f45b97fa640 1 -- 172.21.15.123:0/3276529790 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c803f030 con 0x55898d4dc350 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f45b97fa640 1 -- 172.21.15.123:0/3276529790 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c8022580 con 0x55898d4dc350 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- 172.21.15.123:0/3276529790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 msgr2=0x55898d4dc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 --2- 172.21.15.123:0/3276529790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4dc770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f46c80489f0 tx=0x7f46c8020f00 comp rx=0 tx=0).stop 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- 172.21.15.123:0/3276529790 shutdown_connections 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 --2- 172.21.15.123:0/3276529790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4dc770 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- 172.21.15.123:0/3276529790 >> 172.21.15.123:0/3276529790 conn(0x55898d4d8690 msgr2=0x55898d4d66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- 172.21.15.123:0/3276529790 shutdown_connections 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- 172.21.15.123:0/3276529790 wait complete. 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 Processor -- start 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- start start 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4e3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d8445980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d4e3740 con 0x55898d4dc350 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4e3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4e3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33306/0 (socket says 172.21.15.123:33306) 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.646+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 learned_addr learned my addr 172.21.15.123:0/832705245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d4d0ad0 con 0x55898d4dc350 2024-03-20T13:38:04.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d6761640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4e3200 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f46c80489f0 tx=0x7f46c8048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f45a77fe640 1 -- 172.21.15.123:0/832705245 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c804a2e0 con 0x55898d4dc350 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f45a77fe640 1 -- 172.21.15.123:0/832705245 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c8030070 con 0x55898d4dc350 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55898d4e3940 con 0x55898d4dc350 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f45a77fe640 1 -- 172.21.15.123:0/832705245 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46c80472b0 con 0x55898d4dc350 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55898d4e3d70 con 0x55898d4dc350 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f45a77fe640 1 -- 172.21.15.123:0/832705245 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f46c8047520 con 0x55898d4dc350 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f45a77fe640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45a00342b0 0x7f45a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f45a77fe640 1 -- 172.21.15.123:0/832705245 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f46c8036d40 con 0x55898d4dc350 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d5f60640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45a00342b0 0x7f45a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d4ee940 0x55898d4f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f1550 con 0x55898d4ee940 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d575f640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d4ee940 0x55898d4f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d5f60640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45a00342b0 0x7f45a0036770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f46d0049930 tx=0x7f46d0048fd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d575f640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d4ee940 0x55898d4f0e00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 20 realm 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f1940 con 0x55898d4ee940 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.650+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f21c0 con 0x55898d4ee940 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4f2ba0 0x55898d4f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5740 con 0x55898d4f2ba0 2024-03-20T13:38:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d6761640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4f2ba0 0x55898d4f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d6761640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4f2ba0 0x55898d4f4fd0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f46c801f070 con 0x55898d4f2ba0 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f46c801f070 con 0x55898d4f2ba0 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 20 searching for the correct realm 2024-03-20T13:38:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55898d4f7f90 0x55898d4fa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fab20 con 0x55898d4f7f90 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d5f60640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55898d4f7f90 0x55898d4fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d5f60640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55898d4f7f90 0x55898d4fa450 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.654+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fab20 con 0x55898d4f2ba0 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c801f070 con 0x55898d4f2ba0 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f46c802cc20 0x7f46c8017710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x7f46c802cc20 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f46c802cc20 0x7f46c8017710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f46c802cc20 0x7f46c8017710 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x7f46c802cc20 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f7f90 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c801f070 con 0x55898d4f2ba0 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c801f070 con 0x55898d4f2ba0 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.658+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x7f46c802cc20 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x7f46c802cc20 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x7f46c802cc20 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f46c00b0020 con 0x7f46c802cc20 2024-03-20T13:38:04.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f7f90 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f7f90 2024-03-20T13:38:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00b0020 con 0x55898d4ee940 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.662+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f7f90 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x7f46c802cc20 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4ee940 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x7f46c802cc20 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f7f90 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x7f46c802cc20 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f7f90 2024-03-20T13:38:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.666+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f5f40 con 0x55898d4f2ba0 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f6390 con 0x55898d4ee940 2024-03-20T13:38:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f6740 con 0x55898d4f2ba0 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f6740 con 0x55898d4ee940 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 zone default found 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 4 Realm: () 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:04.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 zonegroup default 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4f6fc0 con 0x7f46c802cc20 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fcde0 con 0x55898d4f7f90 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.670+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fd140 con 0x55898d4f7f90 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d8445980 20 started sync module instance, tier type = 2024-03-20T13:38:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d8445980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:04.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fc3b0 con 0x55898d4f2ba0 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94049269696400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fc3b0 con 0x55898d4f2ba0 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fdab0 con 0x55898d4ee940 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.674+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94049269700112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fded0 con 0x55898d4ee940 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fe900 con 0x55898d4f2ba0 2024-03-20T13:38:04.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94049269696400] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94049269700112] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94049269703680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fda30 con 0x55898d4f2ba0 2024-03-20T13:38:04.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4ff150 con 0x7f46c802cc20 2024-03-20T13:38:04.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94049269705904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fda30 con 0x7f46c802cc20 2024-03-20T13:38:04.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.678+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4ffc10 con 0x55898d4f2ba0 2024-03-20T13:38:04.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94049269705904] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94049269703680] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94049269694224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4ffbd0 con 0x55898d4f2ba0 2024-03-20T13:38:04.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fffc0 con 0x55898d4f7f90 2024-03-20T13:38:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94049269706960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d500810 con 0x55898d4f7f90 2024-03-20T13:38:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d501200 con 0x55898d4f7f90 2024-03-20T13:38:04.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.682+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94049269694224] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94049269706960] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94049269711728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4ff710 con 0x55898d4f7f90 2024-03-20T13:38:04.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d501a50 con 0x7f46c802cc20 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94049269716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d501ed0 con 0x7f46c802cc20 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=0 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=1 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=2 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=3 2024-03-20T13:38:04.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=4 2024-03-20T13:38:04.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=5 2024-03-20T13:38:04.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94049269711728] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.686+0000 7f46d8445980 20 add_watcher() i=6 2024-03-20T13:38:04.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94049269716400] v34'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 20 add_watcher() i=7 2024-03-20T13:38:04.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:04.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d500ce0 con 0x55898d4ee940 2024-03-20T13:38:04.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94049269717456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d500ce0 con 0x55898d4ee940 2024-03-20T13:38:04.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94049269717456] v34'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f458bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:04.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:04.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:04.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 5 note: GC not initialized 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f458afe5640 20 reqs_thread_entry: start 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.690+0000 7f46d8445980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 20 Filter name: none 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f4588fe1640 20 reqs_thread_entry: start 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d526f90 con 0x7f46c802cc20 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:38:04.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d526f90 con 0x55898d4f7f90 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:38:04.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d525c50 con 0x7f46c802cc20 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v34'7 uv7 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94049269866480 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d52a4f0 con 0x55898d4f7f90 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== watch-notify(notify (1) cookie 94049269706960 notify 146028888082 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f46d003a040 con 0x55898d4f7f90 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f45b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94049269706960 notifier 4738 bl.length()=522 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f45b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.694+0000 7f45b97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f45b97fa640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4598003ea0 con 0x55898d4f7f90 2024-03-20T13:38:04.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(65 notify.5 [notify cookie 94049269866480 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== watch-notify(notify_complete (2) cookie 94049269866480 notify 146028888082 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55898d4b58a0 con 0x55898d4f7f90 2024-03-20T13:38:04.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d5257b0 con 0x55898d4f7f90 2024-03-20T13:38:04.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'11 uv11 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d8445980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d8445980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d8445980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94049269866480 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d5257b0 con 0x55898d4f2ba0 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== watch-notify(notify (1) cookie 94049269703680 notify 146028888104 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f46c806a040 con 0x55898d4f2ba0 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f45b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94049269703680 notifier 4738 bl.length()=177 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f45b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f45b8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f45b8ff9640 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4508003400 con 0x55898d4f2ba0 2024-03-20T13:38:04.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(68 notify.2 [notify cookie 94049269866480 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.698+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== watch-notify(notify_complete (2) cookie 94049269866480 notify 146028888104 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55898d4e3d70 con 0x55898d4f2ba0 2024-03-20T13:38:04.704 INFO:teuthology.orchestra.run.smithi123.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:38:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.702+0000 7f458bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:04.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.702+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94049269717456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d507790 con 0x55898d4ee940 2024-03-20T13:38:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.702+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94049269717456] v34'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.702+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94049269696400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d5019d0 con 0x55898d4f2ba0 2024-03-20T13:38:04.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94049269696400] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d8445980 20 remove_watcher() i=0 2024-03-20T13:38:04.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d8445980 2 removed watcher, disabling cache 2024-03-20T13:38:04.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94049269700112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d5019d0 con 0x55898d4ee940 2024-03-20T13:38:04.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94049269700112] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x55898d4ee940 2024-03-20T13:38:04.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d8445980 20 remove_watcher() i=1 2024-03-20T13:38:04.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.706+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94049269703680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fd610 con 0x55898d4f2ba0 2024-03-20T13:38:04.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94049269703680] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d8445980 20 remove_watcher() i=2 2024-03-20T13:38:04.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94049269705904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d5019d0 con 0x7f46c802cc20 2024-03-20T13:38:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94049269705904] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d8445980 20 remove_watcher() i=3 2024-03-20T13:38:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94049269694224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fe400 con 0x55898d4f2ba0 2024-03-20T13:38:04.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d6761640 1 -- 172.21.15.123:0/832705245 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94049269694224] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c8061040 con 0x55898d4f2ba0 2024-03-20T13:38:04.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d8445980 20 remove_watcher() i=4 2024-03-20T13:38:04.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.710+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94049269706960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fd610 con 0x55898d4f7f90 2024-03-20T13:38:04.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94049269706960] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 20 remove_watcher() i=5 2024-03-20T13:38:04.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94049269711728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d5019d0 con 0x55898d4f7f90 2024-03-20T13:38:04.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d5f60640 1 -- 172.21.15.123:0/832705245 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94049269711728] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46d0024020 con 0x55898d4f7f90 2024-03-20T13:38:04.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 20 remove_watcher() i=6 2024-03-20T13:38:04.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94049269716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55898d4fd610 con 0x7f46c802cc20 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94049269716400] v34'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46c00d5060 con 0x7f46c802cc20 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 20 remove_watcher() i=7 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4f2ba0 msgr2=0x55898d4f4fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4f2ba0 0x55898d4f4fd0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d4ee940 msgr2=0x55898d4f0e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d4ee940 0x55898d4f0e00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f46c802cc20 msgr2=0x7f46c8017710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f46c802cc20 0x7f46c8017710 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55898d4f7f90 msgr2=0x55898d4fa450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55898d4f7f90 0x55898d4fa450 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45a00342b0 msgr2=0x7f45a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45a00342b0 0x7f45a0036770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f46d0049930 tx=0x7f46d0048fd0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 msgr2=0x55898d4e3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d575f640 1 -- 172.21.15.123:0/832705245 reap_dead start 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4e3200 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f46c80489f0 tx=0x7f46c8048980 comp rx=0 tx=0).stop 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 shutdown_connections 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 --2- 172.21.15.123:0/832705245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4dc350 0x55898d4e3200 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 >> 172.21.15.123:0/832705245 conn(0x55898d4d8690 msgr2=0x55898d4d66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 shutdown_connections 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.714+0000 7f46d8445980 1 -- 172.21.15.123:0/832705245 wait complete. 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45b00342b0 msgr2=0x7f45b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45b00342b0 0x7f45b0036770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55898d4bf9d0 tx=0x7f46d0012f20 comp rx=0 tx=0).stop 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 msgr2=0x55898d4cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 0x55898d4cf7f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f46c800aae0 tx=0x7f46c8008e70 comp rx=0 tx=0).stop 2024-03-20T13:38:04.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 shutdown_connections 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45b00342b0 0x7f45b0036770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/1011852677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d4cf3d0 0x55898d4cf7f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 >> 172.21.15.123:0/1011852677 conn(0x55898d4c41e0 msgr2=0x55898d4c4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 shutdown_connections 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/1011852677 wait complete. 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4bc960 msgr2=0x55898d4bed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4bc960 0x55898d4bed50 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d3c8670 msgr2=0x55898d4bbbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d3c8670 0x55898d4bbbb0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45bc034300 msgr2=0x7f45bc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45bc034300 0x7f45bc0367c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f46c00ae000 tx=0x7f46c00a6000 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 msgr2=0x55898d4b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4b4f30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55898d4aef70 tx=0x7f46d0000f50 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 shutdown_connections 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55898d4bc960 0x55898d4bed50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55898d3c8670 0x55898d4bbbb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f45bc034300 0x7f45bc0367c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 --2- 172.21.15.123:0/2746504398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55898d3c4170 0x55898d4b4f30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 >> 172.21.15.123:0/2746504398 conn(0x55898d337890 msgr2=0x55898d4a8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 shutdown_connections 2024-03-20T13:38:04.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.718+0000 7f46d8445980 1 -- 172.21.15.123:0/2746504398 wait complete. 2024-03-20T13:38:04.732 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:38:04.746 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:38:04.753 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-03-20T13:38:04.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-03-20T13:38:04.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-03-20T13:38:04.753 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-03-20T13:38:04.785 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:04.785 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:04.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9999a08980 1 Processor -- start 2024-03-20T13:38:04.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9999a08980 1 -- start start 2024-03-20T13:38:04.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9999a08980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560bbf905640 0x560bbf907a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9999a08980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560bbf84b4c0 con 0x560bbf901140 2024-03-20T13:38:04.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9999a08980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x560bbf8120f0 con 0x560bbf905640 2024-03-20T13:38:04.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9997523640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x560bbf901140 0x560bbf901520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59300/0 (socket says 172.21.15.123:59300) 2024-03-20T13:38:04.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9997523640 1 -- 172.21.15.123:0/3835606385 learned_addr learned my addr 172.21.15.123:0/3835606385 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:38:04.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9996d22640 1 --2- 172.21.15.123:0/3835606385 >> v2:172.21.15.89:3300/0 conn(0x560bbf905640 0x560bbf907a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9996521640 1 -- 172.21.15.123:0/3835606385 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875794286 0 0) 0x560bbf84b4c0 con 0x560bbf901140 2024-03-20T13:38:04.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9996521640 1 -- 172.21.15.123:0/3835606385 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9984001e20 con 0x560bbf901140 2024-03-20T13:38:04.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9996d22640 1 -- 172.21.15.123:0/3835606385 >> v1:172.21.15.89:6789/0 conn(0x560bbf901140 legacy=0x560bbf901520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.782+0000 7f9996d22640 1 -- 172.21.15.123:0/3835606385 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bbf908f80 con 0x560bbf905640 2024-03-20T13:38:04.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9996d22640 1 --2- 172.21.15.123:0/3835606385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf905640 0x560bbf907a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f998000a480 tx=0x7f998001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88eba7672aca70c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9996521640 1 -- 172.21.15.123:0/3835606385 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99800ab540 con 0x560bbf905640 2024-03-20T13:38:04.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9996521640 1 -- 172.21.15.123:0/3835606385 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99800ab6a0 con 0x560bbf905640 2024-03-20T13:38:04.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9996521640 1 -- 172.21.15.123:0/3835606385 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99800ab940 con 0x560bbf905640 2024-03-20T13:38:04.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 -- 172.21.15.123:0/3835606385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf905640 msgr2=0x560bbf907a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 --2- 172.21.15.123:0/3835606385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf905640 0x560bbf907a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f998000a480 tx=0x7f998001b280 comp rx=0 tx=0).stop 2024-03-20T13:38:04.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 -- 172.21.15.123:0/3835606385 shutdown_connections 2024-03-20T13:38:04.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 --2- 172.21.15.123:0/3835606385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf905640 0x560bbf907a30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 -- 172.21.15.123:0/3835606385 >> 172.21.15.123:0/3835606385 conn(0x560bbf874860 msgr2=0x560bbf874c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 -- 172.21.15.123:0/3835606385 shutdown_connections 2024-03-20T13:38:04.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.786+0000 7f9999a08980 1 -- 172.21.15.123:0/3835606385 wait complete. 2024-03-20T13:38:04.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9999a08980 1 Processor -- start 2024-03-20T13:38:04.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9999a08980 1 -- start start 2024-03-20T13:38:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9999a08980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9eae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9999a08980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbf80f620 con 0x560bbf901140 2024-03-20T13:38:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9997523640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9eae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9997523640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9eae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33324/0 (socket says 172.21.15.123:33324) 2024-03-20T13:38:04.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9997523640 1 -- 172.21.15.123:0/308636987 learned_addr learned my addr 172.21.15.123:0/308636987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9997523640 1 -- 172.21.15.123:0/308636987 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980005d30 con 0x560bbf901140 2024-03-20T13:38:04.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9997523640 1 --2- 172.21.15.123:0/308636987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9eae10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9988001c30 tx=0x7f998800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe266eea21e1e61e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f988560a640 1 -- 172.21.15.123:0/308636987 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f998800e690 con 0x560bbf901140 2024-03-20T13:38:04.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f988560a640 1 -- 172.21.15.123:0/308636987 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998800e7f0 con 0x560bbf901140 2024-03-20T13:38:04.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f988560a640 1 -- 172.21.15.123:0/308636987 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f998800eb50 con 0x560bbf901140 2024-03-20T13:38:04.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9999a08980 1 -- 172.21.15.123:0/308636987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 msgr2=0x560bbf9eae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.802+0000 7f9999a08980 1 --2- 172.21.15.123:0/308636987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9eae10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9988001c30 tx=0x7f998800b6d0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- 172.21.15.123:0/308636987 shutdown_connections 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 --2- 172.21.15.123:0/308636987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9eae10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- 172.21.15.123:0/308636987 >> 172.21.15.123:0/308636987 conn(0x560bbf874860 msgr2=0x560bbf9e69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- 172.21.15.123:0/308636987 shutdown_connections 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- 172.21.15.123:0/308636987 wait complete. 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 Processor -- start 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- start start 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbf80ae00 con 0x560bbf901140 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9997523640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9997523640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33340/0 (socket says 172.21.15.123:33340) 2024-03-20T13:38:04.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9997523640 1 -- 172.21.15.123:0/912604899 learned_addr learned my addr 172.21.15.123:0/912604899 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9997523640 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984001e20 con 0x560bbf901140 2024-03-20T13:38:04.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9997523640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9f1cc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f998800b710 tx=0x7f9988000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9883e07640 1 -- 172.21.15.123:0/912604899 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f998801f070 con 0x560bbf901140 2024-03-20T13:38:04.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bbf9f2200 con 0x560bbf901140 2024-03-20T13:38:04.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9883e07640 1 -- 172.21.15.123:0/912604899 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998801a2e0 con 0x560bbf901140 2024-03-20T13:38:04.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9883e07640 1 -- 172.21.15.123:0/912604899 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f998801a820 con 0x560bbf901140 2024-03-20T13:38:04.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bbf9f2630 con 0x560bbf901140 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9883e07640 1 -- 172.21.15.123:0/912604899 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f998800a040 con 0x560bbf901140 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9883e07640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f987c0342b0 0x7f987c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.806+0000 7f9883e07640 1 -- 172.21.15.123:0/912604899 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9988049940 con 0x560bbf901140 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9996d22640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f987c0342b0 0x7f987c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbf905640 0x560bbf9f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbf9f8e30 con 0x560bbf905640 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997d24640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbf905640 0x560bbf9f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9996d22640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f987c0342b0 0x7f987c036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f99800ad000 tx=0x7f99800a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997d24640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbf905640 0x560bbf9f88f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997d24640 1 -- 172.21.15.123:0/912604899 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbf905640 2024-03-20T13:38:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbf9f96a0 0x560bbf9fba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbf9fc200 con 0x560bbf9f96a0 2024-03-20T13:38:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997523640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbf9f96a0 0x560bbf9fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997523640 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbf9f96a0 0x560bbf9fba90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997523640 1 -- 172.21.15.123:0/912604899 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9988014070 con 0x560bbf9f96a0 2024-03-20T13:38:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbf9fda60 con 0x560bbf9f96a0 2024-03-20T13:38:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.810+0000 7f9997523640 1 -- 172.21.15.123:0/912604899 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9988014070 con 0x560bbf9f96a0 2024-03-20T13:38:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbf9fcba0 con 0x560bbf9f96a0 2024-03-20T13:38:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997523640 1 -- 172.21.15.123:0/912604899 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9988014070 con 0x560bbf9f96a0 2024-03-20T13:38:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbf9fcfb0 con 0x560bbf905640 2024-03-20T13:38:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997d24640 1 -- 172.21.15.123:0/912604899 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbf905640 2024-03-20T13:38:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 Processor -- start 2024-03-20T13:38:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 -- start start 2024-03-20T13:38:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 0x560bbfa0c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbf7a3e30 con 0x560bbfa0c170 2024-03-20T13:38:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997d24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 0x560bbfa0c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997d24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 0x560bbfa0c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33342/0 (socket says 172.21.15.123:33342) 2024-03-20T13:38:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997d24640 1 -- 172.21.15.123:0/1028311366 learned_addr learned my addr 172.21.15.123:0/1028311366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997d24640 1 -- 172.21.15.123:0/1028311366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bbfa0cad0 con 0x560bbfa0c170 2024-03-20T13:38:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9997d24640 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 0x560bbfa0c590 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9990016cf0 tx=0x7f999000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9881602640 1 -- 172.21.15.123:0/1028311366 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9990017660 con 0x560bbfa0c170 2024-03-20T13:38:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.814+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bbfa0cd20 con 0x560bbfa0c170 2024-03-20T13:38:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9881602640 1 -- 172.21.15.123:0/1028311366 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900177c0 con 0x560bbfa0c170 2024-03-20T13:38:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9881602640 1 -- 172.21.15.123:0/1028311366 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9990017a60 con 0x560bbfa0c170 2024-03-20T13:38:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bbfa0d870 con 0x560bbfa0c170 2024-03-20T13:38:04.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9881602640 1 -- 172.21.15.123:0/1028311366 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f999001d020 con 0x560bbfa0c170 2024-03-20T13:38:04.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9881602640 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98700342b0 0x7f9870036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9881602640 1 -- 172.21.15.123:0/1028311366 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f999004b250 con 0x560bbfa0c170 2024-03-20T13:38:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997523640 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98700342b0 0x7f9870036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9999a08980 1 Processor -- start 2024-03-20T13:38:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9999a08980 1 -- start start 2024-03-20T13:38:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997523640 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98700342b0 0x7f9870036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x560bbf9fc6a0 tx=0x7f9988047c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9999a08980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9999a08980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbf797790 con 0x560bbfa190a0 2024-03-20T13:38:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997d24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997d24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa194c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33358/0 (socket says 172.21.15.123:33358) 2024-03-20T13:38:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997d24640 1 -- 172.21.15.123:0/3150769787 learned_addr learned my addr 172.21.15.123:0/3150769787 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997d24640 1 -- 172.21.15.123:0/3150769787 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bbfa19a90 con 0x560bbfa190a0 2024-03-20T13:38:04.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f9997d24640 1 --2- 172.21.15.123:0/3150769787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa194c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f99900495a0 tx=0x7f9990014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd72c4513da5e7b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f987affd640 1 -- 172.21.15.123:0/3150769787 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f999003b070 con 0x560bbfa190a0 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f987affd640 1 -- 172.21.15.123:0/3150769787 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990011e30 con 0x560bbfa190a0 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.818+0000 7f987affd640 1 -- 172.21.15.123:0/3150769787 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f999003b1d0 con 0x560bbfa190a0 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3150769787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 msgr2=0x560bbfa194c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 --2- 172.21.15.123:0/3150769787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa194c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f99900495a0 tx=0x7f9990014740 comp rx=0 tx=0).stop 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3150769787 shutdown_connections 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 --2- 172.21.15.123:0/3150769787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa194c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3150769787 >> 172.21.15.123:0/3150769787 conn(0x560bbfa15430 msgr2=0x560bbfa13490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3150769787 shutdown_connections 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3150769787 wait complete. 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 Processor -- start 2024-03-20T13:38:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- start start 2024-03-20T13:38:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbfa20490 con 0x560bbfa190a0 2024-03-20T13:38:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9997d24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9997d24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa1ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33360/0 (socket says 172.21.15.123:33360) 2024-03-20T13:38:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 learned_addr learned my addr 172.21.15.123:0/3869111091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bbfa0d870 con 0x560bbfa190a0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9997d24640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa1ff50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f999000dce0 tx=0x7f9990049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f98797fa640 1 -- 172.21.15.123:0/3869111091 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99900481d0 con 0x560bbfa190a0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f98797fa640 1 -- 172.21.15.123:0/3869111091 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999001fdf0 con 0x560bbfa190a0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560bbfa20690 con 0x560bbfa190a0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f98797fa640 1 -- 172.21.15.123:0/3869111091 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9990011540 con 0x560bbfa190a0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bbfa20b20 con 0x560bbfa190a0 2024-03-20T13:38:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f98797fa640 1 -- 172.21.15.123:0/3869111091 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9990011760 con 0x560bbfa190a0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.822+0000 7f98797fa640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98600342b0 0x7f9860036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f98797fa640 1 -- 172.21.15.123:0/3869111091 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9990044ae0 con 0x560bbfa190a0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9997523640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98600342b0 0x7f9860036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbfa2b680 0x560bbfa2db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa2e290 con 0x560bbfa2b680 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9996d22640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbfa2b680 0x560bbfa2db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9997523640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98600342b0 0x7f9860036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9988001130 tx=0x7f998803c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9996d22640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbfa2b680 0x560bbfa2db40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99800abb90 con 0x560bbfa2b680 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 realm 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa2e680 con 0x560bbfa2b680 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99800abb90 con 0x560bbfa2b680 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa2ef00 con 0x560bbfa2b680 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99800abb90 con 0x560bbfa2b680 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbfa2f8e0 0x560bbfa31d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa32480 con 0x560bbfa2f8e0 2024-03-20T13:38:04.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9997d24640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbfa2f8e0 0x560bbfa31d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9997d24640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbfa2f8e0 0x560bbfa31d10 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.826+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa32c80 con 0x560bbfa2f8e0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9999a08980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9999a08980 20 searching for the correct realm 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560bbfa34ce0 0x560bbfa371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997523640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560bbfa34ce0 0x560bbfa371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997523640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560bbfa34ce0 0x560bbfa371a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997d24640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9990033070 0x7f9990005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x7f9990033070 2024-03-20T13:38:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9990033070 0x7f9990005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9990033070 0x7f9990005040 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800abb90 con 0x7f9990033070 2024-03-20T13:38:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.830+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x7f9990033070 2024-03-20T13:38:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x7f9990033070 2024-03-20T13:38:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x7f9990033070 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f99800c8040 con 0x7f9990033070 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.834+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800c8040 con 0x560bbfa2b680 2024-03-20T13:38:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x7f9990033070 2024-03-20T13:38:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2b680 2024-03-20T13:38:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.838+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x7f9990033070 2024-03-20T13:38:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x7f9990033070 2024-03-20T13:38:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa34ce0 2024-03-20T13:38:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.842+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa37870 con 0x560bbfa2f8e0 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa34240 con 0x560bbfa2b680 2024-03-20T13:38:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa331c0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa331d0 con 0x560bbfa2b680 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 zone default found 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 4 Realm: () 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 zonegroup default 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa33d20 con 0x7f9990033070 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa39bc0 con 0x560bbfa34ce0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3a090 con 0x560bbfa34ce0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 started sync module instance, tier type = 2024-03-20T13:38:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.846+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa39100 con 0x560bbfa2f8e0 2024-03-20T13:38:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94608459797680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa39100 con 0x560bbfa2f8e0 2024-03-20T13:38:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3ab00 con 0x560bbfa2b680 2024-03-20T13:38:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94608459802144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3aa40 con 0x560bbfa2b680 2024-03-20T13:38:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3ba00 con 0x560bbfa2f8e0 2024-03-20T13:38:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94608459797680] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.850+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94608459802144] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94608459804336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3aa40 con 0x560bbfa2f8e0 2024-03-20T13:38:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3b660 con 0x7f9990033070 2024-03-20T13:38:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94608459808224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3aa40 con 0x7f9990033070 2024-03-20T13:38:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3cd30 con 0x560bbfa2f8e0 2024-03-20T13:38:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94608459804336] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94608459808224] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94608459809280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3ccf0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.854+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3d0e0 con 0x560bbfa34ce0 2024-03-20T13:38:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94608459795552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3d930 con 0x560bbfa34ce0 2024-03-20T13:38:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3e300 con 0x560bbfa34ce0 2024-03-20T13:38:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94608459809280] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94608459795552] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94608459816448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3d490 con 0x560bbfa34ce0 2024-03-20T13:38:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3eb50 con 0x7f9990033070 2024-03-20T13:38:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94608459818672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3d490 con 0x7f9990033070 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=0 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=1 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=2 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=3 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=4 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=5 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94608459816448] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.858+0000 7f9999a08980 20 add_watcher() i=6 2024-03-20T13:38:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94608459818672] v34'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 20 add_watcher() i=7 2024-03-20T13:38:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3c810 con 0x560bbfa2b680 2024-03-20T13:38:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94608459819728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3c810 con 0x560bbfa2b680 2024-03-20T13:38:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94608459819728] v34'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f984dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 5 note: GC not initialized 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f984cfe1640 20 reqs_thread_entry: start 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 20 Filter name: none 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f97c67fc640 20 reqs_thread_entry: start 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 20 rados->read ofs=0 len=0 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.862+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa63bc0 con 0x7f9990033070 2024-03-20T13:38:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9999a08980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:38:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9999a08980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-03-20T13:38:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9999a08980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:38:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9999a08980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa678d0 con 0x7f9990033070 2024-03-20T13:38:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v34'8 uv7 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-03-20T13:38:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f984dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.866+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94608459819728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa28be0 con 0x560bbfa2b680 2024-03-20T13:38:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.870+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94608459819728] v34'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.870+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94608459797680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3ead0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.870+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94608459797680] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.870+0000 7f9999a08980 20 remove_watcher() i=0 2024-03-20T13:38:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.870+0000 7f9999a08980 2 removed watcher, disabling cache 2024-03-20T13:38:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.870+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94608459802144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3ead0 con 0x560bbfa2b680 2024-03-20T13:38:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.874+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94608459802144] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x560bbfa2b680 2024-03-20T13:38:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.874+0000 7f9999a08980 20 remove_watcher() i=1 2024-03-20T13:38:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.874+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94608459804336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3a620 con 0x560bbfa2f8e0 2024-03-20T13:38:04.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.874+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94608459804336] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.874+0000 7f9999a08980 20 remove_watcher() i=2 2024-03-20T13:38:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.874+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94608459808224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3ead0 con 0x7f9990033070 2024-03-20T13:38:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94608459808224] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9999a08980 20 remove_watcher() i=3 2024-03-20T13:38:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94608459809280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3a620 con 0x560bbfa2f8e0 2024-03-20T13:38:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9997d24640 1 -- 172.21.15.123:0/3869111091 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94608459809280] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f999000a4d0 con 0x560bbfa2f8e0 2024-03-20T13:38:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9999a08980 20 remove_watcher() i=4 2024-03-20T13:38:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94608459795552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3c280 con 0x560bbfa34ce0 2024-03-20T13:38:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94608459795552] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9999a08980 20 remove_watcher() i=5 2024-03-20T13:38:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.878+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94608459816448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3c280 con 0x560bbfa34ce0 2024-03-20T13:38:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9997523640 1 -- 172.21.15.123:0/3869111091 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94608459816448] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9988014070 con 0x560bbfa34ce0 2024-03-20T13:38:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 20 remove_watcher() i=6 2024-03-20T13:38:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94608459818672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x560bbfa3c280 con 0x7f9990033070 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94608459818672] v34'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99800d5060 con 0x7f9990033070 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 20 remove_watcher() i=7 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbfa2f8e0 msgr2=0x560bbfa31d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbfa2f8e0 0x560bbfa31d10 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbfa2b680 msgr2=0x560bbfa2db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbfa2b680 0x560bbfa2db40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9990033070 msgr2=0x7f9990005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f9990033070 0x7f9990005040 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560bbfa34ce0 msgr2=0x560bbfa371a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x560bbfa34ce0 0x560bbfa371a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98600342b0 msgr2=0x7f9860036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98600342b0 0x7f9860036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9988001130 tx=0x7f998803c000 comp rx=0 tx=0).stop 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 msgr2=0x560bbfa1ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9996d22640 1 -- 172.21.15.123:0/3869111091 reap_dead start 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa1ff50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f999000dce0 tx=0x7f9990049530 comp rx=0 tx=0).stop 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 shutdown_connections 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/3869111091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa190a0 0x560bbfa1ff50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 >> 172.21.15.123:0/3869111091 conn(0x560bbfa15430 msgr2=0x560bbfa12a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 shutdown_connections 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/3869111091 wait complete. 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98700342b0 msgr2=0x7f9870036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98700342b0 0x7f9870036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x560bbf9fc6a0 tx=0x7f9988047c20 comp rx=0 tx=0).stop 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 msgr2=0x560bbfa0c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 0x560bbfa0c590 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9990016cf0 tx=0x7f999000d790 comp rx=0 tx=0).stop 2024-03-20T13:38:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 shutdown_connections 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f98700342b0 0x7f9870036770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/1028311366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbfa0c170 0x560bbfa0c590 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 >> 172.21.15.123:0/1028311366 conn(0x560bbfa00f80 msgr2=0x560bbfa01a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 shutdown_connections 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/1028311366 wait complete. 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbf9f96a0 msgr2=0x560bbf9fba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbf9f96a0 0x560bbf9fba90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbf905640 msgr2=0x560bbf9f88f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbf905640 0x560bbf9f88f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f987c0342b0 msgr2=0x7f987c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f987c0342b0 0x7f987c036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f99800ad000 tx=0x7f99800a5040 comp rx=0 tx=0).stop 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 msgr2=0x560bbf9f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9f1cc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f998800b710 tx=0x7f9988000bd0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 shutdown_connections 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560bbf9f96a0 0x560bbf9fba90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560bbf905640 0x560bbf9f88f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f987c0342b0 0x7f987c036770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 --2- 172.21.15.123:0/912604899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560bbf901140 0x560bbf9f1cc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 >> 172.21.15.123:0/912604899 conn(0x560bbf874860 msgr2=0x560bbf9e54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 shutdown_connections 2024-03-20T13:38:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.882+0000 7f9999a08980 1 -- 172.21.15.123:0/912604899 wait complete. 2024-03-20T13:38:04.898 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:38:04.904 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:38:04.904 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-03-20T13:38:04.910 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:38:04.910 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-03-20T13:38:04.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-03-20T13:38:04.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-03-20T13:38:04.911 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-03-20T13:38:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.966+0000 7f1dc462c980 1 Processor -- start 2024-03-20T13:38:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.966+0000 7f1dc462c980 1 -- start start 2024-03-20T13:38:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc462c980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5564a90a48c0 0x5564a9135040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc462c980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5564a907c4c0 con 0x5564a9135580 2024-03-20T13:38:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc462c980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5564a90430f0 con 0x5564a90a48c0 2024-03-20T13:38:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc2147640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5564a90a48c0 0x5564a9135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc2147640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5564a90a48c0 0x5564a9135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33362/0 (socket says 172.21.15.123:33362) 2024-03-20T13:38:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc1946640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5564a9135580 0x5564a9137970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59314/0 (socket says 172.21.15.123:59314) 2024-03-20T13:38:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc2147640 1 -- 172.21.15.123:0/2887775499 learned_addr learned my addr 172.21.15.123:0/2887775499 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc2147640 1 -- 172.21.15.123:0/2887775499 >> v1:172.21.15.89:6789/0 conn(0x5564a9135580 legacy=0x5564a9137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc2147640 1 -- 172.21.15.123:0/2887775499 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a9130a60 con 0x5564a90a48c0 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc2147640 1 --2- 172.21.15.123:0/2887775499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9135040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00a5c0 tx=0x7f1dbc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75f52c1c8e9fb5d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc1145640 1 -- 172.21.15.123:0/2887775499 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dbc0aa470 con 0x5564a90a48c0 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc1145640 1 -- 172.21.15.123:0/2887775499 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0aa5d0 con 0x5564a90a48c0 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.970+0000 7f1dc1145640 1 -- 172.21.15.123:0/2887775499 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dbc0aa890 con 0x5564a90a48c0 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 -- 172.21.15.123:0/2887775499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 msgr2=0x5564a9135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 --2- 172.21.15.123:0/2887775499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9135040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00a5c0 tx=0x7f1dbc01b340 comp rx=0 tx=0).stop 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 -- 172.21.15.123:0/2887775499 shutdown_connections 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 --2- 172.21.15.123:0/2887775499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9135040 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 -- 172.21.15.123:0/2887775499 >> 172.21.15.123:0/2887775499 conn(0x5564a912a720 msgr2=0x5564a912cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 -- 172.21.15.123:0/2887775499 shutdown_connections 2024-03-20T13:38:04.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.974+0000 7f1dc462c980 1 -- 172.21.15.123:0/2887775499 wait complete. 2024-03-20T13:38:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc462c980 1 Processor -- start 2024-03-20T13:38:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc462c980 1 -- start start 2024-03-20T13:38:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc462c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a921c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc462c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a9040620 con 0x5564a90a48c0 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc2147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a921c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc2147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a921c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33368/0 (socket says 172.21.15.123:33368) 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc2147640 1 -- 172.21.15.123:0/3898082087 learned_addr learned my addr 172.21.15.123:0/3898082087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc2147640 1 -- 172.21.15.123:0/3898082087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc005df0 con 0x5564a90a48c0 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.986+0000 7f1dc2147640 1 --2- 172.21.15.123:0/3898082087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a921c0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc018f70 tx=0x7f1dbc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbff2ad06ac67e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1cb0608640 1 -- 172.21.15.123:0/3898082087 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dbc0aa9c0 con 0x5564a90a48c0 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1cb0608640 1 -- 172.21.15.123:0/3898082087 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0aab20 con 0x5564a90a48c0 2024-03-20T13:38:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1cb0608640 1 -- 172.21.15.123:0/3898082087 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dbc0aadc0 con 0x5564a90a48c0 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/3898082087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 msgr2=0x5564a921c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 --2- 172.21.15.123:0/3898082087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a921c0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc018f70 tx=0x7f1dbc003030 comp rx=0 tx=0).stop 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/3898082087 shutdown_connections 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 --2- 172.21.15.123:0/3898082087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a921c0d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/3898082087 >> 172.21.15.123:0/3898082087 conn(0x5564a912a720 msgr2=0x5564a9217c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/3898082087 shutdown_connections 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/3898082087 wait complete. 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 Processor -- start 2024-03-20T13:38:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- start start 2024-03-20T13:38:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9222e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a903be00 con 0x5564a90a48c0 2024-03-20T13:38:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc2147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9222e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc2147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9222e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33378/0 (socket says 172.21.15.123:33378) 2024-03-20T13:38:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc2147640 1 -- 172.21.15.123:0/527164218 learned_addr learned my addr 172.21.15.123:0/527164218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc2147640 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a9130a60 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc2147640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9222e20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc018f70 tx=0x7f1dbc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1caee05640 1 -- 172.21.15.123:0/527164218 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dbc0cb070 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564a9223360 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1caee05640 1 -- 172.21.15.123:0/527164218 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0bd810 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1caee05640 1 -- 172.21.15.123:0/527164218 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dbc0bdab0 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.990+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564a9223730 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1caee05640 1 -- 172.21.15.123:0/527164218 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1dbc0bdce0 con 0x5564a90a48c0 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1caee05640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1ca8034300 0x7f1ca80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1caee05640 1 -- 172.21.15.123:0/527164218 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1dbc0e4bc0 con 0x5564a90a48c0 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc1946640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1ca8034300 0x7f1ca80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a9135580 0x5564a9229a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9229f90 con 0x5564a9135580 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc2948640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a9135580 0x5564a9229a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc1946640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1ca8034300 0x7f1ca80367c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1dac000f70 tx=0x7f1dac001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc2948640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a9135580 0x5564a9229a50 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc2948640 1 -- 172.21.15.123:0/527164218 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9135580 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a922a800 0x5564a922cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a922d250 con 0x5564a922a800 2024-03-20T13:38:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc2147640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a922a800 0x5564a922cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc2147640 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a922a800 0x5564a922cbf0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc2147640 1 -- 172.21.15.123:0/527164218 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a922a800 2024-03-20T13:38:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.994+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a922ea90 con 0x5564a922a800 2024-03-20T13:38:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2147640 1 -- 172.21.15.123:0/527164218 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a922a800 2024-03-20T13:38:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a922dc90 con 0x5564a922a800 2024-03-20T13:38:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2147640 1 -- 172.21.15.123:0/527164218 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a922a800 2024-03-20T13:38:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a922e0a0 con 0x5564a9135580 2024-03-20T13:38:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2948640 1 -- 172.21.15.123:0/527164218 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9135580 2024-03-20T13:38:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 Processor -- start 2024-03-20T13:38:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 -- start start 2024-03-20T13:38:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 0x5564a923d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a8fd4e30 con 0x5564a923d240 2024-03-20T13:38:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 0x5564a923d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 0x5564a923d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33382/0 (socket says 172.21.15.123:33382) 2024-03-20T13:38:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2948640 1 -- 172.21.15.123:0/1910837630 learned_addr learned my addr 172.21.15.123:0/1910837630 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2948640 1 -- 172.21.15.123:0/1910837630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a923dba0 con 0x5564a923d240 2024-03-20T13:38:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc2948640 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 0x5564a923d660 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1db4016cf0 tx=0x7f1db400d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1ca7fff640 1 -- 172.21.15.123:0/1910837630 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db4017660 con 0x5564a923d240 2024-03-20T13:38:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1ca7fff640 1 -- 172.21.15.123:0/1910837630 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db40177c0 con 0x5564a923d240 2024-03-20T13:38:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564a923ddf0 con 0x5564a923d240 2024-03-20T13:38:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1ca7fff640 1 -- 172.21.15.123:0/1910837630 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db4017a60 con 0x5564a923d240 2024-03-20T13:38:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:04.998+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564a923e940 con 0x5564a923d240 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1ca7fff640 1 -- 172.21.15.123:0/1910837630 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1db401d020 con 0x5564a923d240 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1ca7fff640 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c9c0342b0 0x7f1c9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1ca7fff640 1 -- 172.21.15.123:0/1910837630 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1db404b2d0 con 0x5564a923d240 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2147640 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c9c0342b0 0x7f1c9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 Processor -- start 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- start start 2024-03-20T13:38:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2147640 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c9c0342b0 0x7f1c9c036770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5564a922d6d0 tx=0x7f1dbc0e2ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a924a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a8fc8790 con 0x5564a924a1c0 2024-03-20T13:38:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a924a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a924a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33390/0 (socket says 172.21.15.123:33390) 2024-03-20T13:38:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 -- 172.21.15.123:0/1122039741 learned_addr learned my addr 172.21.15.123:0/1122039741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 -- 172.21.15.123:0/1122039741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a924abb0 con 0x5564a924a1c0 2024-03-20T13:38:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 --2- 172.21.15.123:0/1122039741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a924a5e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1db40495a0 tx=0x7f1db4049850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160d087f0b1e0bb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1ca5ffb640 1 -- 172.21.15.123:0/1122039741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db403b070 con 0x5564a924a1c0 2024-03-20T13:38:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1ca5ffb640 1 -- 172.21.15.123:0/1122039741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db404b0d0 con 0x5564a924a1c0 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1ca5ffb640 1 -- 172.21.15.123:0/1122039741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db403b300 con 0x5564a924a1c0 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- 172.21.15.123:0/1122039741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 msgr2=0x5564a924a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1122039741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a924a5e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1db40495a0 tx=0x7f1db4049850 comp rx=0 tx=0).stop 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- 172.21.15.123:0/1122039741 shutdown_connections 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1122039741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a924a5e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- 172.21.15.123:0/1122039741 >> 172.21.15.123:0/1122039741 conn(0x5564a9246500 msgr2=0x5564a9244560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- 172.21.15.123:0/1122039741 shutdown_connections 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- 172.21.15.123:0/1122039741 wait complete. 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 Processor -- start 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- start start 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a9251070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc462c980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a92515b0 con 0x5564a924a1c0 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a9251070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a9251070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33394/0 (socket says 172.21.15.123:33394) 2024-03-20T13:38:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.002+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 learned_addr learned my addr 172.21.15.123:0/1895438742 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a923e940 con 0x5564a924a1c0 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc2948640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a9251070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1db400a100 tx=0x7f1db4049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1c93fff640 1 -- 172.21.15.123:0/1895438742 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db40481d0 con 0x5564a924a1c0 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1c93fff640 1 -- 172.21.15.123:0/1895438742 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4049930 con 0x5564a924a1c0 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564a92517b0 con 0x5564a924a1c0 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1c93fff640 1 -- 172.21.15.123:0/1895438742 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db4049bd0 con 0x5564a924a1c0 2024-03-20T13:38:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564a9251c40 con 0x5564a924a1c0 2024-03-20T13:38:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1c93fff640 1 -- 172.21.15.123:0/1895438742 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1db4049d30 con 0x5564a924a1c0 2024-03-20T13:38:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1c93fff640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c8c034300 0x7f1c8c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1c93fff640 1 -- 172.21.15.123:0/1895438742 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1db4048540 con 0x5564a924a1c0 2024-03-20T13:38:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc2147640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c8c034300 0x7f1c8c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a925c730 0x5564a925ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a925f340 con 0x5564a925c730 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc1946640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a925c730 0x5564a925ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc2147640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c8c034300 0x7f1c8c0367c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0c6ee0 tx=0x7f1dbc0ef000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc1946640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a925c730 0x5564a925ebf0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 realm 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a925bb90 con 0x5564a925c730 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a925fdc0 con 0x5564a925c730 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a9260b50 0x5564a9262f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92635c0 con 0x5564a9260b50 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.006+0000 7f1dc2948640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a9260b50 0x5564a9262f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2948640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a9260b50 0x5564a9262f40 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a9260b50 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 20 searching for the correct realm 2024-03-20T13:38:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5564a9265d00 0x5564a92681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9268890 con 0x5564a9265d00 2024-03-20T13:38:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2147640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5564a9265d00 0x5564a92681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2147640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5564a9265d00 0x5564a92681c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9268890 con 0x5564a9260b50 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2948640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1db403b4d0 0x7f1db4029610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x7f1db403b4d0 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc1946640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1db403b4d0 0x7f1db4029610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.010+0000 7f1dc1946640 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1db403b4d0 0x7f1db4029610 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a9265d00 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a9260b50 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a9260b50 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a925c730 2024-03-20T13:38:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x7f1db403b4d0 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9263dc0 con 0x5564a925c730 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x7f1db403b4d0 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.014+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9260b50 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9265d00 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a925c730 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9260b50 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9265d00 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9265d00 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x7f1db403b4d0 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x7f1db403b4d0 2024-03-20T13:38:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9265d00 2024-03-20T13:38:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.018+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x7f1db403b4d0 2024-03-20T13:38:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9260b50 2024-03-20T13:38:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9260b50 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9265d00 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9260b50 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1dac02d080 con 0x5564a9260b50 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9264120 con 0x5564a925c730 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.022+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92644d0 con 0x5564a9260b50 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92644d0 con 0x5564a925c730 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 zone default found 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 4 Realm: () 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 zonegroup default 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9268cd0 con 0x7f1db403b4d0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926aa10 con 0x5564a9265d00 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926ade0 con 0x5564a9265d00 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 started sync module instance, tier type = 2024-03-20T13:38:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926a2f0 con 0x5564a9260b50 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.026+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93890822970960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926a270 con 0x5564a9260b50 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926bb40 con 0x5564a925c730 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93890822977184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926bf60 con 0x5564a925c730 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926c7c0 con 0x5564a9260b50 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93890822970960] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93890822977184] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93890822976000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926bf60 con 0x5564a9260b50 2024-03-20T13:38:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.030+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926d010 con 0x7f1db403b4d0 2024-03-20T13:38:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93890822982512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926bf60 con 0x7f1db403b4d0 2024-03-20T13:38:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926db00 con 0x5564a9260b50 2024-03-20T13:38:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93890822976000] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93890822982512] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93890822985216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926bac0 con 0x5564a9260b50 2024-03-20T13:38:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926e350 con 0x5564a9265d00 2024-03-20T13:38:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93890822987440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926bac0 con 0x5564a9265d00 2024-03-20T13:38:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.034+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926f160 con 0x5564a9265d00 2024-03-20T13:38:05.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93890822985216] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93890822987440] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93890822989488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926ecc0 con 0x5564a9265d00 2024-03-20T13:38:05.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926f500 con 0x7f1db403b4d0 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93890822991040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926fd50 con 0x7f1db403b4d0 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=0 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=1 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=2 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=3 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=4 2024-03-20T13:38:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=5 2024-03-20T13:38:05.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93890822989488] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=6 2024-03-20T13:38:05.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93890822991040] v34'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 20 add_watcher() i=7 2024-03-20T13:38:05.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:05.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9272990 con 0x5564a925c730 2024-03-20T13:38:05.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.038+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93890822983568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926fd00 con 0x5564a925c730 2024-03-20T13:38:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93890822983568] v34'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1c78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1dc462c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1dc462c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927afd0 con 0x5564a9260b50 2024-03-20T13:38:05.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.042+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927b410 con 0x7f1db403b4d0 2024-03-20T13:38:05.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.046+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.046+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927b410 con 0x5564a9265d00 2024-03-20T13:38:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.046+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.046+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927b940 con 0x5564a925c730 2024-03-20T13:38:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.050+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.050+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927be70 con 0x5564a9260b50 2024-03-20T13:38:05.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.050+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'69 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.050+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927c3a0 con 0x5564a9265d00 2024-03-20T13:38:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.054+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.054+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927c8d0 con 0x5564a9260b50 2024-03-20T13:38:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.054+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.054+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927ce00 con 0x5564a925c730 2024-03-20T13:38:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.054+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.054+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927d2a0 con 0x5564a9260b50 2024-03-20T13:38:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.058+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.058+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9279050 con 0x5564a9260b50 2024-03-20T13:38:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.058+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.062+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927a840 con 0x5564a9260b50 2024-03-20T13:38:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.062+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'70 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.062+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92789e0 con 0x5564a9265d00 2024-03-20T13:38:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.062+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.062+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92789e0 con 0x5564a9260b50 2024-03-20T13:38:05.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.066+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.066+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927a980 con 0x5564a925c730 2024-03-20T13:38:05.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.066+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.066+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927a980 con 0x5564a925c730 2024-03-20T13:38:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.070+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.070+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927a980 con 0x5564a9260b50 2024-03-20T13:38:05.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.070+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.070+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927a980 con 0x5564a9260b50 2024-03-20T13:38:05.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.074+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'71 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.074+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927a980 con 0x5564a9265d00 2024-03-20T13:38:05.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.074+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.074+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9260b50 2024-03-20T13:38:05.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.078+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.078+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a925c730 2024-03-20T13:38:05.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.078+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.078+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9260b50 2024-03-20T13:38:05.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.082+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.082+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9260b50 2024-03-20T13:38:05.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.082+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.082+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9265d00 2024-03-20T13:38:05.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.086+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.086+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9260b50 2024-03-20T13:38:05.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.086+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.086+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9265d00 2024-03-20T13:38:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.086+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.086+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9265d00 2024-03-20T13:38:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.090+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.090+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9265d00 2024-03-20T13:38:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.090+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.090+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9260b50 2024-03-20T13:38:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.094+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.094+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a925c730 2024-03-20T13:38:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.094+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.094+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a9260b50 2024-03-20T13:38:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x5564a925c730 2024-03-20T13:38:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a927dbe0 con 0x7f1db403b4d0 2024-03-20T13:38:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1bf37fe640 20 reqs_thread_entry: start 2024-03-20T13:38:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 20 Filter name: none 2024-03-20T13:38:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1bf17fa640 20 reqs_thread_entry: start 2024-03-20T13:38:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9278520 con 0x7f1db403b4d0 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.098+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9299c20 con 0x5564a9260b50 2024-03-20T13:38:05.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-03-20T13:38:05.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-20T13:38:05.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 93890823028976 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a929a180 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== watch-notify(notify (1) cookie 93890822987440 notify 146028888084 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5564a9223730 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1ca5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 93890822987440 notifier 4752 bl.length()=170 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1ca5ffb640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1c88003d60 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(96 notify.5 [notify cookie 93890823028976 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== watch-notify(notify_complete (2) cookie 93890823028976 notify 146028888084 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5564a9223360 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a929a100 con 0x5564a925c730 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 10 removing email index: 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 10 removing user buckets index 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93890823028976 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a929a140 con 0x5564a9265d00 2024-03-20T13:38:05.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== watch-notify(notify (1) cookie 93890822989488 notify 146028888085 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x5564a9223360 con 0x5564a9265d00 2024-03-20T13:38:05.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1ca57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 93890822989488 notifier 4752 bl.length()=160 2024-03-20T13:38:05.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(99 notify.6 [notify cookie 93890823028976 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1ca57fa640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1bf80032c0 con 0x5564a9265d00 2024-03-20T13:38:05.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== watch-notify(notify_complete (2) cookie 93890823028976 notify 146028888085 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5564a9130a60 con 0x5564a9265d00 2024-03-20T13:38:05.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.102+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92780f0 con 0x5564a9260b50 2024-03-20T13:38:05.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(101 bud.buckets [delete] v34'6 uv4 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc462c980 10 removing user index: bud 2024-03-20T13:38:05.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc462c980 10 removing default.rgw.meta+users.uid+bud from cache 2024-03-20T13:38:05.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc462c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-03-20T13:38:05.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 93890823028976 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92990b0 con 0x5564a9265d00 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== watch-notify(notify (1) cookie 93890822987440 notify 146028888086 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5564a9130a60 con 0x5564a9265d00 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1ca5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 93890822987440 notifier 4752 bl.length()=152 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1ca5ffb640 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f1c88003d60 con 0x5564a9265d00 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(102 notify.5 [notify cookie 93890823028976 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== watch-notify(notify_complete (2) cookie 93890823028976 notify 146028888086 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1dbc005df0 con 0x5564a9265d00 2024-03-20T13:38:05.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a92990b0 con 0x7f1db403b4d0 2024-03-20T13:38:05.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(104 bud [call,call,delete] v34'5 uv5 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1c78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:05.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.106+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93890822983568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a9299900 con 0x5564a925c730 2024-03-20T13:38:05.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.110+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93890822983568] v34'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.110+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93890822970960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926cf90 con 0x5564a9260b50 2024-03-20T13:38:05.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.110+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93890822970960] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.110+0000 7f1dc462c980 20 remove_watcher() i=0 2024-03-20T13:38:05.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.110+0000 7f1dc462c980 2 removed watcher, disabling cache 2024-03-20T13:38:05.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.110+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93890822977184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926cf90 con 0x5564a925c730 2024-03-20T13:38:05.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93890822977184] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x5564a925c730 2024-03-20T13:38:05.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc462c980 20 remove_watcher() i=1 2024-03-20T13:38:05.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93890822976000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926b6a0 con 0x5564a9260b50 2024-03-20T13:38:05.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93890822976000] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc462c980 20 remove_watcher() i=2 2024-03-20T13:38:05.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93890822982512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926cf90 con 0x7f1db403b4d0 2024-03-20T13:38:05.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93890822982512] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc462c980 20 remove_watcher() i=3 2024-03-20T13:38:05.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.114+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93890822985216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926d010 con 0x5564a9260b50 2024-03-20T13:38:05.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.118+0000 7f1dc2948640 1 -- 172.21.15.123:0/1895438742 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93890822985216] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a4d0 con 0x5564a9260b50 2024-03-20T13:38:05.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.118+0000 7f1dc462c980 20 remove_watcher() i=4 2024-03-20T13:38:05.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.118+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93890822987440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926d010 con 0x5564a9265d00 2024-03-20T13:38:05.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.118+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93890822987440] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.118+0000 7f1dc462c980 20 remove_watcher() i=5 2024-03-20T13:38:05.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.118+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93890822989488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926d010 con 0x5564a9265d00 2024-03-20T13:38:05.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc2147640 1 -- 172.21.15.123:0/1895438742 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93890822989488] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dbc0cd070 con 0x5564a9265d00 2024-03-20T13:38:05.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 20 remove_watcher() i=6 2024-03-20T13:38:05.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93890822991040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5564a926d010 con 0x7f1db403b4d0 2024-03-20T13:38:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93890822991040] v34'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac00f620 con 0x7f1db403b4d0 2024-03-20T13:38:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 20 remove_watcher() i=7 2024-03-20T13:38:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a9260b50 msgr2=0x5564a9262f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a9260b50 0x5564a9262f40 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a925c730 msgr2=0x5564a925ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a925c730 0x5564a925ebf0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1db403b4d0 msgr2=0x7f1db4029610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f1db403b4d0 0x7f1db4029610 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5564a9265d00 msgr2=0x5564a92681c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5564a9265d00 0x5564a92681c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c8c034300 msgr2=0x7f1c8c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c8c034300 0x7f1c8c0367c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0c6ee0 tx=0x7f1dbc0ef000 comp rx=0 tx=0).stop 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 msgr2=0x5564a9251070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a9251070 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1db400a100 tx=0x7f1db4049530 comp rx=0 tx=0).stop 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc1946640 1 -- 172.21.15.123:0/1895438742 reap_dead start 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 shutdown_connections 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1895438742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a924a1c0 0x5564a9251070 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 >> 172.21.15.123:0/1895438742 conn(0x5564a9246500 msgr2=0x5564a9243b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 shutdown_connections 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1895438742 wait complete. 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c9c0342b0 msgr2=0x7f1c9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c9c0342b0 0x7f1c9c036770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5564a922d6d0 tx=0x7f1dbc0e2ea0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 msgr2=0x5564a923d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 0x5564a923d660 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1db4016cf0 tx=0x7f1db400d790 comp rx=0 tx=0).stop 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 shutdown_connections 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1c9c0342b0 0x7f1c9c036770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/1910837630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a923d240 0x5564a923d660 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 >> 172.21.15.123:0/1910837630 conn(0x5564a9232050 msgr2=0x5564a9232b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 shutdown_connections 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/1910837630 wait complete. 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a922a800 msgr2=0x5564a922cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a922a800 0x5564a922cbf0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a9135580 msgr2=0x5564a9229a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a9135580 0x5564a9229a50 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1ca8034300 msgr2=0x7f1ca80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1ca8034300 0x7f1ca80367c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1dac000f70 tx=0x7f1dac001380 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 msgr2=0x5564a9222e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9222e20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc018f70 tx=0x7f1dbc0180e0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 shutdown_connections 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5564a922a800 0x5564a922cbf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5564a9135580 0x5564a9229a50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f1ca8034300 0x7f1ca80367c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 --2- 172.21.15.123:0/527164218 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564a90a48c0 0x5564a9222e20 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 >> 172.21.15.123:0/527164218 conn(0x5564a912a720 msgr2=0x5564a9216770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 shutdown_connections 2024-03-20T13:38:05.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.122+0000 7f1dc462c980 1 -- 172.21.15.123:0/527164218 wait complete. 2024-03-20T13:38:05.138 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-03-20T13:38:05.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-03-20T13:38:05.138 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-03-20T13:38:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:05.215 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.210+0000 7f5448f3d980 1 Processor -- start 2024-03-20T13:38:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.210+0000 7f5448f3d980 1 -- start start 2024-03-20T13:38:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.210+0000 7f5448f3d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dbb6823080 0x55dbb6823490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.210+0000 7f5448f3d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dbb67f64c0 con 0x55dbb6820b80 2024-03-20T13:38:05.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.210+0000 7f5448f3d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dbb67bd0f0 con 0x55dbb6823080 2024-03-20T13:38:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5446257640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dbb6823080 0x55dbb6823490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5446257640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dbb6823080 0x55dbb6823490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33408/0 (socket says 172.21.15.123:33408) 2024-03-20T13:38:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5446257640 1 -- 172.21.15.123:0/342482792 learned_addr learned my addr 172.21.15.123:0/342482792 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5446257640 1 -- 172.21.15.123:0/342482792 >> v1:172.21.15.89:6789/0 conn(0x55dbb6820b80 legacy=0x55dbb6820f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5446257640 1 -- 172.21.15.123:0/342482792 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb68249e0 con 0x55dbb6823080 2024-03-20T13:38:05.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5446257640 1 --2- 172.21.15.123:0/342482792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb6823490 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f543c00a5c0 tx=0x7f543c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ddb473996f0715 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5445a56640 1 -- 172.21.15.123:0/342482792 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f543c0aa470 con 0x55dbb6823080 2024-03-20T13:38:05.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5445a56640 1 -- 172.21.15.123:0/342482792 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c0aa5d0 con 0x55dbb6823080 2024-03-20T13:38:05.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5445a56640 1 -- 172.21.15.123:0/342482792 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f543c0aa890 con 0x55dbb6823080 2024-03-20T13:38:05.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 -- 172.21.15.123:0/342482792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 msgr2=0x55dbb6823490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 --2- 172.21.15.123:0/342482792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb6823490 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f543c00a5c0 tx=0x7f543c01b340 comp rx=0 tx=0).stop 2024-03-20T13:38:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 -- 172.21.15.123:0/342482792 shutdown_connections 2024-03-20T13:38:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 --2- 172.21.15.123:0/342482792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb6823490 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 -- 172.21.15.123:0/342482792 >> 172.21.15.123:0/342482792 conn(0x55dbb681f860 msgr2=0x55dbb681fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 -- 172.21.15.123:0/342482792 shutdown_connections 2024-03-20T13:38:05.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.214+0000 7f5448f3d980 1 -- 172.21.15.123:0/342482792 wait complete. 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5448f3d980 1 Processor -- start 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5448f3d980 1 -- start start 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5448f3d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 0x55dbb699a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5448f3d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb67ba620 con 0x55dbb6820b80 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5446a58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 0x55dbb699a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5446a58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 0x55dbb699a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33418/0 (socket says 172.21.15.123:33418) 2024-03-20T13:38:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5446a58640 1 -- 172.21.15.123:0/1802514728 learned_addr learned my addr 172.21.15.123:0/1802514728 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5446a58640 1 -- 172.21.15.123:0/1802514728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c005df0 con 0x55dbb6820b80 2024-03-20T13:38:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5446a58640 1 --2- 172.21.15.123:0/1802514728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 0x55dbb699a470 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5438006fb0 tx=0x7f5438001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1e9245f9b3e09f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5334e09640 1 -- 172.21.15.123:0/1802514728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f543800f640 con 0x55dbb6820b80 2024-03-20T13:38:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5334e09640 1 -- 172.21.15.123:0/1802514728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800f7c0 con 0x55dbb6820b80 2024-03-20T13:38:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5334e09640 1 -- 172.21.15.123:0/1802514728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f543800fae0 con 0x55dbb6820b80 2024-03-20T13:38:05.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5448f3d980 1 -- 172.21.15.123:0/1802514728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 msgr2=0x55dbb699a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.230+0000 7f5448f3d980 1 --2- 172.21.15.123:0/1802514728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 0x55dbb699a470 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5438006fb0 tx=0x7f5438001940 comp rx=0 tx=0).stop 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/1802514728 shutdown_connections 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 --2- 172.21.15.123:0/1802514728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6820b80 0x55dbb699a470 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/1802514728 >> 172.21.15.123:0/1802514728 conn(0x55dbb681f860 msgr2=0x55dbb6996000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/1802514728 shutdown_connections 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/1802514728 wait complete. 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 Processor -- start 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- start start 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb69a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb67b5e00 con 0x55dbb6823080 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5446a58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb69a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5446a58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb69a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33428/0 (socket says 172.21.15.123:33428) 2024-03-20T13:38:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5446a58640 1 -- 172.21.15.123:0/2744700460 learned_addr learned my addr 172.21.15.123:0/2744700460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5446a58640 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb67f64c0 con 0x55dbb6823080 2024-03-20T13:38:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5446a58640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb69a15b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5438003000 tx=0x7f5438000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5333606640 1 -- 172.21.15.123:0/2744700460 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5438005450 con 0x55dbb6823080 2024-03-20T13:38:05.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbb69a1af0 con 0x55dbb6823080 2024-03-20T13:38:05.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5333606640 1 -- 172.21.15.123:0/2744700460 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54380055b0 con 0x55dbb6823080 2024-03-20T13:38:05.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5333606640 1 -- 172.21.15.123:0/2744700460 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5438005890 con 0x55dbb6823080 2024-03-20T13:38:05.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbb69a1f20 con 0x55dbb6823080 2024-03-20T13:38:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5333606640 1 -- 172.21.15.123:0/2744700460 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f54380059f0 con 0x55dbb6823080 2024-03-20T13:38:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5333606640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f532c0342b0 0x7f532c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5333606640 1 -- 172.21.15.123:0/2744700460 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5438049000 con 0x55dbb6823080 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5446257640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f532c0342b0 0x7f532c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69a61d0 0x55dbb69a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69a8b00 con 0x55dbb69a61d0 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.234+0000 7f5447259640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69a61d0 0x55dbb69a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5446257640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f532c0342b0 0x7f532c036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f543c0ae000 tx=0x7f543c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5447259640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69a61d0 0x55dbb69a85c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5447259640 1 -- 172.21.15.123:0/2744700460 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54400083f0 con 0x55dbb69a61d0 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69a9370 0x55dbb69ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69abe10 con 0x55dbb69a9370 2024-03-20T13:38:05.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5446a58640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69a9370 0x55dbb69ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5446a58640 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69a9370 0x55dbb69ab760 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5446a58640 1 -- 172.21.15.123:0/2744700460 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69a9370 2024-03-20T13:38:05.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ad670 con 0x55dbb69a9370 2024-03-20T13:38:05.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5446a58640 1 -- 172.21.15.123:0/2744700460 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69a9370 2024-03-20T13:38:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ac870 con 0x55dbb69a9370 2024-03-20T13:38:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5446a58640 1 -- 172.21.15.123:0/2744700460 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69a9370 2024-03-20T13:38:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69acc80 con 0x55dbb69a61d0 2024-03-20T13:38:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.238+0000 7f5447259640 1 -- 172.21.15.123:0/2744700460 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f54400083f0 con 0x55dbb69a61d0 2024-03-20T13:38:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 Processor -- start 2024-03-20T13:38:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 -- start start 2024-03-20T13:38:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 0x55dbb69bc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb674ee30 con 0x55dbb69bbd30 2024-03-20T13:38:05.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5447259640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 0x55dbb69bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5447259640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 0x55dbb69bc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33438/0 (socket says 172.21.15.123:33438) 2024-03-20T13:38:05.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5447259640 1 -- 172.21.15.123:0/1875878463 learned_addr learned my addr 172.21.15.123:0/1875878463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5447259640 1 -- 172.21.15.123:0/1875878463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb69bc690 con 0x55dbb69bbd30 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5447259640 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 0x55dbb69bc150 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55dbb69a2200 tx=0x7f544000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5330e01640 1 -- 172.21.15.123:0/1875878463 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f544001d070 con 0x55dbb69bbd30 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5330e01640 1 -- 172.21.15.123:0/1875878463 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440010040 con 0x55dbb69bbd30 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5330e01640 1 -- 172.21.15.123:0/1875878463 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5440007e20 con 0x55dbb69bbd30 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbb69bc8e0 con 0x55dbb69bbd30 2024-03-20T13:38:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbb69bd430 con 0x55dbb69bbd30 2024-03-20T13:38:05.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5330e01640 1 -- 172.21.15.123:0/1875878463 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5440018430 con 0x55dbb69bbd30 2024-03-20T13:38:05.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5330e01640 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5320034300 0x7f53200367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5330e01640 1 -- 172.21.15.123:0/1875878463 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f544004a5d0 con 0x55dbb69bbd30 2024-03-20T13:38:05.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5446a58640 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5320034300 0x7f53200367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5448f3d980 1 Processor -- start 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.242+0000 7f5446a58640 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5320034300 0x7f53200367c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55dbb69ac370 tx=0x7f5438031040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- start start 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb6742790 con 0x55dbb69c8d30 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33444/0 (socket says 172.21.15.123:33444) 2024-03-20T13:38:05.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 -- 172.21.15.123:0/3421062763 learned_addr learned my addr 172.21.15.123:0/3421062763 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 -- 172.21.15.123:0/3421062763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb69c9720 con 0x55dbb69c8d30 2024-03-20T13:38:05.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 --2- 172.21.15.123:0/3421062763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69c9150 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5440048920 tx=0x7f5440021830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d911b102d0818e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f532a7fc640 1 -- 172.21.15.123:0/3421062763 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5440047070 con 0x55dbb69c8d30 2024-03-20T13:38:05.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f532a7fc640 1 -- 172.21.15.123:0/3421062763 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440039120 con 0x55dbb69c8d30 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f532a7fc640 1 -- 172.21.15.123:0/3421062763 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5440016330 con 0x55dbb69c8d30 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- 172.21.15.123:0/3421062763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 msgr2=0x55dbb69c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 --2- 172.21.15.123:0/3421062763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69c9150 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5440048920 tx=0x7f5440021830 comp rx=0 tx=0).stop 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- 172.21.15.123:0/3421062763 shutdown_connections 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 --2- 172.21.15.123:0/3421062763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69c9150 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- 172.21.15.123:0/3421062763 >> 172.21.15.123:0/3421062763 conn(0x55dbb69c5020 msgr2=0x55dbb69c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- 172.21.15.123:0/3421062763 shutdown_connections 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- 172.21.15.123:0/3421062763 wait complete. 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 Processor -- start 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- start start 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5448f3d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbb69d0070 con 0x55dbb69c8d30 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33446/0 (socket says 172.21.15.123:33446) 2024-03-20T13:38:05.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 learned_addr learned my addr 172.21.15.123:0/421680851 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:05.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbb69bd430 con 0x55dbb69c8d30 2024-03-20T13:38:05.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5447259640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69cfb30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5440048880 tx=0x7f54400488b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5328ff9640 1 -- 172.21.15.123:0/421680851 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5440048a60 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.246+0000 7f5328ff9640 1 -- 172.21.15.123:0/421680851 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440048bc0 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbb69d0270 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5328ff9640 1 -- 172.21.15.123:0/421680851 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5440048e80 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbb69d0700 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5328ff9640 1 -- 172.21.15.123:0/421680851 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5440021a30 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5328ff9640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5310034260 0x7f5310036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5328ff9640 1 -- 172.21.15.123:0/421680851 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f5440037d70 con 0x55dbb69c8d30 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446a58640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5310034260 0x7f5310036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69db290 0x55dbb69dd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ddea0 con 0x55dbb69db290 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446257640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69db290 0x55dbb69dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446a58640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5310034260 0x7f5310036720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55dbb69a2290 tx=0x7f5438038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446257640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69db290 0x55dbb69dd750 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 realm 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69de290 con 0x55dbb69db290 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69deae0 con 0x55dbb69db290 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69df4c0 0x55dbb69e1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e2080 con 0x55dbb69df4c0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5447259640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69df4c0 0x55dbb69e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.250+0000 7f5447259640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69df4c0 0x55dbb69e1910 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f544001f070 con 0x55dbb69df4c0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e2880 con 0x55dbb69df4c0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f544001f070 con 0x55dbb69df4c0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 20 searching for the correct realm 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dbb69e48e0 0x55dbb69e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446a58640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dbb69e48e0 0x55dbb69e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446a58640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dbb69e48e0 0x55dbb69e6da0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544001f070 con 0x55dbb69df4c0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5447259640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5440036070 0x7f544003da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x7f5440036070 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5440036070 0x7f544003da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5440036070 0x7f544003da30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x7f5440036070 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.254+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544001f070 con 0x55dbb69df4c0 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544001f070 con 0x55dbb69df4c0 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x7f5440036070 2024-03-20T13:38:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x7f5440036070 2024-03-20T13:38:05.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x7f5440036070 2024-03-20T13:38:05.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f543c0b0020 con 0x7f5440036070 2024-03-20T13:38:05.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.258+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0b0020 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x7f5440036070 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x7f5440036070 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x7f5440036070 2024-03-20T13:38:05.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.262+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69e48e0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7470 con 0x55dbb69df4c0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e31a0 con 0x55dbb69db290 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e3550 con 0x55dbb69df4c0 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e3930 con 0x55dbb69db290 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 zone default found 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 4 Realm: () 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 zonegroup default 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e7d50 con 0x7f5440036070 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e79a0 con 0x55dbb69e48e0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.266+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ea000 con 0x55dbb69e48e0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 20 started sync module instance, tier type = 2024-03-20T13:38:05.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:05.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e9500 con 0x55dbb69df4c0 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402150045872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69e9500 con 0x55dbb69df4c0 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69eaa90 con 0x55dbb69db290 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94402150049168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69eaa50 con 0x55dbb69db290 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.270+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69eb990 con 0x55dbb69df4c0 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94402150045872] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94402150049168] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94402150053040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69eb990 con 0x55dbb69df4c0 2024-03-20T13:38:05.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69eafb0 con 0x7f5440036070 2024-03-20T13:38:05.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94402150055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69eb990 con 0x7f5440036070 2024-03-20T13:38:05.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.274+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ecce0 con 0x55dbb69df4c0 2024-03-20T13:38:05.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94402150055280] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94402150053040] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94402150043744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ecce0 con 0x55dbb69df4c0 2024-03-20T13:38:05.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ed0d0 con 0x55dbb69e48e0 2024-03-20T13:38:05.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94402150057936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ed090 con 0x55dbb69e48e0 2024-03-20T13:38:05.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69edf70 con 0x55dbb69e48e0 2024-03-20T13:38:05.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94402150043744] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94402150062736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69edf70 con 0x55dbb69e48e0 2024-03-20T13:38:05.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.278+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ee930 con 0x7f5440036070 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94402150057936] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94402150061184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ee930 con 0x7f5440036070 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=0 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=1 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=2 2024-03-20T13:38:05.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=3 2024-03-20T13:38:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=4 2024-03-20T13:38:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=5 2024-03-20T13:38:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94402150062736] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=6 2024-03-20T13:38:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94402150061184] v34'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 20 add_watcher() i=7 2024-03-20T13:38:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ee930 con 0x55dbb69db290 2024-03-20T13:38:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.282+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94402150065296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69ee8b0 con 0x55dbb69db290 2024-03-20T13:38:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94402150065296] v34'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f52fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f5448f3d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f5448f3d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:05.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f9f70 con 0x55dbb69df4c0 2024-03-20T13:38:05.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.286+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fa430 con 0x7f5440036070 2024-03-20T13:38:05.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.290+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.290+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fa430 con 0x55dbb69e48e0 2024-03-20T13:38:05.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.290+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.290+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fa960 con 0x55dbb69db290 2024-03-20T13:38:05.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.290+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.290+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fae90 con 0x55dbb69df4c0 2024-03-20T13:38:05.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.294+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'72 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.294+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fb3c0 con 0x55dbb69e48e0 2024-03-20T13:38:05.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.294+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.294+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fb8f0 con 0x55dbb69df4c0 2024-03-20T13:38:05.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.298+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.298+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fbe20 con 0x55dbb69db290 2024-03-20T13:38:05.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.298+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.298+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fc350 con 0x55dbb69df4c0 2024-03-20T13:38:05.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.298+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.298+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fc7f0 con 0x55dbb69df4c0 2024-03-20T13:38:05.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.302+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.302+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fbe20 con 0x55dbb69df4c0 2024-03-20T13:38:05.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.302+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'73 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.306+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69fc7f0 con 0x55dbb69e48e0 2024-03-20T13:38:05.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.306+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.306+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69df4c0 2024-03-20T13:38:05.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.306+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.306+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f9570 con 0x55dbb69db290 2024-03-20T13:38:05.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.306+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.310+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f9570 con 0x55dbb69db290 2024-03-20T13:38:05.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.310+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.310+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f9570 con 0x55dbb69df4c0 2024-03-20T13:38:05.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.310+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.310+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8df0 con 0x55dbb69df4c0 2024-03-20T13:38:05.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.314+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'74 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.314+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8df0 con 0x55dbb69e48e0 2024-03-20T13:38:05.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.314+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.314+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8df0 con 0x55dbb69df4c0 2024-03-20T13:38:05.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.318+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.318+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8df0 con 0x55dbb69db290 2024-03-20T13:38:05.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.322+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.322+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69df4c0 2024-03-20T13:38:05.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.322+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.322+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69df4c0 2024-03-20T13:38:05.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.326+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.326+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69e48e0 2024-03-20T13:38:05.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.326+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.326+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69df4c0 2024-03-20T13:38:05.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.326+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.326+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69e48e0 2024-03-20T13:38:05.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.330+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.330+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69e48e0 2024-03-20T13:38:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.330+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.330+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69e48e0 2024-03-20T13:38:05.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.330+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.330+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69df4c0 2024-03-20T13:38:05.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.334+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.334+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69db290 2024-03-20T13:38:05.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.334+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.334+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69df4c0 2024-03-20T13:38:05.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.338+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.338+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x55dbb69db290 2024-03-20T13:38:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.338+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.338+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8fc0 con 0x7f5440036070 2024-03-20T13:38:05.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.338+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5277fff640 20 reqs_thread_entry: start 2024-03-20T13:38:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:05.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 20 Filter name: none 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5275ffb640 20 reqs_thread_entry: start 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f7b70 con 0x7f5440036070 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:05.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f77c0 con 0x55dbb69db290 2024-03-20T13:38:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 : miss 2024-03-20T13:38:05.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:96 8.1d 8:bb27f4f9:root::.bucket.meta.myfoo7%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8f00 con 0x55dbb69db290 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=355 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 info.flags=0x17 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 to cache LRU end 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 2024-03-20T13:38:05.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 4.32 4:4dfeac01:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96760 con 0x55dbb69df4c0 2024-03-20T13:38:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(97 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:98 4.3c 4:3d3bd13f:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a967a0 con 0x55dbb69db290 2024-03-20T13:38:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(98 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0d5060 con 0x55dbb69db290 2024-03-20T13:38:05.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.342+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:99 4.10 4:0a669813:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a967a0 con 0x55dbb69e48e0 2024-03-20T13:38:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(99 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:100 4.14 4:28c5e3ed:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x55dbb69e48e0 2024-03-20T13:38:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(100 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:101 4.b 4:d3eb714c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x7f5440036070 2024-03-20T13:38:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(101 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 4.13 4:ca333705:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x7f5440036070 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(102 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 [call out=378b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+378 (crc 0 0 0) 0x7f543c0d5060 con 0x7f5440036070 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 10 cls_bucket_list_unordered: got fourteen 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:103 4.c 4:314b39b1:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(103 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:104 4.10 4:090c590b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x55dbb69e48e0 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(104 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 4.f 4:f1e4ae75:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(105 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:106 4.27 4:e71a1a04:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(106 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:107 4.7 4:e162e593:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a96ca0 con 0x55dbb69db290 2024-03-20T13:38:05.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(107 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 20 get_obj_state: octx=0x7f543c0aab50 obj=myfoo7:fourteen state=0x55dbb6a1a138 s->prefetch_data=0 2024-03-20T13:38:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:108 3.23s0 3:c67f0fc0:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1af40 con 0x7f5440036070 2024-03-20T13:38:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(108 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 239+0+874 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 10 manifest: total_size = 8 2024-03-20T13:38:05.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.14392223863104176571 2024-03-20T13:38:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 20 get_obj_state: octx=0x7f543c0aab50 obj=myfoo7:fourteen state=0x55dbb6a1a138 s->prefetch_data=0 2024-03-20T13:38:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 20 prepare_atomic_modification: state is not atomic. state=0x55dbb6a1a138 2024-03-20T13:38:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 2024-03-20T13:38:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.346+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:109 4.13 4:ca333705:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1f7f0 con 0x7f5440036070 2024-03-20T13:38:05.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.350+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(109 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 [stat,call,call] v34'9 uv9 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.350+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:110 3.23s0 3:c67f0fc0:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1d7d0 con 0x7f5440036070 2024-03-20T13:38:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(110 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10_fourteen [call] v34'4 uv4 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:111 4.13 4:ca333705:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1fd90 con 0x7f5440036070 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 20 list_objects_ordered: starting attempt 1 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:112 4.32 4:4dfeac01:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69df4c0 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:113 4.3c 4:3d3bd13f:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a23f10 con 0x55dbb69db290 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:114 4.10 4:0a669813:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69e48e0 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:115 4.14 4:28c5e3ed:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a23f10 con 0x55dbb69e48e0 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:116 4.b 4:d3eb714c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a2b2c0 con 0x7f5440036070 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:117 4.13 4:ca333705:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a2dc60 con 0x7f5440036070 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:118 4.c 4:314b39b1:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a30640 con 0x55dbb69db290 2024-03-20T13:38:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:119 4.10 4:090c590b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a33010 con 0x55dbb69e48e0 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:120 4.f 4:f1e4ae75:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a35a10 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:121 4.27 4:e71a1a04:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a38820 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:122 4.7 4:e162e593:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a3b1c0 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(114 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(115 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(112 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(119 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(113 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(118 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(120 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(116 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== osd_op_reply(121 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(122 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(111 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 [stat,call,call] v34'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f532a7fc640 20 handle_completion(): completion ok for obj=fourteen 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 22 ==== osd_op_reply(117 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10])"; uploads.size()=0; is_truncated=0 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:123 4.32 4:4dfeac01:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69df4c0 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:124 4.3c 4:3d3bd13f:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a33010 con 0x55dbb69db290 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:125 4.10 4:0a669813:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a22a60 con 0x55dbb69e48e0 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:126 4.14 4:28c5e3ed:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69e48e0 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:127 4.b 4:d3eb714c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a33010 con 0x7f5440036070 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:128 4.13 4:ca333705:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a22a60 con 0x7f5440036070 2024-03-20T13:38:05.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:129 4.c 4:314b39b1:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:130 4.10 4:090c590b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a33010 con 0x55dbb69e48e0 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:131 4.f 4:f1e4ae75:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:132 4.27 4:e71a1a04:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a22a60 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== osd_op_reply(124 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:133 4.7 4:e162e593:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a30a90 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(125 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(126 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== osd_op_reply(129 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(130 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(123 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 23 ==== osd_op_reply(127 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 24 ==== osd_op_reply(128 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(131 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.354+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(132 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== osd_op_reply(133 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21660 con 0x55dbb69db290 2024-03-20T13:38:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(134 fud.buckets [call] v34'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-03-20T13:38:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a33010 con 0x7f5440036070 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 25 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 20 rados_obj.operate() r=0 bl.length=168 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94402150270544 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20a70 con 0x7f5440036070 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 26 ==== watch-notify(notify (1) cookie 94402150055280 notify 146028888081 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7f543c0e8040 con 0x7f5440036070 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f532a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94402150055280 notifier 4759 bl.length()=150 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 27 ==== osd_op_reply(136 notify.3 [notify cookie 94402150270544 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f532a7fc640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f530c003d60 con 0x7f5440036070 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 28 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 29 ==== watch-notify(notify_complete (2) cookie 94402150270544 notify 146028888081 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f543c0e0000 con 0x7f5440036070 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20650 con 0x7f5440036070 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 30 ==== osd_op_reply(138 myfoo7 [call,call,delete] v34'47 uv47 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 from cache 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10, ofs0, ns] 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.358+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [notify cookie 94402150270544 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20e20 con 0x55dbb69e48e0 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== watch-notify(notify (1) cookie 94402150057936 notify 146028888087 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7f543805c040 con 0x55dbb69e48e0 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94402150057936 notifier 4759 bl.length()=208 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5329ffb640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f527c0032c0 con 0x55dbb69e48e0 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(139 notify.5 [notify cookie 94402150270544 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(140 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== watch-notify(notify_complete (2) cookie 94402150270544 notify 146028888087 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dbb69a1f20 con 0x55dbb69e48e0 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:141 8.1d 8:bb27f4f9:root::.bucket.meta.myfoo7%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1a570 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(141 .bucket.meta.myfoo7:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 [call,call,delete] v34'2 uv2 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:142 4.32 4:4dfeac01:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20e20 con 0x55dbb69df4c0 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:143 4.3c 4:3d3bd13f:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21620 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:144 4.10 4:0a669813:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a18960 con 0x55dbb69e48e0 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:145 4.14 4:28c5e3ed:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a19560 con 0x55dbb69e48e0 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:146 4.b 4:d3eb714c:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20e20 con 0x7f5440036070 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:147 4.13 4:ca333705:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21620 con 0x7f5440036070 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:148 4.c 4:314b39b1:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a30e50 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:149 4.10 4:090c590b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a18960 con 0x55dbb69e48e0 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:150 4.f 4:f1e4ae75:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20e20 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:151 4.27 4:e71a1a04:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a21620 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.362+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:152 4.7 4:e162e593:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a19560 con 0x55dbb69db290 2024-03-20T13:38:05.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(142 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.0 [delete] v34'5 uv5 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(143 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.1 [delete] v34'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(144 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.2 [delete] v34'5 uv5 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(148 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.6 [delete] v34'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(150 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.8 [delete] v34'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 49 ==== osd_op_reply(152 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.10 [delete] v34'8 uv8 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(145 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.3 [delete] v34'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(149 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.7 [delete] v34'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 50 ==== osd_op_reply(151 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.9 [delete] v34'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 31 ==== osd_op_reply(147 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.5 [delete] v34'11 uv11 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 32 ==== osd_op_reply(146 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10.4 [delete] v34'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 : miss 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:153 6.6 6:638d37c5:::pubsub..bucket.myfoo7%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20e20 con 0x55dbb69e48e0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== osd_op_reply(153 pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 info.flags=0x0 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 10 adding default.rgw.log++pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 to cache LRU end 2024-03-20T13:38:05.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 10 removing default.rgw.log++pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 from cache 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10, ofs0, ns] 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:154 7.15 7:a93a5511:::notify.2:head [notify cookie 94402150270544 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1a570 con 0x55dbb69df4c0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== watch-notify(notify (1) cookie 94402150053040 notify 146028888105 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x7f5440068040 con 0x55dbb69df4c0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f532a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94402150053040 notifier 4759 bl.length()=205 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f532a7fc640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:155 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f530c003d60 con 0x55dbb69df4c0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(154 notify.2 [notify cookie 94402150270544 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(155 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== watch-notify(notify_complete (2) cookie 94402150270544 notify 146028888105 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dbb69d0700 con 0x55dbb69df4c0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.366+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:156 6.6 6:638d37c5:::pubsub..bucket.myfoo7%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20e20 con 0x55dbb69e48e0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(156 pubsub..bucket.myfoo7/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.10 [delete] v34'13 uv12 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1a570 con 0x55dbb69db290 2024-03-20T13:38:05.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 51 ==== osd_op_reply(157 fud.buckets [call] v34'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5448f3d980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5448f3d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94402150270544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a1a570 con 0x55dbb69df4c0 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== watch-notify(notify (1) cookie 94402150053040 notify 146028888106 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55dbb69d0700 con 0x55dbb69df4c0 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94402150053040 notifier 4759 bl.length()=170 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5329ffb640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f527c0032a0 con 0x55dbb69df4c0 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(158 notify.2 [notify cookie 94402150270544 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== watch-notify(notify_complete (2) cookie 94402150270544 notify 146028888106 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dbb69d0270 con 0x55dbb69df4c0 2024-03-20T13:38:05.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.370+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb69f8070 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v34'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 10 removing email index: 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 10 removing user buckets index 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94402150270544 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== watch-notify(notify (1) cookie 94402150062736 notify 146028888088 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55dbb69a1f20 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 42 ==== osd_op_reply(161 notify.6 [notify cookie 94402150270544 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94402150062736 notifier 4759 bl.length()=160 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5329ffb640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f527c0032a0 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 43 ==== watch-notify(notify_complete (2) cookie 94402150270544 notify 146028888088 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dbb69a1af0 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 44 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69db290 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 52 ==== osd_op_reply(163 fud.buckets [delete] v34'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 10 removing user index: fud 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 10 removing default.rgw.meta+users.uid+fud from cache 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94402150270544 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69e48e0 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 45 ==== watch-notify(notify (1) cookie 94402150057936 notify 146028888089 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55dbb69a1af0 con 0x55dbb69e48e0 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94402150057936 notifier 4759 bl.length()=152 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 46 ==== osd_op_reply(164 notify.5 [notify cookie 94402150270544 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5329ffb640 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f527c0032a0 con 0x55dbb69e48e0 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 47 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.374+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 48 ==== watch-notify(notify_complete (2) cookie 94402150270544 notify 146028888089 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dbb67f64c0 con 0x55dbb69e48e0 2024-03-20T13:38:05.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.378+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x7f5440036070 2024-03-20T13:38:05.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.378+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 33 ==== osd_op_reply(166 fud [call,call,delete] v34'9 uv9 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.378+0000 7f52fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:05.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.378+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94402150065296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69db290 2024-03-20T13:38:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.382+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 53 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94402150065296] v34'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.382+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94402150045872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69df4c0 2024-03-20T13:38:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.382+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94402150045872] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.382+0000 7f5448f3d980 20 remove_watcher() i=0 2024-03-20T13:38:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.382+0000 7f5448f3d980 2 removed watcher, disabling cache 2024-03-20T13:38:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.382+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94402150049168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69db290 2024-03-20T13:38:05.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.1 v2:172.21.15.123:6800/3706732118 54 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94402150049168] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x55dbb69db290 2024-03-20T13:38:05.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5448f3d980 20 remove_watcher() i=1 2024-03-20T13:38:05.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94402150053040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69df4c0 2024-03-20T13:38:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94402150053040] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5448f3d980 20 remove_watcher() i=2 2024-03-20T13:38:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94402150055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x7f5440036070 2024-03-20T13:38:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 34 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94402150055280] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5448f3d980 20 remove_watcher() i=3 2024-03-20T13:38:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.386+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94402150043744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69df4c0 2024-03-20T13:38:05.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.390+0000 7f5447259640 1 -- 172.21.15.123:0/421680851 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94402150043744] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f544005f040 con 0x55dbb69df4c0 2024-03-20T13:38:05.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.390+0000 7f5448f3d980 20 remove_watcher() i=4 2024-03-20T13:38:05.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.390+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94402150057936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69e48e0 2024-03-20T13:38:05.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.390+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 49 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94402150057936] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.390+0000 7f5448f3d980 20 remove_watcher() i=5 2024-03-20T13:38:05.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.390+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94402150062736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x55dbb69e48e0 2024-03-20T13:38:05.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5446a58640 1 -- 172.21.15.123:0/421680851 <== osd.3 v2:172.21.15.123:6816/3519650013 50 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94402150062736] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5438023070 con 0x55dbb69e48e0 2024-03-20T13:38:05.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 20 remove_watcher() i=6 2024-03-20T13:38:05.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94402150061184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55dbb6a20100 con 0x7f5440036070 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 <== osd.2 v2:172.21.15.123:6803/1251286685 35 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94402150061184] v34'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f543c0e1040 con 0x7f5440036070 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 20 remove_watcher() i=7 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69df4c0 msgr2=0x55dbb69e1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69df4c0 0x55dbb69e1910 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69db290 msgr2=0x55dbb69dd750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69db290 0x55dbb69dd750 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5440036070 msgr2=0x7f544003da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5440036070 0x7f544003da30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dbb69e48e0 msgr2=0x55dbb69e6da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55dbb69e48e0 0x55dbb69e6da0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5310034260 msgr2=0x7f5310036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5310034260 0x7f5310036720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55dbb69a2290 tx=0x7f5438038000 comp rx=0 tx=0).stop 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5446257640 1 -- 172.21.15.123:0/421680851 reap_dead start 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 msgr2=0x55dbb69cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69cfb30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5440048880 tx=0x7f54400488b0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 shutdown_connections 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/421680851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69c8d30 0x55dbb69cfb30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 >> 172.21.15.123:0/421680851 conn(0x55dbb69c5020 msgr2=0x55dbb69c26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 shutdown_connections 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/421680851 wait complete. 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5320034300 msgr2=0x7f53200367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5320034300 0x7f53200367c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55dbb69ac370 tx=0x7f5438031040 comp rx=0 tx=0).stop 2024-03-20T13:38:05.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 msgr2=0x55dbb69bc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 0x55dbb69bc150 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55dbb69a2200 tx=0x7f544000af40 comp rx=0 tx=0).stop 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 shutdown_connections 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f5320034300 0x7f53200367c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 --2- 172.21.15.123:0/1875878463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb69bbd30 0x55dbb69bc150 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 >> 172.21.15.123:0/1875878463 conn(0x55dbb69b0b40 msgr2=0x55dbb69b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 shutdown_connections 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.394+0000 7f5448f3d980 1 -- 172.21.15.123:0/1875878463 wait complete. 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69a9370 msgr2=0x55dbb69ab760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69a9370 0x55dbb69ab760 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69a61d0 msgr2=0x55dbb69a85c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69a61d0 0x55dbb69a85c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f532c0342b0 msgr2=0x7f532c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f532c0342b0 0x7f532c036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f543c0ae000 tx=0x7f543c0a6000 comp rx=0 tx=0).stop 2024-03-20T13:38:05.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 msgr2=0x55dbb69a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb69a15b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5438003000 tx=0x7f5438000f50 comp rx=0 tx=0).stop 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 shutdown_connections 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55dbb69a9370 0x55dbb69ab760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55dbb69a61d0 0x55dbb69a85c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f532c0342b0 0x7f532c036770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 --2- 172.21.15.123:0/2744700460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dbb6823080 0x55dbb69a15b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 >> 172.21.15.123:0/2744700460 conn(0x55dbb681f860 msgr2=0x55dbb6994b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 shutdown_connections 2024-03-20T13:38:05.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:05.398+0000 7f5448f3d980 1 -- 172.21.15.123:0/2744700460 wait complete. 2024-03-20T13:38:10.413 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-03-20T13:38:10.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-03-20T13:38:10.413 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-03-20T13:38:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d806d980 1 Processor -- start 2024-03-20T13:38:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d806d980 1 -- start start 2024-03-20T13:38:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d806d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562d90cab070 0x562d90d39bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d806d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562d90c83520 con 0x562d90d3a130 2024-03-20T13:38:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d806d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x562d90c4a0f0 con 0x562d90cab070 2024-03-20T13:38:10.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d5b88640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562d90cab070 0x562d90d39bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d5b88640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562d90cab070 0x562d90d39bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33456/0 (socket says 172.21.15.123:33456) 2024-03-20T13:38:10.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8cd387640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x562d90d3a130 0x562d90d3c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59328/0 (socket says 172.21.15.123:59328) 2024-03-20T13:38:10.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d5b88640 1 -- 172.21.15.123:0/2551115229 learned_addr learned my addr 172.21.15.123:0/2551115229 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d5b88640 1 -- 172.21.15.123:0/2551115229 >> v1:172.21.15.89:6789/0 conn(0x562d90d3a130 legacy=0x562d90d3c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.450+0000 7fa8d5b88640 1 -- 172.21.15.123:0/2551115229 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d90d3ece0 con 0x562d90cab070 2024-03-20T13:38:10.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/2551115229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90d39bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800a5c0 tx=0x7fa8c801b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2a334c9276bcf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d5387640 1 -- 172.21.15.123:0/2551115229 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8c80aa530 con 0x562d90cab070 2024-03-20T13:38:10.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d5387640 1 -- 172.21.15.123:0/2551115229 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80a6050 con 0x562d90cab070 2024-03-20T13:38:10.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d5387640 1 -- 172.21.15.123:0/2551115229 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8c80aa7e0 con 0x562d90cab070 2024-03-20T13:38:10.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 -- 172.21.15.123:0/2551115229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 msgr2=0x562d90d39bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 --2- 172.21.15.123:0/2551115229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90d39bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800a5c0 tx=0x7fa8c801b1d0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 -- 172.21.15.123:0/2551115229 shutdown_connections 2024-03-20T13:38:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 --2- 172.21.15.123:0/2551115229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90d39bf0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 -- 172.21.15.123:0/2551115229 >> 172.21.15.123:0/2551115229 conn(0x562d90d316d0 msgr2=0x562d90d33af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 -- 172.21.15.123:0/2551115229 shutdown_connections 2024-03-20T13:38:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.454+0000 7fa8d806d980 1 -- 172.21.15.123:0/2551115229 wait complete. 2024-03-20T13:38:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d806d980 1 Processor -- start 2024-03-20T13:38:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d806d980 1 -- start start 2024-03-20T13:38:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d806d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e20ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d806d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d90c47620 con 0x562d90cab070 2024-03-20T13:38:10.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d5b88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e20ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d5b88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e20ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33466/0 (socket says 172.21.15.123:33466) 2024-03-20T13:38:10.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d5b88640 1 -- 172.21.15.123:0/4043571895 learned_addr learned my addr 172.21.15.123:0/4043571895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d5b88640 1 -- 172.21.15.123:0/4043571895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8005df0 con 0x562d90cab070 2024-03-20T13:38:10.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/4043571895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e20ef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8017de0 tx=0x7fa8c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c815bf317722f689 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa7c3e07640 1 -- 172.21.15.123:0/4043571895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8c80aa640 con 0x562d90cab070 2024-03-20T13:38:10.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa7c3e07640 1 -- 172.21.15.123:0/4043571895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80aa7c0 con 0x562d90cab070 2024-03-20T13:38:10.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa7c3e07640 1 -- 172.21.15.123:0/4043571895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8c80aaaa0 con 0x562d90cab070 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d806d980 1 -- 172.21.15.123:0/4043571895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 msgr2=0x562d90e20ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.470+0000 7fa8d806d980 1 --2- 172.21.15.123:0/4043571895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e20ef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8017de0 tx=0x7fa8c8003030 comp rx=0 tx=0).stop 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/4043571895 shutdown_connections 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 --2- 172.21.15.123:0/4043571895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e20ef0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/4043571895 >> 172.21.15.123:0/4043571895 conn(0x562d90d316d0 msgr2=0x562d90e1ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/4043571895 shutdown_connections 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/4043571895 wait complete. 2024-03-20T13:38:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 Processor -- start 2024-03-20T13:38:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- start start 2024-03-20T13:38:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e27c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d90c42e00 con 0x562d90cab070 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d5b88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e27c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d5b88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e27c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33470/0 (socket says 172.21.15.123:33470) 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d5b88640 1 -- 172.21.15.123:0/967593665 learned_addr learned my addr 172.21.15.123:0/967593665 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d5b88640 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d90d3ece0 con 0x562d90cab070 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e27c80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa8c801b210 tx=0x7fa8c8017f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa7c2604640 1 -- 172.21.15.123:0/967593665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8c80b4980 con 0x562d90cab070 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa7c2604640 1 -- 172.21.15.123:0/967593665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80b4ae0 con 0x562d90cab070 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d90e281c0 con 0x562d90cab070 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa7c2604640 1 -- 172.21.15.123:0/967593665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8c80b4dc0 con 0x562d90cab070 2024-03-20T13:38:10.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d90e28650 con 0x562d90cab070 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa7c2604640 1 -- 172.21.15.123:0/967593665 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa8c80c4020 con 0x562d90cab070 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa7c2604640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7bc0342b0 0x7fa7bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa7c2604640 1 -- 172.21.15.123:0/967593665 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa8c80e3d30 con 0x562d90cab070 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8cd387640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7bc0342b0 0x7fa7bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90d3a130 0x562d90e2e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.474+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e2edf0 con 0x562d90d3a130 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d6389640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90d3a130 0x562d90e2e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8cd387640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7bc0342b0 0x7fa7bc036770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000b350 tx=0x7fa8c0001530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d6389640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90d3a130 0x562d90e2e8b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d6389640 1 -- 172.21.15.123:0/967593665 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8d000a4d0 con 0x562d90d3a130 2024-03-20T13:38:10.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e2f660 0x562d90e31a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e32120 con 0x562d90e2f660 2024-03-20T13:38:10.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e2f660 0x562d90e31a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e2f660 0x562d90e31a50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d5b88640 1 -- 172.21.15.123:0/967593665 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e2f660 2024-03-20T13:38:10.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e33980 con 0x562d90e2f660 2024-03-20T13:38:10.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d5b88640 1 -- 172.21.15.123:0/967593665 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e2f660 2024-03-20T13:38:10.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.478+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e32b80 con 0x562d90e2f660 2024-03-20T13:38:10.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d5b88640 1 -- 172.21.15.123:0/967593665 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e2f660 2024-03-20T13:38:10.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e32f90 con 0x562d90d3a130 2024-03-20T13:38:10.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d6389640 1 -- 172.21.15.123:0/967593665 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa8d000a4d0 con 0x562d90d3a130 2024-03-20T13:38:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 Processor -- start 2024-03-20T13:38:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 -- start start 2024-03-20T13:38:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 0x562d90e42550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d90bdbe30 con 0x562d90e42130 2024-03-20T13:38:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d6389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 0x562d90e42550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d6389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 0x562d90e42550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33480/0 (socket says 172.21.15.123:33480) 2024-03-20T13:38:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d6389640 1 -- 172.21.15.123:0/1041502519 learned_addr learned my addr 172.21.15.123:0/1041502519 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d6389640 1 -- 172.21.15.123:0/1041502519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d90e42a90 con 0x562d90e42130 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d6389640 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 0x562d90e42550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0016cf0 tx=0x7fa8d000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa7bb7fe640 1 -- 172.21.15.123:0/1041502519 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8d0017660 con 0x562d90e42130 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa7bb7fe640 1 -- 172.21.15.123:0/1041502519 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d00177c0 con 0x562d90e42130 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d90e42ce0 con 0x562d90e42130 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa7bb7fe640 1 -- 172.21.15.123:0/1041502519 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8d0017a60 con 0x562d90e42130 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.482+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d90e43830 con 0x562d90e42130 2024-03-20T13:38:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa7bb7fe640 1 -- 172.21.15.123:0/1041502519 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa8d001d020 con 0x562d90e42130 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa7bb7fe640 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7b00342b0 0x7fa7b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa7bb7fe640 1 -- 172.21.15.123:0/1041502519 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa8d004b250 con 0x562d90e42130 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7b00342b0 0x7fa7b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 Processor -- start 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- start start 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7b00342b0 0x7fa7b0036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x562d90e325c0 tx=0x7fa8c80c5f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90d375c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d90bcf790 con 0x562d90d371a0 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d6389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90d375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d6389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90d375c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33496/0 (socket says 172.21.15.123:33496) 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d6389640 1 -- 172.21.15.123:0/2462511910 learned_addr learned my addr 172.21.15.123:0/2462511910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d6389640 1 -- 172.21.15.123:0/2462511910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d90d359d0 con 0x562d90d371a0 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d6389640 1 --2- 172.21.15.123:0/2462511910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90d375c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00495a0 tx=0x7fa8d0014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c17426185b17326 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa7b97fa640 1 -- 172.21.15.123:0/2462511910 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8d003b070 con 0x562d90d371a0 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa7b97fa640 1 -- 172.21.15.123:0/2462511910 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d00481d0 con 0x562d90d371a0 2024-03-20T13:38:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa7b97fa640 1 -- 172.21.15.123:0/2462511910 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8d003b300 con 0x562d90d371a0 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- 172.21.15.123:0/2462511910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 msgr2=0x562d90d375c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 --2- 172.21.15.123:0/2462511910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90d375c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00495a0 tx=0x7fa8d0014740 comp rx=0 tx=0).stop 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- 172.21.15.123:0/2462511910 shutdown_connections 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 --2- 172.21.15.123:0/2462511910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90d375c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- 172.21.15.123:0/2462511910 >> 172.21.15.123:0/2462511910 conn(0x562d90e4b3e0 msgr2=0x562d90e49440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- 172.21.15.123:0/2462511910 shutdown_connections 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- 172.21.15.123:0/2462511910 wait complete. 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 Processor -- start 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- start start 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90e58160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.486+0000 7fa8d806d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d90e586a0 con 0x562d90d371a0 2024-03-20T13:38:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d6389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90e58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d6389640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90e58160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33506/0 (socket says 172.21.15.123:33506) 2024-03-20T13:38:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 learned_addr learned my addr 172.21.15.123:0/3406300239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d90e43830 con 0x562d90d371a0 2024-03-20T13:38:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d6389640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90e58160 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00287f0 tx=0x7fa8d0049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa7a77fe640 1 -- 172.21.15.123:0/3406300239 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8d001fbe0 con 0x562d90d371a0 2024-03-20T13:38:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa7a77fe640 1 -- 172.21.15.123:0/3406300239 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d001fd40 con 0x562d90d371a0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d90e588a0 con 0x562d90d371a0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa7a77fe640 1 -- 172.21.15.123:0/3406300239 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8d00113d0 con 0x562d90d371a0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d90e58cd0 con 0x562d90d371a0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa7a77fe640 1 -- 172.21.15.123:0/3406300239 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa8d0011550 con 0x562d90d371a0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa7a77fe640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7a00342b0 0x7fa7a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa7a77fe640 1 -- 172.21.15.123:0/3406300239 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa8d0044020 con 0x562d90d371a0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7a00342b0 0x7fa7a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90e63850 0x562d90e65d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e66460 con 0x562d90e63850 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8cd387640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90e63850 0x562d90e65d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7a00342b0 0x7fa7a0036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80e4060 tx=0x7fa8c80df000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8cd387640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90e63850 0x562d90e65d10 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 20 realm 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.490+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e62cb0 con 0x562d90e63850 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e66ee0 con 0x562d90e63850 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e67c70 0x562d90e6a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6a6e0 con 0x562d90e67c70 2024-03-20T13:38:10.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d6389640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e67c70 0x562d90e6a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d6389640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e67c70 0x562d90e6a060 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:10.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6aee0 con 0x562d90e67c70 2024-03-20T13:38:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 20 searching for the correct realm 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562d90e6ce20 0x562d90e6f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e6ce20 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562d90e6ce20 0x562d90e6f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d5b88640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562d90e6ce20 0x562d90e6f2e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.494+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e67c70 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d6389640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa8d0038880 0x7fa8d0005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x7fa8d0038880 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa8d0038880 0x7fa8d0005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa8d0038880 0x7fa8d0005040 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e63850 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e63850 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e6ce20 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e63850 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e67c70 2024-03-20T13:38:10.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.498+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e67c70 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e63850 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x7fa8d0038880 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6f9b0 con 0x562d90e63850 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x7fa8d0038880 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e67c70 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e6ce20 2024-03-20T13:38:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e63850 2024-03-20T13:38:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e67c70 2024-03-20T13:38:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e6ce20 2024-03-20T13:38:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.502+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e6ce20 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x7fa8d0038880 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x7fa8d0038880 2024-03-20T13:38:10.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e6ce20 2024-03-20T13:38:10.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x7fa8d0038880 2024-03-20T13:38:10.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e67c70 2024-03-20T13:38:10.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.506+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e67c70 2024-03-20T13:38:10.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e6ce20 2024-03-20T13:38:10.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e67c70 2024-03-20T13:38:10.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa8c002d080 con 0x562d90e67c70 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6c380 con 0x562d90e63850 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6b790 con 0x562d90e67c70 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6bb70 con 0x562d90e63850 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 zone default found 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 4 Realm: () 2024-03-20T13:38:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 zonegroup default 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.510+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e6fdf0 con 0x7fa8d0038880 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e72020 con 0x562d90e6ce20 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e72380 con 0x562d90e6ce20 2024-03-20T13:38:10.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 started sync module instance, tier type = 2024-03-20T13:38:10.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:10.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e715f0 con 0x562d90e67c70 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753704581584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e715f0 con 0x562d90e67c70 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.514+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e72cf0 con 0x562d90e63850 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753704585296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e72c70 con 0x562d90e63850 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e73bf0 con 0x562d90e67c70 2024-03-20T13:38:10.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753704581584] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753704585296] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753704587424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e73bf0 con 0x562d90e67c70 2024-03-20T13:38:10.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.518+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e73850 con 0x7fa8d0038880 2024-03-20T13:38:10.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753704591264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e73850 con 0x7fa8d0038880 2024-03-20T13:38:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e74f00 con 0x562d90e67c70 2024-03-20T13:38:10.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753704587424] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753704591264] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753704592320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e74ec0 con 0x562d90e67c70 2024-03-20T13:38:10.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e752f0 con 0x562d90e6ce20 2024-03-20T13:38:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753704579408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e75b40 con 0x562d90e6ce20 2024-03-20T13:38:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.522+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e764f0 con 0x562d90e6ce20 2024-03-20T13:38:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753704592320] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753704579408] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753704593920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e756a0 con 0x562d90e6ce20 2024-03-20T13:38:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e76d40 con 0x7fa8d0038880 2024-03-20T13:38:10.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753704601760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e77160 con 0x7fa8d0038880 2024-03-20T13:38:10.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=0 2024-03-20T13:38:10.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=1 2024-03-20T13:38:10.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=2 2024-03-20T13:38:10.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=3 2024-03-20T13:38:10.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=4 2024-03-20T13:38:10.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=5 2024-03-20T13:38:10.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753704593920] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=6 2024-03-20T13:38:10.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753704601760] v34'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 20 add_watcher() i=7 2024-03-20T13:38:10.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.526+0000 7fa8d806d980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:10.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e7a190 con 0x562d90e63850 2024-03-20T13:38:10.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753704602816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e77580 con 0x562d90e63850 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753704602816] v34'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa7877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 5 note: GC not initialized 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa7867fc640 20 reqs_thread_entry: start 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 20 Filter name: none 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa6f7fff640 20 reqs_thread_entry: start 2024-03-20T13:38:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:38:10.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e9bdb0 con 0x562d90e63850 2024-03-20T13:38:10.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:38:10.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:38:10.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:38:10.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.530+0000 7fa8d806d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:10.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.534+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e9e2d0 con 0x562d90e6ce20 2024-03-20T13:38:10.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.534+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.534+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e9e2d0 con 0x562d90e6ce20 2024-03-20T13:38:10.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.534+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.534+0000 7fa7877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:10.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.534+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753704602816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e7c1b0 con 0x562d90e63850 2024-03-20T13:38:10.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.538+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94753704602816] v34'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.538+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753704581584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e7c1b0 con 0x562d90e67c70 2024-03-20T13:38:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.538+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94753704581584] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.538+0000 7fa8d806d980 20 remove_watcher() i=0 2024-03-20T13:38:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.538+0000 7fa8d806d980 2 removed watcher, disabling cache 2024-03-20T13:38:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.538+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753704585296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e719d0 con 0x562d90e63850 2024-03-20T13:38:10.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.542+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94753704585296] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x562d90e63850 2024-03-20T13:38:10.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.542+0000 7fa8d806d980 20 remove_watcher() i=1 2024-03-20T13:38:10.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.542+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753704587424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e719d0 con 0x562d90e67c70 2024-03-20T13:38:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.542+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94753704587424] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.542+0000 7fa8d806d980 20 remove_watcher() i=2 2024-03-20T13:38:10.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.542+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753704591264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e730a0 con 0x7fa8d0038880 2024-03-20T13:38:10.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94753704591264] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d806d980 20 remove_watcher() i=3 2024-03-20T13:38:10.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753704592320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e719d0 con 0x562d90e67c70 2024-03-20T13:38:10.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d6389640 1 -- 172.21.15.123:0/3406300239 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94753704592320] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8d0051040 con 0x562d90e67c70 2024-03-20T13:38:10.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d806d980 20 remove_watcher() i=4 2024-03-20T13:38:10.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753704579408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e730a0 con 0x562d90e6ce20 2024-03-20T13:38:10.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94753704579408] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d806d980 20 remove_watcher() i=5 2024-03-20T13:38:10.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.546+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753704593920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e719d0 con 0x562d90e6ce20 2024-03-20T13:38:10.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d5b88640 1 -- 172.21.15.123:0/3406300239 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94753704593920] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c80c6a30 con 0x562d90e6ce20 2024-03-20T13:38:10.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 20 remove_watcher() i=6 2024-03-20T13:38:10.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753704601760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x562d90e71150 con 0x7fa8d0038880 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94753704601760] v34'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8c000c040 con 0x7fa8d0038880 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 20 remove_watcher() i=7 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e67c70 msgr2=0x562d90e6a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e67c70 0x562d90e6a060 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90e63850 msgr2=0x562d90e65d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90e63850 0x562d90e65d10 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa8d0038880 msgr2=0x7fa8d0005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa8d0038880 0x7fa8d0005040 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562d90e6ce20 msgr2=0x562d90e6f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x562d90e6ce20 0x562d90e6f2e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7a00342b0 msgr2=0x7fa7a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7a00342b0 0x7fa7a0036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80e4060 tx=0x7fa8c80df000 comp rx=0 tx=0).stop 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8cd387640 1 -- 172.21.15.123:0/3406300239 reap_dead start 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 msgr2=0x562d90e58160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90e58160 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00287f0 tx=0x7fa8d0049530 comp rx=0 tx=0).stop 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 shutdown_connections 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/3406300239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90d371a0 0x562d90e58160 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 >> 172.21.15.123:0/3406300239 conn(0x562d90e4b3e0 msgr2=0x562d90e48a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 shutdown_connections 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/3406300239 wait complete. 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7b00342b0 msgr2=0x7fa7b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7b00342b0 0x7fa7b0036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x562d90e325c0 tx=0x7fa8c80c5f90 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 msgr2=0x562d90e42550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 0x562d90e42550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0016cf0 tx=0x7fa8d000d790 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 shutdown_connections 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7b00342b0 0x7fa7b0036770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 --2- 172.21.15.123:0/1041502519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90e42130 0x562d90e42550 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 >> 172.21.15.123:0/1041502519 conn(0x562d90e36f40 msgr2=0x562d90e37a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 shutdown_connections 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.550+0000 7fa8d806d980 1 -- 172.21.15.123:0/1041502519 wait complete. 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e2f660 msgr2=0x562d90e31a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e2f660 0x562d90e31a50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90d3a130 msgr2=0x562d90e2e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90d3a130 0x562d90e2e8b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7bc0342b0 msgr2=0x7fa7bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7bc0342b0 0x7fa7bc036770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000b350 tx=0x7fa8c0001530 comp rx=0 tx=0).stop 2024-03-20T13:38:10.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 msgr2=0x562d90e27c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e27c80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa8c801b210 tx=0x7fa8c8017f70 comp rx=0 tx=0).stop 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 shutdown_connections 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x562d90e2f660 0x562d90e31a50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x562d90d3a130 0x562d90e2e8b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa7bc0342b0 0x7fa7bc036770 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 --2- 172.21.15.123:0/967593665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d90cab070 0x562d90e27c80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 >> 172.21.15.123:0/967593665 conn(0x562d90d316d0 msgr2=0x562d90e1b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 shutdown_connections 2024-03-20T13:38:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.554+0000 7fa8d806d980 1 -- 172.21.15.123:0/967593665 wait complete. 2024-03-20T13:38:10.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-03-20T13:38:10.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-03-20T13:38:10.568 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-03-20T13:38:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa709b43980 1 Processor -- start 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa709b43980 1 -- start start 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa709b43980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563a9a6cbf40 0x563a9a6cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa709b43980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563a9a618520 con 0x563a9a6cc860 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa709b43980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a9a5df0f0 con 0x563a9a6cbf40 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa70765e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563a9a6cbf40 0x563a9a6cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa70765e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563a9a6cbf40 0x563a9a6cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33510/0 (socket says 172.21.15.123:33510) 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa70765e640 1 -- 172.21.15.123:0/493409514 learned_addr learned my addr 172.21.15.123:0/493409514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa706e5d640 1 --1- 172.21.15.123:0/493409514 >> v1:172.21.15.89:6789/0 conn(0x563a9a6cc860 0x563a9a6cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59332/0 (socket says 172.21.15.123:59332) 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa70765e640 1 -- 172.21.15.123:0/493409514 >> v1:172.21.15.89:6789/0 conn(0x563a9a6cc860 legacy=0x563a9a6cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa70765e640 1 -- 172.21.15.123:0/493409514 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9a6cda50 con 0x563a9a6cbf40 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.646+0000 7fa70765e640 1 --2- 172.21.15.123:0/493409514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a6cc320 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa70000a4e0 tx=0x7fa70001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dc7970e1e24598 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa70665c640 1 -- 172.21.15.123:0/493409514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7000aa540 con 0x563a9a6cbf40 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa70665c640 1 -- 172.21.15.123:0/493409514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7000a6070 con 0x563a9a6cbf40 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa70665c640 1 -- 172.21.15.123:0/493409514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7000aa850 con 0x563a9a6cbf40 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 -- 172.21.15.123:0/493409514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 msgr2=0x563a9a6cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 --2- 172.21.15.123:0/493409514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a6cc320 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa70000a4e0 tx=0x7fa70001b090 comp rx=0 tx=0).stop 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 -- 172.21.15.123:0/493409514 shutdown_connections 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 --2- 172.21.15.123:0/493409514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a6cc320 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 -- 172.21.15.123:0/493409514 >> 172.21.15.123:0/493409514 conn(0x563a9a6c7810 msgr2=0x563a9a6c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 -- 172.21.15.123:0/493409514 shutdown_connections 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.650+0000 7fa709b43980 1 -- 172.21.15.123:0/493409514 wait complete. 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 Processor -- start 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- start start 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a7b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9a5dc620 con 0x563a9a6cbf40 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa70765e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a7b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa70765e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a7b63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33512/0 (socket says 172.21.15.123:33512) 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa70765e640 1 -- 172.21.15.123:0/2196499645 learned_addr learned my addr 172.21.15.123:0/2196499645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa70765e640 1 -- 172.21.15.123:0/2196499645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70000a1c0 con 0x563a9a6cbf40 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa70765e640 1 --2- 172.21.15.123:0/2196499645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a7b63e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa700018cc0 tx=0x7fa7000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605ea6d5cabd254f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa5f560a640 1 -- 172.21.15.123:0/2196499645 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7000aa700 con 0x563a9a6cbf40 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa5f560a640 1 -- 172.21.15.123:0/2196499645 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7000aa860 con 0x563a9a6cbf40 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa5f560a640 1 -- 172.21.15.123:0/2196499645 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7000aab20 con 0x563a9a6cbf40 2024-03-20T13:38:10.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- 172.21.15.123:0/2196499645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 msgr2=0x563a9a7b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 --2- 172.21.15.123:0/2196499645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a7b63e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa700018cc0 tx=0x7fa7000033b0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- 172.21.15.123:0/2196499645 shutdown_connections 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 --2- 172.21.15.123:0/2196499645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a7b63e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- 172.21.15.123:0/2196499645 >> 172.21.15.123:0/2196499645 conn(0x563a9a6c7810 msgr2=0x563a9a7b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- 172.21.15.123:0/2196499645 shutdown_connections 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- 172.21.15.123:0/2196499645 wait complete. 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 Processor -- start 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- start start 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a641e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.666+0000 7fa709b43980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9a5d7e00 con 0x563a9a6cbf40 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa70765e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a641e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa70765e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a641e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33526/0 (socket says 172.21.15.123:33526) 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa70765e640 1 -- 172.21.15.123:0/1829552677 learned_addr learned my addr 172.21.15.123:0/1829552677 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa70765e640 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9a6cda50 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa70765e640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a641e80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa700018cc0 tx=0x7fa700017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa5f3e07640 1 -- 172.21.15.123:0/1829552677 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7000c4070 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a9a6423c0 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa5f3e07640 1 -- 172.21.15.123:0/1829552677 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7000b5650 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa5f3e07640 1 -- 172.21.15.123:0/1829552677 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7000b58f0 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a9a6408b0 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa5f3e07640 1 -- 172.21.15.123:0/1829552677 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa7000a8070 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa5f3e07640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5ec034300 0x7fa5ec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa5f3e07640 1 -- 172.21.15.123:0/1829552677 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa7000e35f0 con 0x563a9a6cbf40 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa706e5d640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5ec034300 0x7fa5ec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a6cc860 0x563a9a7c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7c65b0 con 0x563a9a6cc860 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa707e5f640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a6cc860 0x563a9a7c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa706e5d640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5ec034300 0x7fa5ec0367c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc000f70 tx=0x7fa6fc001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa707e5f640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a6cc860 0x563a9a7c6070 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa707e5f640 1 -- 172.21.15.123:0/1829552677 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa6f80083f0 con 0x563a9a6cc860 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7c6e20 0x563a9a7c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.670+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7c97c0 con 0x563a9a7c6e20 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa70765e640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7c6e20 0x563a9a7c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa70765e640 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7c6e20 0x563a9a7c9210 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa70765e640 1 -- 172.21.15.123:0/1829552677 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa7000a93c0 con 0x563a9a7c6e20 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7cb020 con 0x563a9a7c6e20 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa70765e640 1 -- 172.21.15.123:0/1829552677 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa7000a93c0 con 0x563a9a7c6e20 2024-03-20T13:38:10.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7ca220 con 0x563a9a7c6e20 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa70765e640 1 -- 172.21.15.123:0/1829552677 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7000a93c0 con 0x563a9a7c6e20 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7ca630 con 0x563a9a6cc860 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa707e5f640 1 -- 172.21.15.123:0/1829552677 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa6f80083f0 con 0x563a9a6cc860 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 Processor -- start 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 -- start start 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 0x563a9a7d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.674+0000 7fa709b43980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9a570e30 con 0x563a9a7d9700 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 0x563a9a7d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 0x563a9a7d9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33534/0 (socket says 172.21.15.123:33534) 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 -- 172.21.15.123:0/209715476 learned_addr learned my addr 172.21.15.123:0/209715476 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 -- 172.21.15.123:0/209715476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9a7da060 con 0x563a9a7d9700 2024-03-20T13:38:10.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 0x563a9a7d9b20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800aae0 tx=0x7fa6f8008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa5f1602640 1 -- 172.21.15.123:0/209715476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f801d070 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa5f1602640 1 -- 172.21.15.123:0/209715476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8010040 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a9a7da2b0 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa5f1602640 1 -- 172.21.15.123:0/209715476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f8007e70 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a9a7dae00 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa5f1602640 1 -- 172.21.15.123:0/209715476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa6f8018430 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa5f1602640 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5e00342b0 0x7fa5e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa5f1602640 1 -- 172.21.15.123:0/209715476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa6f804a6a0 con 0x563a9a7d9700 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa70765e640 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5e00342b0 0x7fa5e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa709b43980 1 Processor -- start 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa709b43980 1 -- start start 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa70765e640 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5e00342b0 0x7fa5e0036770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x563a9a7c9d20 tx=0x7fa7000d8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa709b43980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa709b43980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9a564790 con 0x563a9a7e6620 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33536/0 (socket says 172.21.15.123:33536) 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.678+0000 7fa707e5f640 1 -- 172.21.15.123:0/2745843085 learned_addr learned my addr 172.21.15.123:0/2745843085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 -- 172.21.15.123:0/2745843085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9a7e7010 con 0x563a9a7e6620 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 --2- 172.21.15.123:0/2745843085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7e6a40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80489f0 tx=0x7fa6f8048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67572a2ff9ca741f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa5eaffd640 1 -- 172.21.15.123:0/2745843085 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f8047070 con 0x563a9a7e6620 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa5eaffd640 1 -- 172.21.15.123:0/2745843085 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8022410 con 0x563a9a7e6620 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa5eaffd640 1 -- 172.21.15.123:0/2745843085 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f8016330 con 0x563a9a7e6620 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/2745843085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 msgr2=0x563a9a7e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 --2- 172.21.15.123:0/2745843085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7e6a40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80489f0 tx=0x7fa6f8048f00 comp rx=0 tx=0).stop 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/2745843085 shutdown_connections 2024-03-20T13:38:10.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 --2- 172.21.15.123:0/2745843085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7e6a40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/2745843085 >> 172.21.15.123:0/2745843085 conn(0x563a9a7e2920 msgr2=0x563a9a7e0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/2745843085 shutdown_connections 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/2745843085 wait complete. 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 Processor -- start 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- start start 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9a7eda00 con 0x563a9a7e6620 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33552/0 (socket says 172.21.15.123:33552) 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 learned_addr learned my addr 172.21.15.123:0/1442278027 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9a7dae00 con 0x563a9a7e6620 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa707e5f640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7ed4c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8047870 tx=0x7fa6f8048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa5e97fa640 1 -- 172.21.15.123:0/1442278027 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f804a510 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa5e97fa640 1 -- 172.21.15.123:0/1442278027 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8022580 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa5e97fa640 1 -- 172.21.15.123:0/1442278027 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f80188a0 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a9a7edc00 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.682+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a9a7ee090 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa5e97fa640 1 -- 172.21.15.123:0/1442278027 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa6f8018ad0 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa5e97fa640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5d00342b0 0x7fa5d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa5e97fa640 1 -- 172.21.15.123:0/1442278027 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa6f8037d20 con 0x563a9a7e6620 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa70765e640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5d00342b0 0x7fa5d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a7f8bd0 0x563a9a7fb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7fb7e0 con 0x563a9a7f8bd0 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa706e5d640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a7f8bd0 0x563a9a7fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa70765e640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5d00342b0 0x7fa5d0036770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa7000a9ff0 tx=0x7fa7000e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa706e5d640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a7f8bd0 0x563a9a7fb090 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 realm 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7f8030 con 0x563a9a7f8bd0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7fc260 con 0x563a9a7f8bd0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7fce00 0x563a9a7ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a7ffa30 con 0x563a9a7fce00 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa707e5f640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7fce00 0x563a9a7ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.686+0000 7fa707e5f640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7fce00 0x563a9a7ff2c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa6f8033070 con 0x563a9a7fce00 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a800280 con 0x563a9a7fce00 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa6f8033070 con 0x563a9a7fce00 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 20 searching for the correct realm 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563a9a801fa0 0x563a9a804390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a801fa0 2024-03-20T13:38:10.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa70765e640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563a9a801fa0 0x563a9a804390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa70765e640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563a9a801fa0 0x563a9a804390 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7fce00 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8033070 con 0x563a9a7fce00 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa707e5f640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa6f8055040 0x7fa6f8017710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x7fa6f8055040 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa706e5d640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa6f8055040 0x7fa6f8017710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa706e5d640 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa6f8055040 0x7fa6f8017710 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7f8bd0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.690+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7f8bd0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a801fa0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7f8bd0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7fce00 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8033070 con 0x563a9a7fce00 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7fce00 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8033070 con 0x563a9a7fce00 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7f8bd0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x7fa6f8055040 2024-03-20T13:38:10.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a804920 con 0x563a9a7f8bd0 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x7fa6f8055040 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.694+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7fce00 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8033070 con 0x563a9a7fce00 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a801fa0 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7f8bd0 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7fce00 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a801fa0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7f8bd0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7f8bd0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7f8bd0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a801fa0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x7fa6f8055040 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7f8bd0 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x7fa6f8055040 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a801fa0 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.698+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x7fa6f8055040 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7fce00 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7fce00 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a801fa0 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7fce00 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7fa6fc02d080 con 0x563a9a7fce00 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a800b80 con 0x563a9a7f8bd0 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.702+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a800fc0 con 0x563a9a7fce00 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8013e0 con 0x563a9a7f8bd0 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 zone default found 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 4 Realm: () 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:10.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 zonegroup default 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a805200 con 0x7fa6f8055040 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8073e0 con 0x563a9a801fa0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a807740 con 0x563a9a801fa0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 started sync module instance, tier type = 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.706+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a806820 con 0x563a9a7fce00 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94809700199424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a806820 con 0x563a9a7fce00 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a807c20 con 0x563a9a7f8bd0 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94809700202304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a807ba0 con 0x563a9a7f8bd0 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a808b30 con 0x563a9a7fce00 2024-03-20T13:38:10.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94809700199424] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94809700202304] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94809700204544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a808af0 con 0x563a9a7fce00 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.710+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a809380 con 0x7fa6f8055040 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94809700208352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a808af0 con 0x7fa6f8055040 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a809e70 con 0x563a9a7fce00 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94809700204544] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94809700208352] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94809700211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a809e30 con 0x563a9a7fce00 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.714+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80a240 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94809700209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80a240 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80b0e0 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94809700211056] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94809700209408] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94809700214256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80ac00 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80b930 con 0x7fa6f8055040 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94809700214256] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94809700206096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80b930 con 0x7fa6f8055040 2024-03-20T13:38:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=0 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=1 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=2 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=3 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=4 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=5 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.718+0000 7fa709b43980 20 add_watcher() i=6 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94809700206096] v34'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 20 add_watcher() i=7 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:10.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80eb00 con 0x563a9a7f8bd0 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94809700230448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a80b930 con 0x563a9a7f8bd0 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94809700230448] v34'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa5bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.722+0000 7fa709b43980 5 note: GC not initialized 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa5bcfe1640 20 reqs_thread_entry: start 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 20 Filter name: none 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa5367fc640 20 reqs_thread_entry: start 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305f0 con 0x563a9a7f8bd0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305f0 con 0x563a9a801fa0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa5bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.726+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94809700230448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a7f8bd0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94809700230448] v34'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94809700199424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a7fce00 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94809700199424] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa709b43980 20 remove_watcher() i=0 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa709b43980 2 removed watcher, disabling cache 2024-03-20T13:38:10.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94809700202304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a7f8bd0 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94809700202304] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x563a9a7f8bd0 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa709b43980 20 remove_watcher() i=1 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.730+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94809700204544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a7fce00 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.734+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94809700204544] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.734+0000 7fa709b43980 20 remove_watcher() i=2 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.734+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94809700208352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x7fa6f8055040 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.734+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94809700208352] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.734+0000 7fa709b43980 20 remove_watcher() i=3 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.734+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94809700211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a7fce00 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.738+0000 7fa707e5f640 1 -- 172.21.15.123:0/1442278027 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94809700211056] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6f8061040 con 0x563a9a7fce00 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.738+0000 7fa709b43980 20 remove_watcher() i=4 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.738+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94809700209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a801fa0 2024-03-20T13:38:10.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.738+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94809700209408] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.738+0000 7fa709b43980 20 remove_watcher() i=5 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.738+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94809700214256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x563a9a801fa0 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa70765e640 1 -- 172.21.15.123:0/1442278027 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94809700214256] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7000eb040 con 0x563a9a801fa0 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 20 remove_watcher() i=6 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94809700206096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x563a9a8305b0 con 0x7fa6f8055040 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94809700206096] v34'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa6fc00f620 con 0x7fa6f8055040 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 20 remove_watcher() i=7 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7fce00 msgr2=0x563a9a7ff2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7fce00 0x563a9a7ff2c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a7f8bd0 msgr2=0x563a9a7fb090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a7f8bd0 0x563a9a7fb090 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa6f8055040 msgr2=0x7fa6f8017710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7fa6f8055040 0x7fa6f8017710 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563a9a801fa0 msgr2=0x563a9a804390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x563a9a801fa0 0x563a9a804390 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5d00342b0 msgr2=0x7fa5d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5d00342b0 0x7fa5d0036770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa7000a9ff0 tx=0x7fa7000e4000 comp rx=0 tx=0).stop 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 msgr2=0x563a9a7ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa706e5d640 1 -- 172.21.15.123:0/1442278027 reap_dead start 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7ed4c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8047870 tx=0x7fa6f8048980 comp rx=0 tx=0).stop 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 shutdown_connections 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1442278027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7e6620 0x563a9a7ed4c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 >> 172.21.15.123:0/1442278027 conn(0x563a9a7e2920 msgr2=0x563a9a7e0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 shutdown_connections 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1442278027 wait complete. 2024-03-20T13:38:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5e00342b0 msgr2=0x7fa5e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5e00342b0 0x7fa5e0036770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x563a9a7c9d20 tx=0x7fa7000d8040 comp rx=0 tx=0).stop 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 msgr2=0x563a9a7d9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 0x563a9a7d9b20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800aae0 tx=0x7fa6f8008e70 comp rx=0 tx=0).stop 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 shutdown_connections 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5e00342b0 0x7fa5e0036770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/209715476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a7d9700 0x563a9a7d9b20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 >> 172.21.15.123:0/209715476 conn(0x563a9a7ce510 msgr2=0x563a9a7cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 shutdown_connections 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/209715476 wait complete. 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7c6e20 msgr2=0x563a9a7c9210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7c6e20 0x563a9a7c9210 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a6cc860 msgr2=0x563a9a7c6070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a6cc860 0x563a9a7c6070 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5ec034300 msgr2=0x7fa5ec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5ec034300 0x7fa5ec0367c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc000f70 tx=0x7fa6fc001380 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 msgr2=0x563a9a641e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a641e80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa700018cc0 tx=0x7fa700017e30 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 shutdown_connections 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x563a9a7c6e20 0x563a9a7c9210 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x563a9a6cc860 0x563a9a7c6070 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa5ec034300 0x7fa5ec0367c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 --2- 172.21.15.123:0/1829552677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a6cbf40 0x563a9a641e80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 >> 172.21.15.123:0/1829552677 conn(0x563a9a6c7810 msgr2=0x563a9a7b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 shutdown_connections 2024-03-20T13:38:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.742+0000 7fa709b43980 1 -- 172.21.15.123:0/1829552677 wait complete. 2024-03-20T13:38:10.781 INFO:teuthology.orchestra.run.smithi123.stdout:{"entries":[],"summary":[]} 2024-03-20T13:38:10.781 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-03-20T13:38:10.782 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-03-20T13:38:10.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-03-20T13:38:10.782 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-03-20T13:38:10.866 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:10.867 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:10.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fffe3980 1 Processor -- start 2024-03-20T13:38:10.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fffe3980 1 -- start start 2024-03-20T13:38:10.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fffe3980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5634dfc4b140 0x5634dfc4b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fffe3980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5634dfb954c0 con 0x5634dfc4ba60 2024-03-20T13:38:10.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fffe3980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5634dfb5c0f0 con 0x5634dfc4b140 2024-03-20T13:38:10.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fdafe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5634dfc4b140 0x5634dfc4b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fdafe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5634dfc4b140 0x5634dfc4b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33560/0 (socket says 172.21.15.123:33560) 2024-03-20T13:38:10.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fdafe640 1 -- 172.21.15.123:0/2611381234 learned_addr learned my addr 172.21.15.123:0/2611381234 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.862+0000 7ff4fd2fd640 1 --1- 172.21.15.123:0/2611381234 >> v1:172.21.15.89:6789/0 conn(0x5634dfc4ba60 0x5634dfc4c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59336/0 (socket says 172.21.15.123:59336) 2024-03-20T13:38:10.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fdafe640 1 -- 172.21.15.123:0/2611381234 >> v1:172.21.15.89:6789/0 conn(0x5634dfc4ba60 legacy=0x5634dfc4c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fdafe640 1 -- 172.21.15.123:0/2611381234 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634dfc4cc40 con 0x5634dfc4b140 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/2611381234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfc4b520 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000a5c0 tx=0x7ff4f001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cc8250fdcfe71c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fcafc640 1 -- 172.21.15.123:0/2611381234 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f00aa470 con 0x5634dfc4b140 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fcafc640 1 -- 172.21.15.123:0/2611381234 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00aa5d0 con 0x5634dfc4b140 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fcafc640 1 -- 172.21.15.123:0/2611381234 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f00aa890 con 0x5634dfc4b140 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 -- 172.21.15.123:0/2611381234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 msgr2=0x5634dfc4b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/2611381234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfc4b520 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000a5c0 tx=0x7ff4f001b340 comp rx=0 tx=0).stop 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 -- 172.21.15.123:0/2611381234 shutdown_connections 2024-03-20T13:38:10.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/2611381234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfc4b520 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 -- 172.21.15.123:0/2611381234 >> 172.21.15.123:0/2611381234 conn(0x5634dfbbe860 msgr2=0x5634dfbbec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 -- 172.21.15.123:0/2611381234 shutdown_connections 2024-03-20T13:38:10.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.866+0000 7ff4fffe3980 1 -- 172.21.15.123:0/2611381234 wait complete. 2024-03-20T13:38:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.882+0000 7ff4fffe3980 1 Processor -- start 2024-03-20T13:38:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.882+0000 7ff4fffe3980 1 -- start start 2024-03-20T13:38:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.882+0000 7ff4fffe3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd355d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.882+0000 7ff4fffe3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634dfb59620 con 0x5634dfc4b140 2024-03-20T13:38:10.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd355d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33576/0 (socket says 172.21.15.123:33576) 2024-03-20T13:38:10.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 -- 172.21.15.123:0/910141133 learned_addr learned my addr 172.21.15.123:0/910141133 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 -- 172.21.15.123:0/910141133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0005df0 con 0x5634dfc4b140 2024-03-20T13:38:10.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/910141133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd355d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0018f70 tx=0x7ff4f0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c6baeb9b1c5be4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff3ebe07640 1 -- 172.21.15.123:0/910141133 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f00aa9c0 con 0x5634dfc4b140 2024-03-20T13:38:10.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff3ebe07640 1 -- 172.21.15.123:0/910141133 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00aab20 con 0x5634dfc4b140 2024-03-20T13:38:10.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff3ebe07640 1 -- 172.21.15.123:0/910141133 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f00aadc0 con 0x5634dfc4b140 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- 172.21.15.123:0/910141133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 msgr2=0x5634dfd355d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/910141133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd355d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0018f70 tx=0x7ff4f0003030 comp rx=0 tx=0).stop 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- 172.21.15.123:0/910141133 shutdown_connections 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/910141133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd355d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- 172.21.15.123:0/910141133 >> 172.21.15.123:0/910141133 conn(0x5634dfbbe860 msgr2=0x5634dfd31160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- 172.21.15.123:0/910141133 shutdown_connections 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- 172.21.15.123:0/910141133 wait complete. 2024-03-20T13:38:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 Processor -- start 2024-03-20T13:38:10.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- start start 2024-03-20T13:38:10.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd3c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fffe3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634dfb54e00 con 0x5634dfc4b140 2024-03-20T13:38:10.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd3c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd3c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33584/0 (socket says 172.21.15.123:33584) 2024-03-20T13:38:10.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3290389364 learned_addr learned my addr 172.21.15.123:0/3290389364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.886+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634dfc4cc40 con 0x5634dfc4b140 2024-03-20T13:38:10.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd3c320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0018f70 tx=0x7ff4f00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff3ea604640 1 -- 172.21.15.123:0/3290389364 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f00cb070 con 0x5634dfc4b140 2024-03-20T13:38:10.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5634dfd3c860 con 0x5634dfc4b140 2024-03-20T13:38:10.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff3ea604640 1 -- 172.21.15.123:0/3290389364 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00c6690 con 0x5634dfc4b140 2024-03-20T13:38:10.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff3ea604640 1 -- 172.21.15.123:0/3290389364 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f00c6930 con 0x5634dfc4b140 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634dfd3cc90 con 0x5634dfc4b140 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff3ea604640 1 -- 172.21.15.123:0/3290389364 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4f00c6b60 con 0x5634dfc4b140 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff3ea604640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3e40342b0 0x7ff3e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff3ea604640 1 -- 172.21.15.123:0/3290389364 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff4f00e4b10 con 0x5634dfc4b140 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fd2fd640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3e40342b0 0x7ff3e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfc4ba60 0x5634dfd42f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd43490 con 0x5634dfc4ba60 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfc4ba60 0x5634dfd42f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fd2fd640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3e40342b0 0x7ff3e4036770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8001e50 tx=0x7ff4e80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfc4ba60 0x5634dfd42f50 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3290389364 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfc4ba60 2024-03-20T13:38:10.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd43d00 0x5634dfd460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd46750 con 0x5634dfd43d00 2024-03-20T13:38:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.890+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd43d00 0x5634dfd460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd43d00 0x5634dfd460f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3290389364 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4f00cd070 con 0x5634dfd43d00 2024-03-20T13:38:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd47fb0 con 0x5634dfd43d00 2024-03-20T13:38:10.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3290389364 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff4f00cd070 con 0x5634dfd43d00 2024-03-20T13:38:10.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd471b0 con 0x5634dfd43d00 2024-03-20T13:38:10.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3290389364 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4f00cd070 con 0x5634dfd43d00 2024-03-20T13:38:10.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd475c0 con 0x5634dfc4ba60 2024-03-20T13:38:10.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3290389364 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfc4ba60 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 Processor -- start 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 -- start start 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 0x5634dfd56b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fffe3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634dfaede30 con 0x5634dfd56740 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fe2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 0x5634dfd56b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fe2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 0x5634dfd56b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33594/0 (socket says 172.21.15.123:33594) 2024-03-20T13:38:10.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.894+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/443512480 learned_addr learned my addr 172.21.15.123:0/443512480 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/443512480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634dfd570a0 con 0x5634dfd56740 2024-03-20T13:38:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 0x5634dfd56b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8016cf0 tx=0x7ff4f800d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e37fe640 1 -- 172.21.15.123:0/443512480 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f8017660 con 0x5634dfd56740 2024-03-20T13:38:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e37fe640 1 -- 172.21.15.123:0/443512480 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f80177c0 con 0x5634dfd56740 2024-03-20T13:38:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5634dfd572f0 con 0x5634dfd56740 2024-03-20T13:38:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e37fe640 1 -- 172.21.15.123:0/443512480 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f8017a60 con 0x5634dfd56740 2024-03-20T13:38:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634dfd57e40 con 0x5634dfd56740 2024-03-20T13:38:10.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e37fe640 1 -- 172.21.15.123:0/443512480 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4f801d020 con 0x5634dfd56740 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e37fe640 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d80342b0 0x7ff3d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e37fe640 1 -- 172.21.15.123:0/443512480 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff4f804b310 con 0x5634dfd56740 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d80342b0 0x7ff3d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fffe3980 1 Processor -- start 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fffe3980 1 -- start start 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d80342b0 0x7ff3d8036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5634dfd46bf0 tx=0x7ff4f00cffb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fffe3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd63b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fffe3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634dfae1790 con 0x5634dfd636e0 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd63b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd63b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33596/0 (socket says 172.21.15.123:33596) 2024-03-20T13:38:10.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3323167240 learned_addr learned my addr 172.21.15.123:0/3323167240 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3323167240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634dfd640d0 con 0x5634dfd636e0 2024-03-20T13:38:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3323167240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd63b00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80495a0 tx=0x7ff4f8049850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dde4e272477ee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.898+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3323167240 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f803b070 con 0x5634dfd636e0 2024-03-20T13:38:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3323167240 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f804b0d0 con 0x5634dfd636e0 2024-03-20T13:38:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3323167240 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f803b300 con 0x5634dfd636e0 2024-03-20T13:38:10.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3323167240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 msgr2=0x5634dfd63b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3323167240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd63b00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80495a0 tx=0x7ff4f8049850 comp rx=0 tx=0).stop 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3323167240 shutdown_connections 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3323167240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd63b00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3323167240 >> 172.21.15.123:0/3323167240 conn(0x5634dfd5fa20 msgr2=0x5634dfd5da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3323167240 shutdown_connections 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3323167240 wait complete. 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 Processor -- start 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- start start 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd6a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634dfd6aad0 con 0x5634dfd636e0 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fe2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd6a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fe2ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd6a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33600/0 (socket says 172.21.15.123:33600) 2024-03-20T13:38:10.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 learned_addr learned my addr 172.21.15.123:0/3815049308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634dfd57e40 con 0x5634dfd636e0 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd6a590 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800a100 tx=0x7ff4f8049530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff3cf7fe640 1 -- 172.21.15.123:0/3815049308 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f80481d0 con 0x5634dfd636e0 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5634dfd6acd0 con 0x5634dfd636e0 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff3cf7fe640 1 -- 172.21.15.123:0/3815049308 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f80499b0 con 0x5634dfd636e0 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff3cf7fe640 1 -- 172.21.15.123:0/3815049308 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4f8049c50 con 0x5634dfd636e0 2024-03-20T13:38:10.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634dfd6b160 con 0x5634dfd636e0 2024-03-20T13:38:10.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.902+0000 7ff3cf7fe640 1 -- 172.21.15.123:0/3815049308 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff4f801f8b0 con 0x5634dfd636e0 2024-03-20T13:38:10.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff3cf7fe640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff3cf7fe640 1 -- 172.21.15.123:0/3815049308 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff4f80448d0 con 0x5634dfd636e0 2024-03-20T13:38:10.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfd75d40 0x5634dfd78200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd78950 con 0x5634dfd75d40 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fd2fd640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfd75d40 0x5634dfd78200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5634dfd3cff0 tx=0x7ff4f00ed000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fd2fd640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfd75d40 0x5634dfd78200 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 realm 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd751a0 con 0x5634dfd75d40 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd79390 con 0x5634dfd75d40 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd7a120 0x5634dfd7c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd7cb90 con 0x5634dfd7a120 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd7a120 0x5634dfd7c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd7a120 0x5634dfd7c510 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.906+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd7d390 con 0x5634dfd7a120 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fffe3980 20 searching for the correct realm 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5634dfd7f2d0 0x5634dfd81790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd81e60 con 0x5634dfd7f2d0 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5634dfd7f2d0 0x5634dfd81790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fdafe640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5634dfd7f2d0 0x5634dfd81790 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd7a120 2024-03-20T13:38:10.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fe2ff640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4f8033070 0x7ff4f803d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x7ff4f8033070 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4f8033070 0x7ff4f803d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4f8033070 0x7ff4f803d0c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd75d40 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd75d40 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd7f2d0 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.910+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd75d40 2024-03-20T13:38:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd7a120 2024-03-20T13:38:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd7a120 2024-03-20T13:38:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd75d40 2024-03-20T13:38:10.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x7ff4f8033070 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4f00fe040 con 0x5634dfd75d40 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x7ff4f8033070 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7a120 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.914+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7f2d0 2024-03-20T13:38:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd75d40 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7a120 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7f2d0 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd75d40 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd75d40 2024-03-20T13:38:10.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd75d40 2024-03-20T13:38:10.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7f2d0 2024-03-20T13:38:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x7ff4f8033070 2024-03-20T13:38:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd75d40 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x7ff4f8033070 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7f2d0 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.918+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x7ff4f8033070 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7a120 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7a120 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7f2d0 2024-03-20T13:38:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7a120 2024-03-20T13:38:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff4e802d080 con 0x5634dfd7a120 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd7d6f0 con 0x5634dfd75d40 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.922+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd7daa0 con 0x5634dfd7a120 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd7daa0 con 0x5634dfd75d40 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 zone default found 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 4 Realm: () 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:10.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 zonegroup default 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd7e390 con 0x7ff4f8033070 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd841c0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd84520 con 0x5634dfd7f2d0 2024-03-20T13:38:10.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 started sync module instance, tier type = 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.926+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd83600 con 0x5634dfd7a120 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785093777888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd83600 con 0x5634dfd7a120 2024-03-20T13:38:10.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd84d70 con 0x5634dfd75d40 2024-03-20T13:38:10.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785093781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd85570 con 0x5634dfd75d40 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd85dd0 con 0x5634dfd7a120 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785093781712] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785093777888] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785093775712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd85570 con 0x5634dfd7a120 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.930+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd86620 con 0x7ff4f8033070 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785093788032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd85570 con 0x7ff4f8033070 2024-03-20T13:38:10.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd870f0 con 0x5634dfd7a120 2024-03-20T13:38:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785093775712] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785093788032] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785093789088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd850d0 con 0x5634dfd7a120 2024-03-20T13:38:10.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.934+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd87940 con 0x5634dfd7f2d0 2024-03-20T13:38:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785093792928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd850d0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd883b0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785093789088] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785093792928] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785093793984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd87ed0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd88c00 con 0x7ff4f8033070 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785093793984] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785093790688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd87ed0 con 0x7ff4f8033070 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=0 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=1 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=2 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=3 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=4 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=5 2024-03-20T13:38:10.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.938+0000 7ff4fffe3980 20 add_watcher() i=6 2024-03-20T13:38:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785093790688] v34'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 20 add_watcher() i=7 2024-03-20T13:38:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:10.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8bcf0 con 0x5634dfd75d40 2024-03-20T13:38:10.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785093797728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd89230 con 0x5634dfd75d40 2024-03-20T13:38:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785093797728] v34'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff3af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.942+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd94340 con 0x5634dfd7a120 2024-03-20T13:38:10.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.946+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.946+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd947c0 con 0x7ff4f8033070 2024-03-20T13:38:10.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.946+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:10.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.946+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd947c0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.950+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.950+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd94cf0 con 0x5634dfd75d40 2024-03-20T13:38:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.950+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.950+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd95220 con 0x5634dfd7a120 2024-03-20T13:38:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.954+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'75 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.954+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd95750 con 0x5634dfd7f2d0 2024-03-20T13:38:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.954+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.954+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd95c80 con 0x5634dfd7a120 2024-03-20T13:38:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.958+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.958+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd961b0 con 0x5634dfd75d40 2024-03-20T13:38:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.958+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.958+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96650 con 0x5634dfd7a120 2024-03-20T13:38:10.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.962+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.962+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd962f0 con 0x5634dfd7a120 2024-03-20T13:38:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.966+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.966+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd962f0 con 0x5634dfd7a120 2024-03-20T13:38:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.966+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'76 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.966+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd962f0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.970+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.970+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96820 con 0x5634dfd7a120 2024-03-20T13:38:10.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.970+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.970+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd961f0 con 0x5634dfd75d40 2024-03-20T13:38:10.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.974+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.974+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd961f0 con 0x5634dfd75d40 2024-03-20T13:38:10.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.974+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.974+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd961f0 con 0x5634dfd7a120 2024-03-20T13:38:10.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.978+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.978+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd961f0 con 0x5634dfd7a120 2024-03-20T13:38:10.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.978+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'77 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.978+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd961f0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.982+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.982+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7a120 2024-03-20T13:38:10.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.986+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.986+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd75d40 2024-03-20T13:38:10.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.986+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:10.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.986+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7a120 2024-03-20T13:38:10.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.990+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.990+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7a120 2024-03-20T13:38:10.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.990+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:10.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.990+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.994+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:10.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.994+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7a120 2024-03-20T13:38:10.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.994+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.994+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.998+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.998+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.998+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:10.998+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.002+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.002+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7a120 2024-03-20T13:38:11.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.006+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.006+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd75d40 2024-03-20T13:38:11.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.006+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.006+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd7a120 2024-03-20T13:38:11.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.010+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.010+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x5634dfd75d40 2024-03-20T13:38:11.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd96cc0 con 0x7ff4f8033070 2024-03-20T13:38:11.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff3ae7fc640 20 reqs_thread_entry: start 2024-03-20T13:38:11.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:11.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 20 Filter name: none 2024-03-20T13:38:11.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff31ffff640 20 reqs_thread_entry: start 2024-03-20T13:38:11.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:38:11.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd929a0 con 0x5634dfd75d40 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd92ea0 con 0x7ff4f8033070 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 : miss 2024-03-20T13:38:11.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.014+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:96 8.16 8:6f9b1710:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb2e40 con 0x5634dfd7f2d0 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(96 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 info.flags=0x17 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 to cache LRU end 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 2024-03-20T13:38:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:97 4.2f 4:f708920a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x5634dfd75d40 2024-03-20T13:38:11.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(97 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:98 4.3f 4:fc8dc944:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x7ff4f8033070 2024-03-20T13:38:11.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(98 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:99 4.3f 4:ffcc9626:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x7ff4f8033070 2024-03-20T13:38:11.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(99 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:100 4.16 4:6a24df5b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x7ff4f8033070 2024-03-20T13:38:11.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(100 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:101 4.31 4:8cf069f7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x5634dfd7a120 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(101 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 [call out=426b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:102 4.33 4:cfa62550:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x7ff4f8033070 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.018+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(102 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:103 4.39 4:9e9bd1a9:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(103 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:104 4.4 4:227b9906:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x5634dfd75d40 2024-03-20T13:38:11.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(104 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:105 4.21 4:849a0e29:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(105 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:106 4.13 4:cae3db52:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x7ff4f8033070 2024-03-20T13:38:11.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(106 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:107 4.4 4:22954f11:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe303e0 con 0x5634dfd75d40 2024-03-20T13:38:11.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(107 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 20 get_obj_state: octx=0x7ff4e800f620 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5634dfe2e7c8 s->prefetch_data=0 2024-03-20T13:38:11.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 3.3bs0 3:dc2423bf:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe2f830 con 0x5634dfd7a120 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(108 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 10 manifest: total_size = 6 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 20 get_obj_state: setting s->obj_tag to 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.12282771656908463257 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 20 get_obj_state: octx=0x7ff4e800f620 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5634dfe2e7c8 s->prefetch_data=0 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 20 prepare_atomic_modification: state is not atomic. state=0x5634dfe2e7c8 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 20 bucket index object: :.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 2024-03-20T13:38:11.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.022+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:109 4.31 4:8cf069f7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe302a0 con 0x5634dfd7a120 2024-03-20T13:38:11.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.026+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(109 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 [stat,call,call] v34'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.026+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:110 3.3bs0 3:dc2423bf:::0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe2fd60 con 0x5634dfd7a120 2024-03-20T13:38:11.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(110 0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:111 4.31 4:8cf069f7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb79f0 con 0x5634dfd7a120 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 20 list_objects_ordered: starting attempt 1 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:112 4.2f 4:f708920a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb79d0 con 0x5634dfd75d40 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:113 4.3f 4:fc8dc944:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbbcb0 con 0x7ff4f8033070 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:114 4.3f 4:ffcc9626:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb79d0 con 0x7ff4f8033070 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:115 4.16 4:6a24df5b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc0c50 con 0x7ff4f8033070 2024-03-20T13:38:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:116 4.31 4:8cf069f7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc3470 con 0x5634dfd7a120 2024-03-20T13:38:11.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:117 4.33 4:cfa62550:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5d80 con 0x7ff4f8033070 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(112 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:118 4.39 4:9e9bd1a9:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5dc0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:119 4.4 4:227b9906:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc8670 con 0x5634dfd75d40 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(115 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(113 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 22 ==== osd_op_reply(117 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(118 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:120 4.21 4:849a0e29:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc0750 con 0x5634dfd7f2d0 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 23 ==== osd_op_reply(114 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(119 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:121 4.13 4:cae3db52:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc4d70 con 0x7ff4f8033070 2024-03-20T13:38:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:122 4.4 4:22954f11:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc51e0 con 0x5634dfd75d40 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(122 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(120 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 24 ==== osd_op_reply(121 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(111 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 [stat,call,call] v34'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff3e17fa640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(116 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7])"; uploads.size()=0; is_truncated=0 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:123 4.2f 4:f708920a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc06f0 con 0x5634dfd75d40 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:124 4.3f 4:fc8dc944:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc55e0 con 0x7ff4f8033070 2024-03-20T13:38:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:125 4.3f 4:ffcc9626:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc59d0 con 0x7ff4f8033070 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:126 4.16 4:6a24df5b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc4c50 con 0x7ff4f8033070 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:127 4.31 4:8cf069f7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb370 con 0x5634dfd7a120 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:128 4.33 4:cfa62550:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb67e0 con 0x7ff4f8033070 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:129 4.39 4:9e9bd1a9:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc06f0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:130 4.4 4:227b9906:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc55e0 con 0x5634dfd75d40 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:131 4.21 4:849a0e29:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb370 con 0x5634dfd7f2d0 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:132 4.13 4:cae3db52:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc06f0 con 0x7ff4f8033070 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.030+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:133 4.4 4:22954f11:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb67e0 con 0x5634dfd75d40 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(123 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(129 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(130 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(127 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(133 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(131 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 25 ==== osd_op_reply(124 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 26 ==== osd_op_reply(126 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 27 ==== osd_op_reply(128 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 28 ==== osd_op_reply(125 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 29 ==== osd_op_reply(132 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5c90 con 0x7ff4f8033070 2024-03-20T13:38:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 30 ==== osd_op_reply(134 foo.buckets [call] v34'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:38:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5c90 con 0x7ff4f8033070 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 31 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 10 removing default.rgw.meta+root+myfoo from cache 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94785094048912 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb7c0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== watch-notify(notify (1) cookie 94785093793984 notify 146028888090 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x5634dfd3cc90 con 0x5634dfd7f2d0 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff3e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94785093793984 notifier 4780 bl.length()=149 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(136 notify.6 [notify cookie 94785094048912 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3c0003d60 con 0x5634dfd7f2d0 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== watch-notify(notify_complete (2) cookie 94785094048912 notify 146028888090 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5634dfd3c860 con 0x5634dfd7f2d0 2024-03-20T13:38:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.034+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb7c0 con 0x7ff4f8033070 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 32 ==== osd_op_reply(138 myfoo [call,call,delete] v34'49 uv49 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 from cache 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7, ofs0, ns] 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:139 7.0 7:05bf5b68:::notify.1:head [notify cookie 94785094048912 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb7c0 con 0x5634dfd75d40 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== watch-notify(notify (1) cookie 94785093781712 notify 146028888079 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x5634dfb954c0 con 0x5634dfd75d40 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(139 notify.1 [notify cookie 94785094048912 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff3e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94785093781712 notifier 4780 bl.length()=206 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff3e0ff9640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3280032c0 con 0x5634dfd75d40 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== watch-notify(notify_complete (2) cookie 94785094048912 notify 146028888079 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff4e805d040 con 0x5634dfd75d40 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== osd_op_reply(140 notify.1 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:141 8.16 8:6f9b1710:root::.bucket.meta.myfoo%3a0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb7c0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(141 .bucket.meta.myfoo:0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 [call,call,delete] v34'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:142 4.2f 4:f708920a:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb7c0 con 0x5634dfd75d40 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:143 4.3f 4:fc8dc944:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb6ba0 con 0x7ff4f8033070 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:144 4.3f 4:ffcc9626:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb73a0 con 0x7ff4f8033070 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:145 4.16 4:6a24df5b:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfe2e5c0 con 0x7ff4f8033070 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:146 4.31 4:8cf069f7:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb1e30 con 0x5634dfd7a120 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:147 4.33 4:cfa62550:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb26b0 con 0x7ff4f8033070 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:148 4.39 4:9e9bd1a9:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc3b30 con 0x5634dfd7f2d0 2024-03-20T13:38:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:149 4.4 4:227b9906:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc43f0 con 0x5634dfd75d40 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:150 4.21 4:849a0e29:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdbb7c0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:151 4.13 4:cae3db52:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb1e30 con 0x7ff4f8033070 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.038+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:152 4.4 4:22954f11:::.dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdb6ba0 con 0x5634dfd75d40 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(149 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.7 [delete] v34'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 33 ==== osd_op_reply(147 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.5 [delete] v34'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 34 ==== osd_op_reply(143 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.1 [delete] v34'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(142 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.0 [delete] v34'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== osd_op_reply(148 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.6 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 35 ==== osd_op_reply(151 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.9 [delete] v34'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 36 ==== osd_op_reply(144 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.2 [delete] v34'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.042+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== osd_op_reply(152 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.10 [delete] v34'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 37 ==== osd_op_reply(145 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.3 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(150 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.8 [delete] v34'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== osd_op_reply(146 .dir.0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7.4 [delete] v34'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 : miss 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:153 6.2 6:444b79ca:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x5634dfd7f2d0 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(153 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 info.flags=0x0 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 10 adding default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 to cache LRU end 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 10 removing default.rgw.log++pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 from cache 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7, ofs0, ns] 2024-03-20T13:38:11.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94785094484640 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc4f00 con 0x5634dfd7a120 2024-03-20T13:38:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== watch-notify(notify (1) cookie 94785093777888 notify 146028888107 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7ff4f8067040 con 0x5634dfd7a120 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff3e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94785093777888 notifier 4780 bl.length()=203 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3c0003d60 con 0x5634dfd7a120 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(154 notify.0 [notify cookie 94785094484640 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== watch-notify(notify_complete (2) cookie 94785094484640 notify 146028888107 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5634dfd6b160 con 0x5634dfd7a120 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:156 6.2 6:444b79ca:::pubsub..bucket.myfoo%2f0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x5634dfd7f2d0 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.046+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(156 pubsub..bucket.myfoo/0d7d802a-c721-48a5-bb28-ec9d694bd027.4227.7 [delete] v34'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x7ff4f8033070 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 38 ==== osd_op_reply(157 foo.buckets [call] v34'50 uv50 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94785094484640 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd93290 con 0x7ff4f8033070 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 39 ==== watch-notify(notify (1) cookie 94785093788032 notify 146028888082 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7ff4e805d040 con 0x7ff4f8033070 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff3e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94785093788032 notifier 4780 bl.length()=170 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 40 ==== osd_op_reply(158 notify.3 [notify cookie 94785094484640 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff3e0ff9640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3280032a0 con 0x7ff4f8033070 2024-03-20T13:38:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 41 ==== watch-notify(notify_complete (2) cookie 94785094484640 notify 146028888082 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff4e801f720 con 0x7ff4f8033070 2024-03-20T13:38:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 42 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x5634dfd75d40 2024-03-20T13:38:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 10 removing email index: foo@foo.com 2024-03-20T13:38:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-03-20T13:38:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94785094484640 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd93290 con 0x7ff4f8033070 2024-03-20T13:38:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 43 ==== watch-notify(notify (1) cookie 94785093788032 notify 146028888083 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7ff4e801f720 con 0x7ff4f8033070 2024-03-20T13:38:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff3e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94785093788032 notifier 4780 bl.length()=162 2024-03-20T13:38:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 44 ==== osd_op_reply(161 notify.3 [notify cookie 94785094484640 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.050+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3c0003d60 con 0x7ff4f8033070 2024-03-20T13:38:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 45 ==== watch-notify(notify_complete (2) cookie 94785094484640 notify 146028888083 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff4e801fa50 con 0x7ff4f8033070 2024-03-20T13:38:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 46 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x5634dfd75d40 2024-03-20T13:38:11.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(163 foo@foo.com [delete] v34'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fffe3980 10 removing user buckets index 2024-03-20T13:38:11.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-03-20T13:38:11.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94785094484640 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd93290 con 0x5634dfd7f2d0 2024-03-20T13:38:11.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== watch-notify(notify (1) cookie 94785093792928 notify 146028888091 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x5634dfd3c860 con 0x5634dfd7f2d0 2024-03-20T13:38:11.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff3e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94785093792928 notifier 4780 bl.length()=160 2024-03-20T13:38:11.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(164 notify.5 [notify cookie 94785094484640 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff3e0ff9640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3280032a0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== watch-notify(notify_complete (2) cookie 94785094484640 notify 146028888091 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5634dfc4cc40 con 0x5634dfd7f2d0 2024-03-20T13:38:11.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.054+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x7ff4f8033070 2024-03-20T13:38:11.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 47 ==== osd_op_reply(166 foo.buckets [delete] v34'51 uv51 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fffe3980 10 removing user index: foo 2024-03-20T13:38:11.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fffe3980 10 removing default.rgw.meta+users.uid+foo from cache 2024-03-20T13:38:11.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fffe3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:38:11.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94785094484640 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd93290 con 0x5634dfd7a120 2024-03-20T13:38:11.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== watch-notify(notify (1) cookie 94785093789088 notify 146028888108 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5634dfd6b160 con 0x5634dfd7a120 2024-03-20T13:38:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff3e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94785093789088 notifier 4780 bl.length()=152 2024-03-20T13:38:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff3e17fa640 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x7ff3c0003d60 con 0x5634dfd7a120 2024-03-20T13:38:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(167 notify.4 [notify cookie 94785094484640 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== watch-notify(notify_complete (2) cookie 94785094484640 notify 146028888108 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5634dfd6acd0 con 0x5634dfd7a120 2024-03-20T13:38:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 49 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.058+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfdc5b70 con 0x5634dfd75d40 2024-03-20T13:38:11.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.062+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(169 foo [call,call,delete] v34'17 uv17 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.062+0000 7ff3af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:11.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.062+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785093797728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd75d40 2024-03-20T13:38:11.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.062+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94785093797728] v34'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.062+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785093777888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd7a120 2024-03-20T13:38:11.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 50 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94785093777888] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fffe3980 20 remove_watcher() i=0 2024-03-20T13:38:11.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fffe3980 2 removed watcher, disabling cache 2024-03-20T13:38:11.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785093781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd75d40 2024-03-20T13:38:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94785093781712] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x5634dfd75d40 2024-03-20T13:38:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fffe3980 20 remove_watcher() i=1 2024-03-20T13:38:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.066+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785093775712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd7a120 2024-03-20T13:38:11.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.070+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 51 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94785093775712] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.070+0000 7ff4fffe3980 20 remove_watcher() i=2 2024-03-20T13:38:11.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.070+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785093788032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x7ff4f8033070 2024-03-20T13:38:11.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.070+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 48 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94785093788032] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.070+0000 7ff4fffe3980 20 remove_watcher() i=3 2024-03-20T13:38:11.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.070+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785093789088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd7a120 2024-03-20T13:38:11.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.074+0000 7ff4fe2ff640 1 -- 172.21.15.123:0/3815049308 <== osd.0 v2:172.21.15.89:6800/854515999 52 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94785093789088] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f800a4d0 con 0x5634dfd7a120 2024-03-20T13:38:11.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.074+0000 7ff4fffe3980 20 remove_watcher() i=4 2024-03-20T13:38:11.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.074+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785093792928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.074+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 42 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94785093792928] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.074+0000 7ff4fffe3980 20 remove_watcher() i=5 2024-03-20T13:38:11.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.074+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785093793984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fdafe640 1 -- 172.21.15.123:0/3815049308 <== osd.3 v2:172.21.15.123:6816/3519650013 43 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94785093793984] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4f00e5db0 con 0x5634dfd7f2d0 2024-03-20T13:38:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 20 remove_watcher() i=6 2024-03-20T13:38:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785093790688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5634dfd8b6f0 con 0x7ff4f8033070 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 <== osd.2 v2:172.21.15.123:6803/1251286685 49 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94785093790688] v34'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e800f6a0 con 0x7ff4f8033070 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 20 remove_watcher() i=7 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd7a120 msgr2=0x5634dfd7c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd7a120 0x5634dfd7c510 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfd75d40 msgr2=0x5634dfd78200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfd75d40 0x5634dfd78200 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4f8033070 msgr2=0x7ff4f803d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7ff4f8033070 0x7ff4f803d0c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5634dfd7f2d0 msgr2=0x5634dfd81790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5634dfd7f2d0 0x5634dfd81790 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 msgr2=0x7ff3c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3c80342b0 0x7ff3c8036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5634dfd3cff0 tx=0x7ff4f00ed000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 msgr2=0x5634dfd6a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fd2fd640 1 -- 172.21.15.123:0/3815049308 reap_dead start 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd6a590 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800a100 tx=0x7ff4f8049530 comp rx=0 tx=0).stop 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 shutdown_connections 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3815049308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd636e0 0x5634dfd6a590 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 >> 172.21.15.123:0/3815049308 conn(0x5634dfd5fa20 msgr2=0x5634dfd5d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 shutdown_connections 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3815049308 wait complete. 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d80342b0 msgr2=0x7ff3d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d80342b0 0x7ff3d8036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5634dfd46bf0 tx=0x7ff4f00cffb0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 msgr2=0x5634dfd56b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 0x5634dfd56b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8016cf0 tx=0x7ff4f800d790 comp rx=0 tx=0).stop 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 shutdown_connections 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3d80342b0 0x7ff3d8036770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/443512480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfd56740 0x5634dfd56b60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 >> 172.21.15.123:0/443512480 conn(0x5634dfd4b550 msgr2=0x5634dfd4c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 shutdown_connections 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/443512480 wait complete. 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd43d00 msgr2=0x5634dfd460f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd43d00 0x5634dfd460f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfc4ba60 msgr2=0x5634dfd42f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.078+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfc4ba60 0x5634dfd42f50 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3e40342b0 msgr2=0x7ff3e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3e40342b0 0x7ff3e4036770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8001e50 tx=0x7ff4e80013b0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 msgr2=0x5634dfd3c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd3c320 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0018f70 tx=0x7ff4f00180e0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 shutdown_connections 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5634dfd43d00 0x5634dfd460f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5634dfc4ba60 0x5634dfd42f50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff3e40342b0 0x7ff3e4036770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 --2- 172.21.15.123:0/3290389364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634dfc4b140 0x5634dfd3c320 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 >> 172.21.15.123:0/3290389364 conn(0x5634dfbbe860 msgr2=0x5634dfd2fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 shutdown_connections 2024-03-20T13:38:11.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.082+0000 7ff4fffe3980 1 -- 172.21.15.123:0/3290389364 wait complete. 2024-03-20T13:38:11.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:38:11.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:38:11.097 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:38:11.176 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:11.176 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:11.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f5163ed0980 1 Processor -- start 2024-03-20T13:38:11.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f5163ed0980 1 -- start start 2024-03-20T13:38:11.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f5163ed0980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5563ea649630 0x5563ea64ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f5163ed0980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5563ea58f520 con 0x5563ea645130 2024-03-20T13:38:11.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f5163ed0980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5563ea5560f0 con 0x5563ea649630 2024-03-20T13:38:11.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51611ea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5563ea649630 0x5563ea64ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51611ea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5563ea649630 0x5563ea64ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33614/0 (socket says 172.21.15.123:33614) 2024-03-20T13:38:11.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51619eb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5563ea645130 0x5563ea645510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59350/0 (socket says 172.21.15.123:59350) 2024-03-20T13:38:11.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51611ea640 1 -- 172.21.15.123:0/2583191708 learned_addr learned my addr 172.21.15.123:0/2583191708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51609e9640 1 -- 172.21.15.123:0/2583191708 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692502272 0 0) 0x5563ea58f520 con 0x5563ea645130 2024-03-20T13:38:11.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51609e9640 1 -- 172.21.15.123:0/2583191708 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f514c001e20 con 0x5563ea645130 2024-03-20T13:38:11.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51611ea640 1 -- 172.21.15.123:0/2583191708 >> v1:172.21.15.89:6789/0 conn(0x5563ea645130 legacy=0x5563ea645510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.174+0000 7f51611ea640 1 -- 172.21.15.123:0/2583191708 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563ea64cf70 con 0x5563ea649630 2024-03-20T13:38:11.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f51611ea640 1 --2- 172.21.15.123:0/2583191708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea649630 0x5563ea64ba20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f515800a4e0 tx=0x7f515801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4ede935eb29459 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f51609e9640 1 -- 172.21.15.123:0/2583191708 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51580aa540 con 0x5563ea649630 2024-03-20T13:38:11.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f51609e9640 1 -- 172.21.15.123:0/2583191708 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51580a6070 con 0x5563ea649630 2024-03-20T13:38:11.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f51609e9640 1 -- 172.21.15.123:0/2583191708 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51580aa850 con 0x5563ea649630 2024-03-20T13:38:11.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 -- 172.21.15.123:0/2583191708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea649630 msgr2=0x5563ea64ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 --2- 172.21.15.123:0/2583191708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea649630 0x5563ea64ba20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f515800a4e0 tx=0x7f515801b090 comp rx=0 tx=0).stop 2024-03-20T13:38:11.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 -- 172.21.15.123:0/2583191708 shutdown_connections 2024-03-20T13:38:11.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 --2- 172.21.15.123:0/2583191708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea649630 0x5563ea64ba20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 -- 172.21.15.123:0/2583191708 >> 172.21.15.123:0/2583191708 conn(0x5563ea5b8850 msgr2=0x5563ea5b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 -- 172.21.15.123:0/2583191708 shutdown_connections 2024-03-20T13:38:11.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.178+0000 7f5163ed0980 1 -- 172.21.15.123:0/2583191708 wait complete. 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f5163ed0980 1 Processor -- start 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f5163ed0980 1 -- start start 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f5163ed0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea72ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f5163ed0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563ea553620 con 0x5563ea645130 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f51619eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea72ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f51619eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea72ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33630/0 (socket says 172.21.15.123:33630) 2024-03-20T13:38:11.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f51619eb640 1 -- 172.21.15.123:0/1032506627 learned_addr learned my addr 172.21.15.123:0/1032506627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f51619eb640 1 -- 172.21.15.123:0/1032506627 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515800a1c0 con 0x5563ea645130 2024-03-20T13:38:11.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f51619eb640 1 --2- 172.21.15.123:0/1032506627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea72ee00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f515c001d70 tx=0x7f515c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2c22fe90ad15d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f504fe07640 1 -- 172.21.15.123:0/1032506627 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515c014070 con 0x5563ea645130 2024-03-20T13:38:11.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f504fe07640 1 -- 172.21.15.123:0/1032506627 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00e5d0 con 0x5563ea645130 2024-03-20T13:38:11.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.194+0000 7f504fe07640 1 -- 172.21.15.123:0/1032506627 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515c007040 con 0x5563ea645130 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/1032506627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 msgr2=0x5563ea72ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 --2- 172.21.15.123:0/1032506627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea72ee00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f515c001d70 tx=0x7f515c00b610 comp rx=0 tx=0).stop 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/1032506627 shutdown_connections 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 --2- 172.21.15.123:0/1032506627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea72ee00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/1032506627 >> 172.21.15.123:0/1032506627 conn(0x5563ea5b8850 msgr2=0x5563ea72a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/1032506627 shutdown_connections 2024-03-20T13:38:11.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/1032506627 wait complete. 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 Processor -- start 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- start start 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea735cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563ea54ee00 con 0x5563ea645130 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f51619eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea735cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f51619eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea735cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33636/0 (socket says 172.21.15.123:33636) 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f51619eb640 1 -- 172.21.15.123:0/491263005 learned_addr learned my addr 172.21.15.123:0/491263005 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f51619eb640 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c001e20 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f51619eb640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea735cb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f515c00b650 tx=0x7f515c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f504e604640 1 -- 172.21.15.123:0/491263005 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515c014030 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f504e604640 1 -- 172.21.15.123:0/491263005 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00f7a0 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563ea7361f0 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f504e604640 1 -- 172.21.15.123:0/491263005 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515c00fac0 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563ea736620 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.198+0000 7f504e604640 1 -- 172.21.15.123:0/491263005 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f515c00fd30 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f504e604640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50480342b0 0x7f5048036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f504e604640 1 -- 172.21.15.123:0/491263005 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f515c006070 con 0x5563ea645130 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51611ea640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50480342b0 0x7f5048036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea649630 0x5563ea73c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea73ce20 con 0x5563ea649630 2024-03-20T13:38:11.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51621ec640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea649630 0x5563ea73c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51611ea640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50480342b0 0x7f5048036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f51580ab000 tx=0x7f51580a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51621ec640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea649630 0x5563ea73c8e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51621ec640 1 -- 172.21.15.123:0/491263005 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51540083f0 con 0x5563ea649630 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea73d690 0x5563ea73faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea740210 con 0x5563ea73d690 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51619eb640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea73d690 0x5563ea73faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51619eb640 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea73d690 0x5563ea73faa0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51619eb640 1 -- 172.21.15.123:0/491263005 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f515c016070 con 0x5563ea73d690 2024-03-20T13:38:11.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea741a70 con 0x5563ea73d690 2024-03-20T13:38:11.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f51619eb640 1 -- 172.21.15.123:0/491263005 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f515c016070 con 0x5563ea73d690 2024-03-20T13:38:11.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.202+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea740c70 con 0x5563ea73d690 2024-03-20T13:38:11.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51619eb640 1 -- 172.21.15.123:0/491263005 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f515c016070 con 0x5563ea73d690 2024-03-20T13:38:11.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea741080 con 0x5563ea649630 2024-03-20T13:38:11.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51621ec640 1 -- 172.21.15.123:0/491263005 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f51540083f0 con 0x5563ea649630 2024-03-20T13:38:11.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 Processor -- start 2024-03-20T13:38:11.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 -- start start 2024-03-20T13:38:11.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 0x5563ea750590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563ea4e7e30 con 0x5563ea750170 2024-03-20T13:38:11.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51621ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 0x5563ea750590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51621ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 0x5563ea750590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33646/0 (socket says 172.21.15.123:33646) 2024-03-20T13:38:11.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51621ec640 1 -- 172.21.15.123:0/1761038070 learned_addr learned my addr 172.21.15.123:0/1761038070 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51621ec640 1 -- 172.21.15.123:0/1761038070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563ea750ad0 con 0x5563ea750170 2024-03-20T13:38:11.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f51621ec640 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 0x5563ea750590 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f515400aae0 tx=0x7f5154008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f50477fe640 1 -- 172.21.15.123:0/1761038070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515401d070 con 0x5563ea750170 2024-03-20T13:38:11.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f50477fe640 1 -- 172.21.15.123:0/1761038070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154010040 con 0x5563ea750170 2024-03-20T13:38:11.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563ea750d20 con 0x5563ea750170 2024-03-20T13:38:11.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f50477fe640 1 -- 172.21.15.123:0/1761038070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5154007e70 con 0x5563ea750170 2024-03-20T13:38:11.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.206+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563ea751870 con 0x5563ea750170 2024-03-20T13:38:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f50477fe640 1 -- 172.21.15.123:0/1761038070 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5154018430 con 0x5563ea750170 2024-03-20T13:38:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f50477fe640 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f503c034300 0x7f503c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f50477fe640 1 -- 172.21.15.123:0/1761038070 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f515404a640 con 0x5563ea750170 2024-03-20T13:38:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51619eb640 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f503c034300 0x7f503c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 Processor -- start 2024-03-20T13:38:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- start start 2024-03-20T13:38:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51619eb640 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f503c034300 0x7f503c0367c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5563ea740770 tx=0x7f515c01cce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea75d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563ea4db790 con 0x5563ea75d0f0 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51621ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea75d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51621ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea75d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33660/0 (socket says 172.21.15.123:33660) 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51621ec640 1 -- 172.21.15.123:0/437841648 learned_addr learned my addr 172.21.15.123:0/437841648 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51621ec640 1 -- 172.21.15.123:0/437841648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563ea75dae0 con 0x5563ea75d0f0 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51621ec640 1 --2- 172.21.15.123:0/437841648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea75d510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f51540489c0 tx=0x7f5154020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a872612d4d7a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f50457fa640 1 -- 172.21.15.123:0/437841648 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515403e030 con 0x5563ea75d0f0 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f50457fa640 1 -- 172.21.15.123:0/437841648 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154021e20 con 0x5563ea75d0f0 2024-03-20T13:38:11.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f50457fa640 1 -- 172.21.15.123:0/437841648 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5154022540 con 0x5563ea75d0f0 2024-03-20T13:38:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- 172.21.15.123:0/437841648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 msgr2=0x5563ea75d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 --2- 172.21.15.123:0/437841648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea75d510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f51540489c0 tx=0x7f5154020f00 comp rx=0 tx=0).stop 2024-03-20T13:38:11.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- 172.21.15.123:0/437841648 shutdown_connections 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 --2- 172.21.15.123:0/437841648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea75d510 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- 172.21.15.123:0/437841648 >> 172.21.15.123:0/437841648 conn(0x5563ea759430 msgr2=0x5563ea757490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- 172.21.15.123:0/437841648 shutdown_connections 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- 172.21.15.123:0/437841648 wait complete. 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 Processor -- start 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- start start 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea763fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f5163ed0980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563ea764500 con 0x5563ea75d0f0 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.210+0000 7f51621ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea763fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51621ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea763fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33674/0 (socket says 172.21.15.123:33674) 2024-03-20T13:38:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 learned_addr learned my addr 172.21.15.123:0/4286879198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563ea751870 con 0x5563ea75d0f0 2024-03-20T13:38:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51621ec640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea763fc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5154047860 tx=0x7f5154048920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f50337fe640 1 -- 172.21.15.123:0/4286879198 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5154048ce0 con 0x5563ea75d0f0 2024-03-20T13:38:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f50337fe640 1 -- 172.21.15.123:0/4286879198 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154048e60 con 0x5563ea75d0f0 2024-03-20T13:38:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563ea764700 con 0x5563ea75d0f0 2024-03-20T13:38:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f50337fe640 1 -- 172.21.15.123:0/4286879198 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f515404a240 con 0x5563ea75d0f0 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563ea764b30 con 0x5563ea75d0f0 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f50337fe640 1 -- 172.21.15.123:0/4286879198 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5154041070 con 0x5563ea75d0f0 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f50337fe640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f502c0342b0 0x7f502c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f50337fe640 1 -- 172.21.15.123:0/4286879198 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f515403f070 con 0x5563ea75d0f0 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51619eb640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f502c0342b0 0x7f502c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea76f660 0x5563ea771b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea772250 con 0x5563ea76f660 2024-03-20T13:38:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51611ea640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea76f660 0x5563ea771b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51619eb640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f502c0342b0 0x7f502c036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f515c00ef00 tx=0x7f515c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51611ea640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea76f660 0x5563ea771b00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51580aa870 con 0x5563ea76f660 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 20 realm 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.214+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea772640 con 0x5563ea76f660 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51580aa870 con 0x5563ea76f660 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea772e90 con 0x5563ea76f660 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51580aa870 con 0x5563ea76f660 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea773870 0x5563ea775ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea776410 con 0x5563ea773870 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51621ec640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea773870 0x5563ea775ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51621ec640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea773870 0x5563ea775ca0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea776c60 con 0x5563ea773870 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 20 searching for the correct realm 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5563ea778980 0x5563ea77ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51619eb640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5563ea778980 0x5563ea77ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51619eb640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5563ea778980 0x5563ea77ad70 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.218+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5154035070 0x7f5154036460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x7f5154035070 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5154035070 0x7f5154036460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5154035070 0x7f5154036460 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580aa870 con 0x7f5154035070 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.222+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x7f5154035070 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x7f5154035070 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x7f5154035070 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f51580c9040 con 0x7f5154035070 2024-03-20T13:38:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580c9040 con 0x5563ea76f660 2024-03-20T13:38:11.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.226+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x7f5154035070 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea76f660 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x7f5154035070 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x7f5154035070 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea778980 2024-03-20T13:38:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.230+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77b300 con 0x5563ea773870 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea777590 con 0x5563ea76f660 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7779d0 con 0x5563ea773870 2024-03-20T13:38:11.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:11.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea777df0 con 0x5563ea76f660 2024-03-20T13:38:11.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 zone default found 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 4 Realm: () 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 zonegroup default 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77bbe0 con 0x7f5154035070 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77ddc0 con 0x5563ea778980 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77e120 con 0x5563ea778980 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 started sync module instance, tier type = 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:11.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.234+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77d200 con 0x5563ea773870 2024-03-20T13:38:11.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887623843168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77da50 con 0x5563ea773870 2024-03-20T13:38:11.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77e960 con 0x5563ea76f660 2024-03-20T13:38:11.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887623849088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77f1b0 con 0x5563ea76f660 2024-03-20T13:38:11.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77fbd0 con 0x5563ea773870 2024-03-20T13:38:11.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.238+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887623843168] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887623849088] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887623853744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77ed10 con 0x5563ea773870 2024-03-20T13:38:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea780420 con 0x7f5154035070 2024-03-20T13:38:11.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887623856000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77ed10 con 0x7f5154035070 2024-03-20T13:38:11.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.242+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea780f10 con 0x5563ea773870 2024-03-20T13:38:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887623853744] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887623858704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea780ed0 con 0x5563ea773870 2024-03-20T13:38:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7818d0 con 0x5563ea778980 2024-03-20T13:38:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887623856000] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887623861296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea781c30 con 0x5563ea778980 2024-03-20T13:38:11.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7824d0 con 0x5563ea778980 2024-03-20T13:38:11.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887623858704] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887623861296] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887623857056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea77d5b0 con 0x5563ea778980 2024-03-20T13:38:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.246+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea782e90 con 0x7f5154035070 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887623866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7832b0 con 0x7f5154035070 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=0 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=1 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=2 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=3 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=4 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=5 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887623857056] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=6 2024-03-20T13:38:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887623866864] v34'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 20 add_watcher() i=7 2024-03-20T13:38:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7832b0 con 0x5563ea76f660 2024-03-20T13:38:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.250+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887623867920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea783bf0 con 0x5563ea76f660 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887623867920] v34'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f50137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 5 note: GC not initialized 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f50127fc640 20 reqs_thread_entry: start 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 20 Filter name: none 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f4f83fff640 20 reqs_thread_entry: start 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 20 rados->read ofs=0 len=0 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d40 con 0x5563ea76f660 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:could not fetch user info: no user info saved 2024-03-20T13:38:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f50137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:11.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.254+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887623867920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea76f660 2024-03-20T13:38:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.258+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93887623867920] v34'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.258+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887623843168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea773870 2024-03-20T13:38:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.258+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93887623843168] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.258+0000 7f5163ed0980 20 remove_watcher() i=0 2024-03-20T13:38:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.258+0000 7f5163ed0980 2 removed watcher, disabling cache 2024-03-20T13:38:11.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.258+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887623849088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea76f660 2024-03-20T13:38:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.262+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93887623849088] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x5563ea76f660 2024-03-20T13:38:11.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.262+0000 7f5163ed0980 20 remove_watcher() i=1 2024-03-20T13:38:11.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.262+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887623853744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea773870 2024-03-20T13:38:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.262+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93887623853744] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.262+0000 7f5163ed0980 20 remove_watcher() i=2 2024-03-20T13:38:11.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.262+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887623856000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x7f5154035070 2024-03-20T13:38:11.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93887623856000] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f5163ed0980 20 remove_watcher() i=3 2024-03-20T13:38:11.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887623858704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea773870 2024-03-20T13:38:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f51621ec640 1 -- 172.21.15.123:0/4286879198 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93887623858704] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515401f070 con 0x5563ea773870 2024-03-20T13:38:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f5163ed0980 20 remove_watcher() i=4 2024-03-20T13:38:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887623861296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea778980 2024-03-20T13:38:11.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93887623861296] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f5163ed0980 20 remove_watcher() i=5 2024-03-20T13:38:11.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.266+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887623857056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x5563ea778980 2024-03-20T13:38:11.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f51619eb640 1 -- 172.21.15.123:0/4286879198 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93887623857056] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f515c016070 con 0x5563ea778980 2024-03-20T13:38:11.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 20 remove_watcher() i=6 2024-03-20T13:38:11.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887623866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x5563ea7a7d00 con 0x7f5154035070 2024-03-20T13:38:11.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93887623866864] v34'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51580d6060 con 0x7f5154035070 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 20 remove_watcher() i=7 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea773870 msgr2=0x5563ea775ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea773870 0x5563ea775ca0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea76f660 msgr2=0x5563ea771b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea76f660 0x5563ea771b00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5154035070 msgr2=0x7f5154036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f5154035070 0x7f5154036460 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5563ea778980 msgr2=0x5563ea77ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x5563ea778980 0x5563ea77ad70 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f502c0342b0 msgr2=0x7f502c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f502c0342b0 0x7f502c036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f515c00ef00 tx=0x7f515c033000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 msgr2=0x5563ea763fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea763fc0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5154047860 tx=0x7f5154048920 comp rx=0 tx=0).stop 2024-03-20T13:38:11.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f51611ea640 1 -- 172.21.15.123:0/4286879198 reap_dead start 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 shutdown_connections 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/4286879198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea75d0f0 0x5563ea763fc0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 >> 172.21.15.123:0/4286879198 conn(0x5563ea759430 msgr2=0x5563ea757460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 shutdown_connections 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/4286879198 wait complete. 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f503c034300 msgr2=0x7f503c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f503c034300 0x7f503c0367c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5563ea740770 tx=0x7f515c01cce0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 msgr2=0x5563ea750590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 0x5563ea750590 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f515400aae0 tx=0x7f5154008e70 comp rx=0 tx=0).stop 2024-03-20T13:38:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 shutdown_connections 2024-03-20T13:38:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f503c034300 0x7f503c0367c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/1761038070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea750170 0x5563ea750590 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 >> 172.21.15.123:0/1761038070 conn(0x5563ea744f80 msgr2=0x5563ea745a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 shutdown_connections 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/1761038070 wait complete. 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea73d690 msgr2=0x5563ea73faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea73d690 0x5563ea73faa0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea649630 msgr2=0x5563ea73c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea649630 0x5563ea73c8e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50480342b0 msgr2=0x7f5048036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50480342b0 0x7f5048036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f51580ab000 tx=0x7f51580a5000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 msgr2=0x5563ea735cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea735cb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f515c00b650 tx=0x7f515c000ee0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 shutdown_connections 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x5563ea73d690 0x5563ea73faa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x5563ea649630 0x5563ea73c8e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f50480342b0 0x7f5048036770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 --2- 172.21.15.123:0/491263005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5563ea645130 0x5563ea735cb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.270+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 >> 172.21.15.123:0/491263005 conn(0x5563ea5b8850 msgr2=0x5563ea7294a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.274+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 shutdown_connections 2024-03-20T13:38:11.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.274+0000 7f5163ed0980 1 -- 172.21.15.123:0/491263005 wait complete. 2024-03-20T13:38:11.287 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-20T13:38:11.287 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-03-20T13:38:11.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-03-20T13:38:11.288 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-03-20T13:38:11.362 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:11.362 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:11.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc132038980 1 Processor -- start 2024-03-20T13:38:11.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc132038980 1 -- start start 2024-03-20T13:38:11.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc132038980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f0f2e2aa00 0x55f0f2ebb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc132038980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f0f2e02520 con 0x55f0f2ebb5f0 2024-03-20T13:38:11.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc132038980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f0f2dc90f0 con 0x55f0f2e2aa00 2024-03-20T13:38:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc12fb53640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f0f2e2aa00 0x55f0f2ebb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc12fb53640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f0f2e2aa00 0x55f0f2ebb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33684/0 (socket says 172.21.15.123:33684) 2024-03-20T13:38:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc12fb53640 1 -- 172.21.15.123:0/1304090614 learned_addr learned my addr 172.21.15.123:0/1304090614 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.358+0000 7fc12f352640 1 --1- 172.21.15.123:0/1304090614 >> v1:172.21.15.89:6789/0 conn(0x55f0f2ebb5f0 0x55f0f2ebd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59360/0 (socket says 172.21.15.123:59360) 2024-03-20T13:38:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc12fb53640 1 -- 172.21.15.123:0/1304090614 >> v1:172.21.15.89:6789/0 conn(0x55f0f2ebb5f0 legacy=0x55f0f2ebd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc12fb53640 1 -- 172.21.15.123:0/1304090614 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f2eb6ad0 con 0x55f0f2e2aa00 2024-03-20T13:38:11.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc12fb53640 1 --2- 172.21.15.123:0/1304090614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2ebb0b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc12000a4e0 tx=0x7fc12001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2c9c62ccfafe server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc12eb51640 1 -- 172.21.15.123:0/1304090614 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200aa540 con 0x55f0f2e2aa00 2024-03-20T13:38:11.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc12eb51640 1 -- 172.21.15.123:0/1304090614 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1200a6070 con 0x55f0f2e2aa00 2024-03-20T13:38:11.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc12eb51640 1 -- 172.21.15.123:0/1304090614 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200aa850 con 0x55f0f2e2aa00 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 -- 172.21.15.123:0/1304090614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 msgr2=0x55f0f2ebb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 --2- 172.21.15.123:0/1304090614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2ebb0b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc12000a4e0 tx=0x7fc12001b090 comp rx=0 tx=0).stop 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 -- 172.21.15.123:0/1304090614 shutdown_connections 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 --2- 172.21.15.123:0/1304090614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2ebb0b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 -- 172.21.15.123:0/1304090614 >> 172.21.15.123:0/1304090614 conn(0x55f0f2eb0790 msgr2=0x55f0f2eb2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 -- 172.21.15.123:0/1304090614 shutdown_connections 2024-03-20T13:38:11.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.362+0000 7fc132038980 1 -- 172.21.15.123:0/1304090614 wait complete. 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc132038980 1 Processor -- start 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc132038980 1 -- start start 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc132038980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc132038980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f2dc6620 con 0x55f0f2e2aa00 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc12fb53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc12fb53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33692/0 (socket says 172.21.15.123:33692) 2024-03-20T13:38:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.378+0000 7fc12fb53640 1 -- 172.21.15.123:0/2783509774 learned_addr learned my addr 172.21.15.123:0/2783509774 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.382+0000 7fc12fb53640 1 -- 172.21.15.123:0/2783509774 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12000a1c0 con 0x55f0f2e2aa00 2024-03-20T13:38:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.382+0000 7fc12fb53640 1 --2- 172.21.15.123:0/2783509774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa2170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc120017ca0 tx=0x7fc1200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc48bc544568ce50 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc01de0b640 1 -- 172.21.15.123:0/2783509774 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200aa780 con 0x55f0f2e2aa00 2024-03-20T13:38:11.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc01de0b640 1 -- 172.21.15.123:0/2783509774 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1200aa8e0 con 0x55f0f2e2aa00 2024-03-20T13:38:11.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc01de0b640 1 -- 172.21.15.123:0/2783509774 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200aab80 con 0x55f0f2e2aa00 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- 172.21.15.123:0/2783509774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 msgr2=0x55f0f2fa2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 --2- 172.21.15.123:0/2783509774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa2170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc120017ca0 tx=0x7fc1200033b0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- 172.21.15.123:0/2783509774 shutdown_connections 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 --2- 172.21.15.123:0/2783509774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa2170 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- 172.21.15.123:0/2783509774 >> 172.21.15.123:0/2783509774 conn(0x55f0f2eb0790 msgr2=0x55f0f2f9dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- 172.21.15.123:0/2783509774 shutdown_connections 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- 172.21.15.123:0/2783509774 wait complete. 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 Processor -- start 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- start start 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc132038980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f2dc1e00 con 0x55f0f2e2aa00 2024-03-20T13:38:11.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc12fb53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc12fb53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33698/0 (socket says 172.21.15.123:33698) 2024-03-20T13:38:11.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.386+0000 7fc12fb53640 1 -- 172.21.15.123:0/2324999348 learned_addr learned my addr 172.21.15.123:0/2324999348 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc12fb53640 1 -- 172.21.15.123:0/2324999348 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f2eb6ad0 con 0x55f0f2e2aa00 2024-03-20T13:38:11.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc12fb53640 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa8ee0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc120017ca0 tx=0x7fc120017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc017fff640 1 -- 172.21.15.123:0/2324999348 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200c4070 con 0x55f0f2e2aa00 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f2fa9420 con 0x55f0f2e2aa00 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc017fff640 1 -- 172.21.15.123:0/2324999348 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120005150 con 0x55f0f2e2aa00 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc017fff640 1 -- 172.21.15.123:0/2324999348 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc120005410 con 0x55f0f2e2aa00 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f2fa9850 con 0x55f0f2e2aa00 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc132038980 1 Processor -- start 2024-03-20T13:38:11.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc132038980 1 -- start start 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc132038980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fb60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc132038980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f2d5ae30 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc017fff640 1 -- 172.21.15.123:0/2324999348 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc1200a8070 con 0x55f0f2e2aa00 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc130354640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fb60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc130354640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fb60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33708/0 (socket says 172.21.15.123:33708) 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc130354640 1 -- 172.21.15.123:0/3336159172 learned_addr learned my addr 172.21.15.123:0/3336159172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc017fff640 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0180342b0 0x7fc018036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc017fff640 1 -- 172.21.15.123:0/2324999348 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc1200e3350 con 0x55f0f2e2aa00 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc12fb53640 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0180342b0 0x7fc018036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc130354640 1 -- 172.21.15.123:0/3336159172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f2fb6600 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc12fb53640 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0180342b0 0x7fc018036770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc120003430 tx=0x7fc120005570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc130354640 1 --2- 172.21.15.123:0/3336159172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fb60c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc12800a440 tx=0x7fc12800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bd48ca9af86a06 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc015ffb640 1 -- 172.21.15.123:0/3336159172 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc128008850 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc015ffb640 1 -- 172.21.15.123:0/3336159172 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1280089d0 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.390+0000 7fc015ffb640 1 -- 172.21.15.123:0/3336159172 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc128008cb0 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3336159172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 msgr2=0x55f0f2fb60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 --2- 172.21.15.123:0/3336159172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fb60c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc12800a440 tx=0x7fc12800a900 comp rx=0 tx=0).stop 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3336159172 shutdown_connections 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 --2- 172.21.15.123:0/3336159172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fb60c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3336159172 >> 172.21.15.123:0/3336159172 conn(0x55f0f2ebb5f0 msgr2=0x55f0f2fb1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3336159172 shutdown_connections 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3336159172 wait complete. 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 Processor -- start 2024-03-20T13:38:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- start start 2024-03-20T13:38:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fbcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f2d4e790 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc130354640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fbcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc130354640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fbcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33724/0 (socket says 172.21.15.123:33724) 2024-03-20T13:38:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc130354640 1 -- 172.21.15.123:0/3739449216 learned_addr learned my addr 172.21.15.123:0/3739449216 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc130354640 1 -- 172.21.15.123:0/3739449216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128005cd0 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc130354640 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fbcbf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55f0f2fb6a80 tx=0x7fc128003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc00ffff640 1 -- 172.21.15.123:0/3739449216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc128013aa0 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f2fbd130 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc00ffff640 1 -- 172.21.15.123:0/3739449216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc128013c00 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc00ffff640 1 -- 172.21.15.123:0/3739449216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc128013ea0 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f2fbd560 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc00ffff640 1 -- 172.21.15.123:0/3739449216 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc128028460 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc00ffff640 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0080342b0 0x7fc008036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc00ffff640 1 -- 172.21.15.123:0/3739449216 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc128049800 con 0x55f0f2fb5ca0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc12f352640 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0080342b0 0x7fc008036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.394+0000 7fc132038980 1 Processor -- start 2024-03-20T13:38:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 -- start start 2024-03-20T13:38:11.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 0x55f0f2fd6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f2fd71f0 con 0x55f0f2fd6890 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12f352640 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0080342b0 0x7fc008036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55f0f2fb1d50 tx=0x7fc118001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12fb53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 0x55f0f2fd6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12fb53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 0x55f0f2fd6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33738/0 (socket says 172.21.15.123:33738) 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12fb53640 1 -- 172.21.15.123:0/759274133 learned_addr learned my addr 172.21.15.123:0/759274133 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12fb53640 1 -- 172.21.15.123:0/759274133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f2fd7330 con 0x55f0f2fd6890 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12fb53640 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 0x55f0f2fd6cb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc120005f60 tx=0x7fc1200b3630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa7fff640 1 -- 172.21.15.123:0/759274133 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200e7070 con 0x55f0f2fd6890 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f2fd7c90 con 0x55f0f2fd6890 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa7fff640 1 -- 172.21.15.123:0/759274133 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1200d5070 con 0x55f0f2fd6890 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa7fff640 1 -- 172.21.15.123:0/759274133 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1200e1410 con 0x55f0f2fd6890 2024-03-20T13:38:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f2fd80c0 con 0x55f0f2fd6890 2024-03-20T13:38:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa7fff640 1 -- 172.21.15.123:0/759274133 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc1200b5710 con 0x55f0f2fd6890 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa7fff640 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa7fff640 1 -- 172.21.15.123:0/759274133 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc1200d7070 con 0x55f0f2fd6890 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12f352640 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fbfa5ffb640 20 reqs_thread_entry: start 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f2fdb870 0x55f0f2fddc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f2fde1a0 con 0x55f0f2fdb870 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.398+0000 7fc12f352640 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc118000f70 tx=0x7fc11800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc130354640 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f2fdb870 0x55f0f2fddc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc130354640 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f2fdb870 0x55f0f2fddc60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc130354640 1 -- 172.21.15.123:0/2324999348 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc128024020 con 0x55f0f2fdb870 2024-03-20T13:38:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f0f2fdf510 con 0x55f0f2fdb870 2024-03-20T13:38:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc130354640 1 -- 172.21.15.123:0/2324999348 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(2 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc128024020 con 0x55f0f2fdb870 2024-03-20T13:38:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0080342b0 msgr2=0x7fc008036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0080342b0 0x7fc008036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55f0f2fb1d50 tx=0x7fc118001330 comp rx=0 tx=0).stop 2024-03-20T13:38:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 msgr2=0x55f0f2fbcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fbcbf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55f0f2fb6a80 tx=0x7fc128003000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 shutdown_connections 2024-03-20T13:38:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0080342b0 0x7fc008036770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/3739449216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fb5ca0 0x55f0f2fbcbf0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 >> 172.21.15.123:0/3739449216 conn(0x55f0f2ebb5f0 msgr2=0x55f0f2faff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 shutdown_connections 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/3739449216 wait complete. 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 msgr2=0x7fbf70036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc118000f70 tx=0x7fc11800f000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 msgr2=0x55f0f2fd6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 0x55f0f2fd6cb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc120005f60 tx=0x7fc1200b3630 comp rx=0 tx=0).stop 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 shutdown_connections 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fbf700342b0 0x7fbf70036770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 --2- 172.21.15.123:0/759274133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2fd6890 0x55f0f2fd6cb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 >> 172.21.15.123:0/759274133 conn(0x55f0f2fcb5f0 msgr2=0x55f0f2fcc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 shutdown_connections 2024-03-20T13:38:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.402+0000 7fc132038980 1 -- 172.21.15.123:0/759274133 wait complete. 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f2fdb870 msgr2=0x55f0f2fddc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f2fdb870 0x55f0f2fddc60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0180342b0 msgr2=0x7fc018036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0180342b0 0x7fc018036770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc120003430 tx=0x7fc120005570 comp rx=0 tx=0).stop 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 msgr2=0x55f0f2fa8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa8ee0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc120017ca0 tx=0x7fc120017e30 comp rx=0 tx=0).stop 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 shutdown_connections 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f0f2fdb870 0x55f0f2fddc60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fc0180342b0 0x7fc018036770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 --2- 172.21.15.123:0/2324999348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0f2e2aa00 0x55f0f2fa8ee0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 >> 172.21.15.123:0/2324999348 conn(0x55f0f2eb0790 msgr2=0x55f0f2f9c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 shutdown_connections 2024-03-20T13:38:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.406+0000 7fc132038980 1 -- 172.21.15.123:0/2324999348 wait complete. 2024-03-20T13:38:11.419 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:38:11.419 DEBUG:tasks.util.rgw: json result: {'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:38:11.420 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-03-20T13:38:11.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-03-20T13:38:11.420 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-03-20T13:38:11.492 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:11.492 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:11.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1dc38980 1 Processor -- start 2024-03-20T13:38:11.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1dc38980 1 -- start start 2024-03-20T13:38:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1dc38980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f16f56b740 0x55f16f56db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1dc38980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f16f4b1510 con 0x55f16f4d98a0 2024-03-20T13:38:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1dc38980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f16f4780f0 con 0x55f16f56b740 2024-03-20T13:38:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1af52640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f16f56b740 0x55f16f56db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1b753640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f16f4d98a0 0x55f16f56a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59362/0 (socket says 172.21.15.123:59362) 2024-03-20T13:38:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1af52640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f16f56b740 0x55f16f56db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33746/0 (socket says 172.21.15.123:33746) 2024-03-20T13:38:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1b753640 1 -- 172.21.15.123:0/1380459989 learned_addr learned my addr 172.21.15.123:0/1380459989 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:38:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1af52640 1 -- 172.21.15.123:0/1380459989 >> v1:172.21.15.89:6789/0 conn(0x55f16f4d98a0 legacy=0x55f16f56a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.490+0000 7f0c1af52640 1 -- 172.21.15.123:0/1380459989 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16f565a40 con 0x55f16f56b740 2024-03-20T13:38:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1af52640 1 --2- 172.21.15.123:0/1380459989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f56b740 0x55f16f56db30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400a480 tx=0x7f0c0401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e4ac4dc4471533 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1a751640 1 -- 172.21.15.123:0/1380459989 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c040ab540 con 0x55f16f56b740 2024-03-20T13:38:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1a751640 1 -- 172.21.15.123:0/1380459989 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c040ab6a0 con 0x55f16f56b740 2024-03-20T13:38:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1a751640 1 -- 172.21.15.123:0/1380459989 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c040ab960 con 0x55f16f56b740 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1380459989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f56b740 msgr2=0x55f16f56db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/1380459989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f56b740 0x55f16f56db30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400a480 tx=0x7f0c0401b280 comp rx=0 tx=0).stop 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1380459989 shutdown_connections 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/1380459989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f56b740 0x55f16f56db30 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1380459989 >> 172.21.15.123:0/1380459989 conn(0x55f16f55f700 msgr2=0x55f16f561b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1380459989 shutdown_connections 2024-03-20T13:38:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.494+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1380459989 wait complete. 2024-03-20T13:38:11.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 Processor -- start 2024-03-20T13:38:11.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- start start 2024-03-20T13:38:11.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f651070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16f475620 con 0x55f16f4d98a0 2024-03-20T13:38:11.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1b753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f651070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1b753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f651070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33756/0 (socket says 172.21.15.123:33756) 2024-03-20T13:38:11.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1b753640 1 -- 172.21.15.123:0/21671776 learned_addr learned my addr 172.21.15.123:0/21671776 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1b753640 1 -- 172.21.15.123:0/21671776 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04005d30 con 0x55f16f4d98a0 2024-03-20T13:38:11.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1b753640 1 --2- 172.21.15.123:0/21671776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f651070 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0c14006fb0 tx=0x7f0c14001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f04d047edfa74e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0b0960a640 1 -- 172.21.15.123:0/21671776 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c14004530 con 0x55f16f4d98a0 2024-03-20T13:38:11.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0b0960a640 1 -- 172.21.15.123:0/21671776 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c14004690 con 0x55f16f4d98a0 2024-03-20T13:38:11.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0b0960a640 1 -- 172.21.15.123:0/21671776 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c140049b0 con 0x55f16f4d98a0 2024-03-20T13:38:11.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- 172.21.15.123:0/21671776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 msgr2=0x55f16f651070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/21671776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f651070 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0c14006fb0 tx=0x7f0c14001940 comp rx=0 tx=0).stop 2024-03-20T13:38:11.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- 172.21.15.123:0/21671776 shutdown_connections 2024-03-20T13:38:11.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/21671776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f651070 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- 172.21.15.123:0/21671776 >> 172.21.15.123:0/21671776 conn(0x55f16f55f700 msgr2=0x55f16f64cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- 172.21.15.123:0/21671776 shutdown_connections 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- 172.21.15.123:0/21671776 wait complete. 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 Processor -- start 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.510+0000 7f0c1dc38980 1 -- start start 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f657ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16f470e00 con 0x55f16f4d98a0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f657ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f657ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33762/0 (socket says 172.21.15.123:33762) 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 learned_addr learned my addr 172.21.15.123:0/3717219833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16f4b1510 con 0x55f16f4d98a0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f657ec0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55f16f651f00 tx=0x7f0c14000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b07e07640 1 -- 172.21.15.123:0/3717219833 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c14013760 con 0x55f16f4d98a0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f16f658400 con 0x55f16f4d98a0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b07e07640 1 -- 172.21.15.123:0/3717219833 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c140138c0 con 0x55f16f4d98a0 2024-03-20T13:38:11.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b07e07640 1 -- 172.21.15.123:0/3717219833 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c14013b60 con 0x55f16f4d98a0 2024-03-20T13:38:11.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f16f658830 con 0x55f16f4d98a0 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 Processor -- start 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 -- start start 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f6650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1dc38980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16f409e30 con 0x55f16f664cc0 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1bf54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f6650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b07e07640 1 -- 172.21.15.123:0/3717219833 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0c14028460 con 0x55f16f4d98a0 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1bf54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f6650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33766/0 (socket says 172.21.15.123:33766) 2024-03-20T13:38:11.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1bf54640 1 -- 172.21.15.123:0/2683608899 learned_addr learned my addr 172.21.15.123:0/2683608899 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b07e07640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0b000342b0 0x7f0b00036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b07e07640 1 -- 172.21.15.123:0/3717219833 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0c140496b0 con 0x55f16f4d98a0 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0b000342b0 0x7f0b00036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1bf54640 1 -- 172.21.15.123:0/2683608899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16f665620 con 0x55f16f664cc0 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1bf54640 1 --2- 172.21.15.123:0/2683608899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f6650e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00a440 tx=0x7f0c0c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b755916ac828932d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0c1b753640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0b000342b0 0x7f0b00036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0c14001ee0 tx=0x7f0c14001e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.514+0000 7f0b05e03640 1 -- 172.21.15.123:0/2683608899 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c0c008850 con 0x55f16f664cc0 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0b05e03640 1 -- 172.21.15.123:0/2683608899 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c0089d0 con 0x55f16f664cc0 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0b05e03640 1 -- 172.21.15.123:0/2683608899 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c0c008cb0 con 0x55f16f664cc0 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/2683608899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 msgr2=0x55f16f6650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/2683608899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f6650e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00a440 tx=0x7f0c0c00a900 comp rx=0 tx=0).stop 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/2683608899 shutdown_connections 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/2683608899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f6650e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/2683608899 >> 172.21.15.123:0/2683608899 conn(0x55f16f56b740 msgr2=0x55f16f660130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/2683608899 shutdown_connections 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/2683608899 wait complete. 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 Processor -- start 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- start start 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f66bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16f3fd790 con 0x55f16f664cc0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1bf54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f66bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1bf54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f66bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33782/0 (socket says 172.21.15.123:33782) 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1bf54640 1 -- 172.21.15.123:0/1614761881 learned_addr learned my addr 172.21.15.123:0/1614761881 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1bf54640 1 -- 172.21.15.123:0/1614761881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c005cd0 con 0x55f16f664cc0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1bf54640 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f66bc10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55f16f665aa0 tx=0x7f0c0c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0af7fff640 1 -- 172.21.15.123:0/1614761881 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c0c013aa0 con 0x55f16f664cc0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f16f66c150 con 0x55f16f664cc0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0af7fff640 1 -- 172.21.15.123:0/1614761881 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c013c00 con 0x55f16f664cc0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f16f66c580 con 0x55f16f664cc0 2024-03-20T13:38:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0af7fff640 1 -- 172.21.15.123:0/1614761881 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c0c013ea0 con 0x55f16f664cc0 2024-03-20T13:38:11.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0af7fff640 1 -- 172.21.15.123:0/1614761881 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0c0c01e420 con 0x55f16f664cc0 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0af7fff640 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0afc0342b0 0x7f0afc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.518+0000 7f0c1dc38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0af7fff640 1 -- 172.21.15.123:0/1614761881 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0c0c049a50 con 0x55f16f664cc0 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1af52640 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0afc0342b0 0x7f0afc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 Processor -- start 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 -- start start 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1af52640 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0afc0342b0 0x7f0afc036770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad000 tx=0x7f0c040a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 0x55f16f685cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16f6861f0 con 0x55f16f685890 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1b753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 0x55f16f685cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1b753640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 0x55f16f685cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33792/0 (socket says 172.21.15.123:33792) 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1b753640 1 -- 172.21.15.123:0/154673901 learned_addr learned my addr 172.21.15.123:0/154673901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1b753640 1 -- 172.21.15.123:0/154673901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16f686330 con 0x55f16f685890 2024-03-20T13:38:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1b753640 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 0x55f16f685cb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0c1401db00 tx=0x7f0c14011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a8bfff640 1 -- 172.21.15.123:0/154673901 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c14012840 con 0x55f16f685890 2024-03-20T13:38:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f16f686cb0 con 0x55f16f685890 2024-03-20T13:38:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a8bfff640 1 -- 172.21.15.123:0/154673901 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c14038070 con 0x55f16f685890 2024-03-20T13:38:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a8bfff640 1 -- 172.21.15.123:0/154673901 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c14012600 con 0x55f16f685890 2024-03-20T13:38:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f16f686cb0 con 0x55f16f685890 2024-03-20T13:38:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a8bfff640 1 -- 172.21.15.123:0/154673901 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0c14028920 con 0x55f16f685890 2024-03-20T13:38:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a8bfff640 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a5c034300 0x7f0a5c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a8bfff640 1 -- 172.21.15.123:0/154673901 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0c1403a070 con 0x55f16f685890 2024-03-20T13:38:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1af52640 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a5c034300 0x7f0a5c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0a89ffb640 20 reqs_thread_entry: start 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f16f68a890 0x55f16f68cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.522+0000 7f0c1af52640 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a5c034300 0x7f0a5c0367c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ab670 tx=0x7f0c04005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f68d1c0 con 0x55f16f68a890 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1bf54640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f16f68a890 0x55f16f68cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1bf54640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f16f68a890 0x55f16f68cc80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f16f68da30 0x55f16f68fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f690460 con 0x55f16f68da30 2024-03-20T13:38:11.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1b753640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f16f68da30 0x55f16f68fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1b753640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f16f68da30 0x55f16f68fe20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f691cc0 con 0x55f16f68da30 2024-03-20T13:38:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f6979e0 con 0x55f16f68a890 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:NOTICE: set zone's realm_id= 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f16f69ba10 0x55f16f697270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.526+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1af52640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f16f69ba10 0x55f16f697270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1af52640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f16f69ba10 0x55f16f697270 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1b753640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0c14041040 0x7f0c1400a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x7f0c14041040 2024-03-20T13:38:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0c14041040 0x7f0c1400a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0c14041040 0x7f0c1400a450 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x7f0c14041040 2024-03-20T13:38:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.530+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x7f0c14041040 2024-03-20T13:38:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x7f0c14041040 2024-03-20T13:38:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(16 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x7f0c14041040 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0c0c024020 con 0x7f0c14041040 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.534+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x7f0c14041040 2024-03-20T13:38:11.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x7f0c14041040 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68a890 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x7f0c14041040 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x7f0c14041040 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x7f0c14041040 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c0c024020 con 0x7f0c14041040 2024-03-20T13:38:11.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f69ba10 2024-03-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c040c7040 con 0x55f16f69ba10 2024-03-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.538+0000 7f0c1af52640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f698fe0 con 0x55f16f68da30 2024-03-20T13:38:11.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f692020 con 0x55f16f68da30 2024-03-20T13:38:11.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:38 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f692380 con 0x55f16f68da30 2024-03-20T13:38:11.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(38 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.542+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [create,call version.set in=58b,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f696da0 con 0x55f16f68da30 2024-03-20T13:38:11.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.546+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(39 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [create,call,writefull 0~1036] v34'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.546+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f694ae0 con 0x55f16f68da30 2024-03-20T13:38:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.546+0000 7f0c1b753640 1 -- 172.21.15.123:0/3717219833 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f0c1404f070 con 0x55f16f68da30 2024-03-20T13:38:11.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.546+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55f16f694ae0 con 0x55f16f68a890 2024-03-20T13:38:11.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f0c0c024020 con 0x55f16f68a890 2024-03-20T13:38:11.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0afc0342b0 msgr2=0x7f0afc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0afc0342b0 0x7f0afc036770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad000 tx=0x7f0c040a5040 comp rx=0 tx=0).stop 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 msgr2=0x55f16f66bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f66bc10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55f16f665aa0 tx=0x7f0c0c003000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 shutdown_connections 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0afc0342b0 0x7f0afc036770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/1614761881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f664cc0 0x55f16f66bc10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 >> 172.21.15.123:0/1614761881 conn(0x55f16f56b740 msgr2=0x55f16f65ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 shutdown_connections 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/1614761881 wait complete. 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a5c034300 msgr2=0x7f0a5c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a5c034300 0x7f0a5c0367c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ab670 tx=0x7f0c04005a10 comp rx=0 tx=0).stop 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 msgr2=0x55f16f685cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 0x55f16f685cb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0c1401db00 tx=0x7f0c14011b80 comp rx=0 tx=0).stop 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 shutdown_connections 2024-03-20T13:38:11.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0a5c034300 0x7f0a5c0367c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/154673901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f685890 0x55f16f685cb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 >> 172.21.15.123:0/154673901 conn(0x55f16f67a5d0 msgr2=0x55f16f67aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 shutdown_connections 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/154673901 wait complete. 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f16f68da30 msgr2=0x55f16f68fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55f16f68da30 0x55f16f68fe20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f16f68a890 msgr2=0x55f16f68cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55f16f68a890 0x55f16f68cc80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0c14041040 msgr2=0x7f0c1400a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f0c14041040 0x7f0c1400a450 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f16f69ba10 msgr2=0x55f16f697270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55f16f69ba10 0x55f16f697270 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0b000342b0 msgr2=0x7f0b00036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f0b000342b0 0x7f0b00036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0c14001ee0 tx=0x7f0c14001e70 comp rx=0 tx=0).stop 2024-03-20T13:38:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 msgr2=0x55f16f657ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 --2- 172.21.15.123:0/3717219833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f16f4d98a0 0x55f16f657ec0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55f16f651f00 tx=0x7f0c14000f50 comp rx=0 tx=0).stop 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 reap_dead start 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1bf54640 1 -- 172.21.15.123:0/3717219833 reap_dead start 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 shutdown_connections 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 >> 172.21.15.123:0/3717219833 conn(0x55f16f55f700 msgr2=0x55f16f64b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 shutdown_connections 2024-03-20T13:38:11.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.550+0000 7f0c1dc38980 1 -- 172.21.15.123:0/3717219833 wait complete. 2024-03-20T13:38:11.566 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:38:11.566 DEBUG:tasks.util.rgw: json result: {'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:38:11.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-03-20T13:38:11.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-03-20T13:38:11.567 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-03-20T13:38:11.636 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01cbfcf980 1 Processor -- start 2024-03-20T13:38:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01cbfcf980 1 -- start start 2024-03-20T13:38:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01cbfcf980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560db4b348e0 0x560db4bc4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01cbfcf980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560db4b0c510 con 0x560db4bc5520 2024-03-20T13:38:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01cbfcf980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x560db4ad30f0 con 0x560db4b348e0 2024-03-20T13:38:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01c9aea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560db4b348e0 0x560db4bc4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01c9aea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560db4b348e0 0x560db4bc4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33800/0 (socket says 172.21.15.123:33800) 2024-03-20T13:38:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01c9aea640 1 -- 172.21.15.123:0/1122070331 learned_addr learned my addr 172.21.15.123:0/1122070331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01c9aea640 1 -- 172.21.15.123:0/1122070331 >> v1:172.21.15.89:6789/0 conn(0x560db4bc5520 legacy=0x560db4bc7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.634+0000 7f01c9aea640 1 -- 172.21.15.123:0/1122070331 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560db4bca040 con 0x560db4b348e0 2024-03-20T13:38:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01c9aea640 1 --2- 172.21.15.123:0/1122070331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4bc4fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00a5c0 tx=0x7f01bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f001ae2a3cb6713 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01c8ae8640 1 -- 172.21.15.123:0/1122070331 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0aa470 con 0x560db4b348e0 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01c8ae8640 1 -- 172.21.15.123:0/1122070331 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0aa5d0 con 0x560db4b348e0 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01c8ae8640 1 -- 172.21.15.123:0/1122070331 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0aa890 con 0x560db4b348e0 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 -- 172.21.15.123:0/1122070331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 msgr2=0x560db4bc4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/1122070331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4bc4fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00a5c0 tx=0x7f01bc01b340 comp rx=0 tx=0).stop 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 -- 172.21.15.123:0/1122070331 shutdown_connections 2024-03-20T13:38:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/1122070331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4bc4fe0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 -- 172.21.15.123:0/1122070331 >> 172.21.15.123:0/1122070331 conn(0x560db4bba700 msgr2=0x560db4bbcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 -- 172.21.15.123:0/1122070331 shutdown_connections 2024-03-20T13:38:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.638+0000 7f01cbfcf980 1 -- 172.21.15.123:0/1122070331 wait complete. 2024-03-20T13:38:11.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01cbfcf980 1 Processor -- start 2024-03-20T13:38:11.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01cbfcf980 1 -- start start 2024-03-20T13:38:11.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01cbfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01cbfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db4ad0620 con 0x560db4b348e0 2024-03-20T13:38:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01c9aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01c9aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33810/0 (socket says 172.21.15.123:33810) 2024-03-20T13:38:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01c9aea640 1 -- 172.21.15.123:0/3790721205 learned_addr learned my addr 172.21.15.123:0/3790721205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01c9aea640 1 -- 172.21.15.123:0/3790721205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc005df0 con 0x560db4b348e0 2024-03-20T13:38:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f01c9aea640 1 --2- 172.21.15.123:0/3790721205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cac030 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f01bc018f70 tx=0x7f01bc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a7fc806ec722ac server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f00b7e07640 1 -- 172.21.15.123:0/3790721205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0aa9c0 con 0x560db4b348e0 2024-03-20T13:38:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f00b7e07640 1 -- 172.21.15.123:0/3790721205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0aab20 con 0x560db4b348e0 2024-03-20T13:38:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.654+0000 7f00b7e07640 1 -- 172.21.15.123:0/3790721205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0aadc0 con 0x560db4b348e0 2024-03-20T13:38:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/3790721205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 msgr2=0x560db4cac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/3790721205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cac030 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f01bc018f70 tx=0x7f01bc003030 comp rx=0 tx=0).stop 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/3790721205 shutdown_connections 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/3790721205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cac030 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/3790721205 >> 172.21.15.123:0/3790721205 conn(0x560db4bba700 msgr2=0x560db4ca7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/3790721205 shutdown_connections 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/3790721205 wait complete. 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 Processor -- start 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- start start 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cb2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db4acbe00 con 0x560db4b348e0 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01c9aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cb2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01c9aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cb2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33822/0 (socket says 172.21.15.123:33822) 2024-03-20T13:38:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01c9aea640 1 -- 172.21.15.123:0/357196000 learned_addr learned my addr 172.21.15.123:0/357196000 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01c9aea640 1 -- 172.21.15.123:0/357196000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560db4bca040 con 0x560db4b348e0 2024-03-20T13:38:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01c9aea640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cb2d80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f01bc018f70 tx=0x7f01bc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f00b6604640 1 -- 172.21.15.123:0/357196000 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0cb070 con 0x560db4b348e0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560db4cb32c0 con 0x560db4b348e0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f00b6604640 1 -- 172.21.15.123:0/357196000 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0bd810 con 0x560db4b348e0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f00b6604640 1 -- 172.21.15.123:0/357196000 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0bdab0 con 0x560db4b348e0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560db4cb3690 con 0x560db4b348e0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 Processor -- start 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- start start 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cbfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01cbfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db4a64e30 con 0x560db4cbfa90 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f00b6604640 1 -- 172.21.15.123:0/357196000 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f01bc0bdc10 con 0x560db4b348e0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f00b6604640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00b00342b0 0x7f00b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01ca2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cbfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01ca2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cbfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33826/0 (socket says 172.21.15.123:33826) 2024-03-20T13:38:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01ca2eb640 1 -- 172.21.15.123:0/2385261351 learned_addr learned my addr 172.21.15.123:0/2385261351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f00b6604640 1 -- 172.21.15.123:0/357196000 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f01bc0e4b60 con 0x560db4b348e0 2024-03-20T13:38:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.658+0000 7f01c9aea640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00b00342b0 0x7f00b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 -- 172.21.15.123:0/2385261351 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560db4cc03f0 con 0x560db4cbfa90 2024-03-20T13:38:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01c9aea640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00b00342b0 0x7f00b0036770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0e2f10 tx=0x7f01bc0d0f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 --2- 172.21.15.123:0/2385261351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cbfeb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f01c400a430 tx=0x7f01c400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da23a87f4d9d98b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f00affff640 1 -- 172.21.15.123:0/2385261351 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c400f6e0 con 0x560db4cbfa90 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f00affff640 1 -- 172.21.15.123:0/2385261351 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400f860 con 0x560db4cbfa90 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f00affff640 1 -- 172.21.15.123:0/2385261351 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c400fb40 con 0x560db4cbfa90 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2385261351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 msgr2=0x560db4cbfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/2385261351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cbfeb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f01c400a430 tx=0x7f01c400a8f0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2385261351 shutdown_connections 2024-03-20T13:38:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/2385261351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cbfeb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2385261351 >> 172.21.15.123:0/2385261351 conn(0x560db4bc5520 msgr2=0x560db4cbaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2385261351 shutdown_connections 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2385261351 wait complete. 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 Processor -- start 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- start start 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cc6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db4a58790 con 0x560db4cbfa90 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cc6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cc6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33838/0 (socket says 172.21.15.123:33838) 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 -- 172.21.15.123:0/708791360 learned_addr learned my addr 172.21.15.123:0/708791360 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 -- 172.21.15.123:0/708791360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c400a0e0 con 0x560db4cbfa90 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01ca2eb640 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cc6aa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f01c400a3d0 tx=0x7f01c4003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f00ae7fc640 1 -- 172.21.15.123:0/708791360 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c40109a0 con 0x560db4cbfa90 2024-03-20T13:38:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560db4cc6fe0 con 0x560db4cbfa90 2024-03-20T13:38:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f00ae7fc640 1 -- 172.21.15.123:0/708791360 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4010b00 con 0x560db4cbfa90 2024-03-20T13:38:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f00ae7fc640 1 -- 172.21.15.123:0/708791360 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c4010e40 con 0x560db4cbfa90 2024-03-20T13:38:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.662+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560db4cc7470 con 0x560db4cbfa90 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f00ae7fc640 1 -- 172.21.15.123:0/708791360 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f01c401a480 con 0x560db4cbfa90 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f00ae7fc640 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00a40342b0 0x7f00a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 1 Processor -- start 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f00ae7fc640 1 -- 172.21.15.123:0/708791360 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f01c4049fe0 con 0x560db4cbfa90 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01ca2eb640 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00a40342b0 0x7f00a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 1 -- start start 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 0x560db4ce0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db4ce1160 con 0x560db4ce0800 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01ca2eb640 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00a40342b0 0x7f00a4036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01c402dfd0 tx=0x7f01c402dea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01c9aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 0x560db4ce0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01c9aea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 0x560db4ce0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33854/0 (socket says 172.21.15.123:33854) 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01c9aea640 1 -- 172.21.15.123:0/2547453477 learned_addr learned my addr 172.21.15.123:0/2547453477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01c9aea640 1 -- 172.21.15.123:0/2547453477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560db4ce12a0 con 0x560db4ce0800 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01c9aea640 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 0x560db4ce0c20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0a6fd0 tx=0x7f01bc0e2ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f008e7e4640 1 -- 172.21.15.123:0/2547453477 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0e9070 con 0x560db4ce0800 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f008e7e4640 1 -- 172.21.15.123:0/2547453477 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0c7590 con 0x560db4ce0800 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560db4ce1bf0 con 0x560db4ce0800 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f008e7e4640 1 -- 172.21.15.123:0/2547453477 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01bc0cf7b0 con 0x560db4ce0800 2024-03-20T13:38:11.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560db4ce2080 con 0x560db4ce0800 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.666+0000 7f008e7e4640 1 -- 172.21.15.123:0/2547453477 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f01bc0c7b80 con 0x560db4ce0800 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f008e7e4640 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f000c0342b0 0x7f000c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f008e7e4640 1 -- 172.21.15.123:0/2547453477 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f01bc0e1030 con 0x560db4ce0800 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01c92e9640 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f000c0342b0 0x7f000c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7efffffff640 20 reqs_thread_entry: start 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560db4ce57d0 0x560db4ce7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560db4ce8100 con 0x560db4ce57d0 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01c92e9640 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f000c0342b0 0x7f000c036770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f01b4000f70 tx=0x7f01b40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01ca2eb640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560db4ce57d0 0x560db4ce7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01ca2eb640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560db4ce57d0 0x560db4ce7bc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01ca2eb640 1 -- 172.21.15.123:0/357196000 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01c4016020 con 0x560db4ce57d0 2024-03-20T13:38:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560db4ce8a00 0x560db4ceaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560db4ceb630 con 0x560db4ce8a00 2024-03-20T13:38:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01c9aea640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560db4ce8a00 0x560db4ceaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01c9aea640 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560db4ce8a00 0x560db4ceaec0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01c9aea640 1 -- 172.21.15.123:0/357196000 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f01bc0cd070 con 0x560db4ce8a00 2024-03-20T13:38:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.670+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x560db4cece40 con 0x560db4ce8a00 2024-03-20T13:38:11.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01c9aea640 1 -- 172.21.15.123:0/357196000 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7f01bc0cd070 con 0x560db4ce8a00 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00a40342b0 msgr2=0x7f00a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00a40342b0 0x7f00a4036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01c402dfd0 tx=0x7f01c402dea0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 msgr2=0x560db4cc6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cc6aa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f01c400a3d0 tx=0x7f01c4003380 comp rx=0 tx=0).stop 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 shutdown_connections 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00a40342b0 0x7f00a4036770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/708791360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4cbfa90 0x560db4cc6aa0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 >> 172.21.15.123:0/708791360 conn(0x560db4bc5520 msgr2=0x560db4cb9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 shutdown_connections 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/708791360 wait complete. 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f000c0342b0 msgr2=0x7f000c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f000c0342b0 0x7f000c036770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f01b4000f70 tx=0x7f01b40013a0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 msgr2=0x560db4ce0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 0x560db4ce0c20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0a6fd0 tx=0x7f01bc0e2ea0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 shutdown_connections 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f000c0342b0 0x7f000c036770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/2547453477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4ce0800 0x560db4ce0c20 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 >> 172.21.15.123:0/2547453477 conn(0x560db4cd5520 msgr2=0x560db4cd5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 shutdown_connections 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/2547453477 wait complete. 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560db4ce8a00 msgr2=0x560db4ceaec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560db4ce8a00 0x560db4ceaec0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560db4ce57d0 msgr2=0x560db4ce7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560db4ce57d0 0x560db4ce7bc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00b00342b0 msgr2=0x7f00b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00b00342b0 0x7f00b0036770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0e2f10 tx=0x7f01bc0d0f70 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 msgr2=0x560db4cb2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cb2d80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f01bc018f70 tx=0x7f01bc0180e0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 shutdown_connections 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x560db4ce8a00 0x560db4ceaec0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x560db4ce57d0 0x560db4ce7bc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f00b00342b0 0x7f00b0036770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 --2- 172.21.15.123:0/357196000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560db4b348e0 0x560db4cb2d80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 >> 172.21.15.123:0/357196000 conn(0x560db4bba700 msgr2=0x560db4ca66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 shutdown_connections 2024-03-20T13:38:11.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.674+0000 7f01cbfcf980 1 -- 172.21.15.123:0/357196000 wait complete. 2024-03-20T13:38:11.689 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:38:11.689 DEBUG:tasks.util.rgw: json result: {'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:38:11.689 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:38:11.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:38:11.690 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-03-20T13:38:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa518691980 1 Processor -- start 2024-03-20T13:38:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa518691980 1 -- start start 2024-03-20T13:38:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa518691980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558b47056450 0x558b47058840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa518691980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558b46f9e4c0 con 0x558b47051f90 2024-03-20T13:38:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa518691980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558b46f650f0 con 0x558b47056450 2024-03-20T13:38:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa5159ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558b47056450 0x558b47058840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa5159ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558b47056450 0x558b47058840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33856/0 (socket says 172.21.15.123:33856) 2024-03-20T13:38:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa5159ab640 1 -- 172.21.15.123:0/458452080 learned_addr learned my addr 172.21.15.123:0/458452080 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa5161ac640 1 --1- 172.21.15.123:0/458452080 >> v1:172.21.15.89:6789/0 conn(0x558b47051f90 0x558b47052370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59386/0 (socket says 172.21.15.123:59386) 2024-03-20T13:38:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa5159ab640 1 -- 172.21.15.123:0/458452080 >> v1:172.21.15.89:6789/0 conn(0x558b47051f90 legacy=0x558b47052370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.762+0000 7fa5159ab640 1 -- 172.21.15.123:0/458452080 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b47059d90 con 0x558b47056450 2024-03-20T13:38:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa5159ab640 1 --2- 172.21.15.123:0/458452080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47056450 0x558b47058840 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa50800a5c0 tx=0x7fa50801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a85f1e33598d4b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa5151aa640 1 -- 172.21.15.123:0/458452080 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5080aa470 con 0x558b47056450 2024-03-20T13:38:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa5151aa640 1 -- 172.21.15.123:0/458452080 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080aa5d0 con 0x558b47056450 2024-03-20T13:38:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa5151aa640 1 -- 172.21.15.123:0/458452080 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5080aa890 con 0x558b47056450 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 -- 172.21.15.123:0/458452080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47056450 msgr2=0x558b47058840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 --2- 172.21.15.123:0/458452080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47056450 0x558b47058840 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa50800a5c0 tx=0x7fa50801b340 comp rx=0 tx=0).stop 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 -- 172.21.15.123:0/458452080 shutdown_connections 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 --2- 172.21.15.123:0/458452080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47056450 0x558b47058840 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 -- 172.21.15.123:0/458452080 >> 172.21.15.123:0/458452080 conn(0x558b4704d860 msgr2=0x558b4704fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 -- 172.21.15.123:0/458452080 shutdown_connections 2024-03-20T13:38:11.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.766+0000 7fa518691980 1 -- 172.21.15.123:0/458452080 wait complete. 2024-03-20T13:38:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 Processor -- start 2024-03-20T13:38:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- start start 2024-03-20T13:38:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b4713bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46f62620 con 0x558b47051f90 2024-03-20T13:38:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b4713bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b4713bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33872/0 (socket says 172.21.15.123:33872) 2024-03-20T13:38:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 -- 172.21.15.123:0/2331632986 learned_addr learned my addr 172.21.15.123:0/2331632986 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 -- 172.21.15.123:0/2331632986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508005df0 con 0x558b47051f90 2024-03-20T13:38:11.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 --2- 172.21.15.123:0/2331632986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b4713bf00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa500001cc0 tx=0x7fa50000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99ce3b78fe418d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa403616640 1 -- 172.21.15.123:0/2331632986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa500014070 con 0x558b47051f90 2024-03-20T13:38:11.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa403616640 1 -- 172.21.15.123:0/2331632986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000f590 con 0x558b47051f90 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa403616640 1 -- 172.21.15.123:0/2331632986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa500007040 con 0x558b47051f90 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- 172.21.15.123:0/2331632986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 msgr2=0x558b4713bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 --2- 172.21.15.123:0/2331632986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b4713bf00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa500001cc0 tx=0x7fa50000b610 comp rx=0 tx=0).stop 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- 172.21.15.123:0/2331632986 shutdown_connections 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 --2- 172.21.15.123:0/2331632986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b4713bf00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- 172.21.15.123:0/2331632986 >> 172.21.15.123:0/2331632986 conn(0x558b4704d860 msgr2=0x558b47137a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- 172.21.15.123:0/2331632986 shutdown_connections 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- 172.21.15.123:0/2331632986 wait complete. 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 Processor -- start 2024-03-20T13:38:11.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- start start 2024-03-20T13:38:11.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b47142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa518691980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46f5de00 con 0x558b47051f90 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b47142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b47142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33874/0 (socket says 172.21.15.123:33874) 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.782+0000 7fa5161ac640 1 -- 172.21.15.123:0/2348199211 learned_addr learned my addr 172.21.15.123:0/2348199211 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5161ac640 1 -- 172.21.15.123:0/2348199211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b46f9e4c0 con 0x558b47051f90 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5161ac640 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b47142e70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x558b4713cd90 tx=0x7fa500000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa401e13640 1 -- 172.21.15.123:0/2348199211 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa500014030 con 0x558b47051f90 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa401e13640 1 -- 172.21.15.123:0/2348199211 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50001c840 con 0x558b47051f90 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b471433b0 con 0x558b47051f90 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa401e13640 1 -- 172.21.15.123:0/2348199211 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa50001cb40 con 0x558b47051f90 2024-03-20T13:38:11.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b471437e0 con 0x558b47051f90 2024-03-20T13:38:11.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 Processor -- start 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- start start 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b47150030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46ef6e30 con 0x558b4714fc10 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5169ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b47150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5169ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b47150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33876/0 (socket says 172.21.15.123:33876) 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa401e13640 1 -- 172.21.15.123:0/2348199211 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa50001cca0 con 0x558b47051f90 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5169ad640 1 -- 172.21.15.123:0/2893394523 learned_addr learned my addr 172.21.15.123:0/2893394523 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa401e13640 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3fc0342b0 0x7fa3fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa401e13640 1 -- 172.21.15.123:0/2348199211 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa500006070 con 0x558b47051f90 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5161ac640 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3fc0342b0 0x7fa3fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5169ad640 1 -- 172.21.15.123:0/2893394523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b47150570 con 0x558b4714fc10 2024-03-20T13:38:11.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5169ad640 1 --2- 172.21.15.123:0/2893394523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b47150030 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa51000a430 tx=0x7fa51000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7fee6489fb13a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa5161ac640 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3fc0342b0 0x7fa3fc036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa500017930 tx=0x7fa50001cf50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa3fb7fe640 1 -- 172.21.15.123:0/2893394523 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa51000f6e0 con 0x558b4714fc10 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa3fb7fe640 1 -- 172.21.15.123:0/2893394523 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51000f860 con 0x558b4714fc10 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa3fb7fe640 1 -- 172.21.15.123:0/2893394523 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa51000fb40 con 0x558b4714fc10 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2893394523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 msgr2=0x558b47150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 --2- 172.21.15.123:0/2893394523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b47150030 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa51000a430 tx=0x7fa51000a8f0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2893394523 shutdown_connections 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 --2- 172.21.15.123:0/2893394523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b47150030 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2893394523 >> 172.21.15.123:0/2893394523 conn(0x558b47056450 msgr2=0x558b4714b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2893394523 shutdown_connections 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.786+0000 7fa518691980 1 -- 172.21.15.123:0/2893394523 wait complete. 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 Processor -- start 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 -- start start 2024-03-20T13:38:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b46fc89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46eea790 con 0x558b4714fc10 2024-03-20T13:38:11.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5169ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b46fc89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5169ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b46fc89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33878/0 (socket says 172.21.15.123:33878) 2024-03-20T13:38:11.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5169ad640 1 -- 172.21.15.123:0/2647216528 learned_addr learned my addr 172.21.15.123:0/2647216528 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5169ad640 1 -- 172.21.15.123:0/2647216528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51000a0e0 con 0x558b4714fc10 2024-03-20T13:38:11.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5169ad640 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b46fc89f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x558b471509f0 tx=0x7fa510003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa3f9ffb640 1 -- 172.21.15.123:0/2647216528 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa510010a20 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa3f9ffb640 1 -- 172.21.15.123:0/2647216528 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa510010b80 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b46fc8f30 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa3f9ffb640 1 -- 172.21.15.123:0/2647216528 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa51001a480 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b46fc7410 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa3f9ffb640 1 -- 172.21.15.123:0/2647216528 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa51001a6f0 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa3f9ffb640 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3ec0342b0 0x7fa3ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa3f9ffb640 1 -- 172.21.15.123:0/2647216528 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa510049e70 con 0x558b4714fc10 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 Processor -- start 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5159ab640 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3ec0342b0 0x7fa3ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 -- start start 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 0x558b47172ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa518691980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b47173400 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5159ab640 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3ec0342b0 0x7fa3ec036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa5080ae000 tx=0x7fa5080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.790+0000 7fa5161ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 0x558b47172ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5161ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 0x558b47172ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33884/0 (socket says 172.21.15.123:33884) 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5161ac640 1 -- 172.21.15.123:0/1838444867 learned_addr learned my addr 172.21.15.123:0/1838444867 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5161ac640 1 -- 172.21.15.123:0/1838444867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b47173540 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5161ac640 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 0x558b47172ec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa50000ff30 tx=0x7fa500017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3d9fe3640 1 -- 172.21.15.123:0/1838444867 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa500035070 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3d9fe3640 1 -- 172.21.15.123:0/1838444867 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500019350 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b47173ea0 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3d9fe3640 1 -- 172.21.15.123:0/1838444867 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa50000e3c0 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b471742d0 con 0x558b47172aa0 2024-03-20T13:38:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3d9fe3640 1 -- 172.21.15.123:0/1838444867 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa5000110e0 con 0x558b47172aa0 2024-03-20T13:38:11.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3d9fe3640 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3580342a0 0x7fa358036760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3d9fe3640 1 -- 172.21.15.123:0/1838444867 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa500030070 con 0x558b47172aa0 2024-03-20T13:38:11.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5159ab640 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3580342a0 0x7fa358036760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa3537fe640 20 reqs_thread_entry: start 2024-03-20T13:38:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558b47177a80 0x558b47179e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x558b4717a3b0 con 0x558b47177a80 2024-03-20T13:38:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5159ab640 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3580342a0 0x7fa358036760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa508005940 tx=0x7fa508005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5169ad640 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558b47177a80 0x558b47179e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.794+0000 7fa5169ad640 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558b47177a80 0x558b47179e70 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.798+0000 7fa5169ad640 1 -- 172.21.15.123:0/2348199211 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa510016020 con 0x558b47177a80 2024-03-20T13:38:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.798+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x558b4717bbc0 con 0x558b47177a80 2024-03-20T13:38:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.798+0000 7fa5169ad640 1 -- 172.21.15.123:0/2348199211 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(2 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7fa510034450 con 0x558b47177a80 2024-03-20T13:38:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.798+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x558b47180440 con 0x558b47177a80 2024-03-20T13:38:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.798+0000 7fa5169ad640 1 -- 172.21.15.123:0/2348199211 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [stat,call,call,writefull 0~874] v34'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7fa510034040 con 0x558b47177a80 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3ec0342b0 msgr2=0x7fa3ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3ec0342b0 0x7fa3ec036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa5080ae000 tx=0x7fa5080a6000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 msgr2=0x558b46fc89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b46fc89f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x558b471509f0 tx=0x7fa510003380 comp rx=0 tx=0).stop 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 shutdown_connections 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3ec0342b0 0x7fa3ec036770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2647216528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b4714fc10 0x558b46fc89f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 >> 172.21.15.123:0/2647216528 conn(0x558b47056450 msgr2=0x558b47149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 shutdown_connections 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2647216528 wait complete. 2024-03-20T13:38:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3580342a0 msgr2=0x7fa358036760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3580342a0 0x7fa358036760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa508005940 tx=0x7fa508005ad0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 msgr2=0x558b47172ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 0x558b47172ec0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa50000ff30 tx=0x7fa500017d70 comp rx=0 tx=0).stop 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 shutdown_connections 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3580342a0 0x7fa358036760 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/1838444867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47172aa0 0x558b47172ec0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 >> 172.21.15.123:0/1838444867 conn(0x558b47167820 msgr2=0x558b47168240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 shutdown_connections 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/1838444867 wait complete. 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558b47177a80 msgr2=0x558b47179e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558b47177a80 0x558b47179e70 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3fc0342b0 msgr2=0x7fa3fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3fc0342b0 0x7fa3fc036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa500017930 tx=0x7fa50001cf50 comp rx=0 tx=0).stop 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 msgr2=0x558b47142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b47142e70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x558b4713cd90 tx=0x7fa500000bd0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 shutdown_connections 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x558b47177a80 0x558b47179e70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fa3fc0342b0 0x7fa3fc036770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 --2- 172.21.15.123:0/2348199211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558b47051f90 0x558b47142e70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 >> 172.21.15.123:0/2348199211 conn(0x558b4704d860 msgr2=0x558b471365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 shutdown_connections 2024-03-20T13:38:11.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.802+0000 7fa518691980 1 -- 172.21.15.123:0/2348199211 wait complete. 2024-03-20T13:38:11.816 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:38:11.816 DEBUG:tasks.util.rgw: json result: {'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:38:11.816 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-03-20T13:38:11.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-03-20T13:38:11.817 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-03-20T13:38:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4878135980 1 Processor -- start 2024-03-20T13:38:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4878135980 1 -- start start 2024-03-20T13:38:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4878135980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55735d8f10a0 0x55735d97fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4878135980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55735d8c9510 con 0x55735d9800e0 2024-03-20T13:38:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4878135980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55735d8900f0 con 0x55735d8f10a0 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4875c50640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55735d8f10a0 0x55735d97fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4875c50640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55735d8f10a0 0x55735d97fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33886/0 (socket says 172.21.15.123:33886) 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4875c50640 1 -- 172.21.15.123:0/1936695742 learned_addr learned my addr 172.21.15.123:0/1936695742 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f487544f640 1 --1- 172.21.15.123:0/1936695742 >> v1:172.21.15.89:6789/0 conn(0x55735d9800e0 0x55735d9824d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59392/0 (socket says 172.21.15.123:59392) 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4875c50640 1 -- 172.21.15.123:0/1936695742 >> v1:172.21.15.89:6789/0 conn(0x55735d9800e0 legacy=0x55735d9824d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.886+0000 7f4875c50640 1 -- 172.21.15.123:0/1936695742 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735d984cc0 con 0x55735d8f10a0 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4875c50640 1 --2- 172.21.15.123:0/1936695742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97fba0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f486800a5c0 tx=0x7f486801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5c7826b8392eab server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4874c4e640 1 -- 172.21.15.123:0/1936695742 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680aa470 con 0x55735d8f10a0 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4874c4e640 1 -- 172.21.15.123:0/1936695742 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48680aa5d0 con 0x55735d8f10a0 2024-03-20T13:38:11.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4874c4e640 1 -- 172.21.15.123:0/1936695742 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680aa890 con 0x55735d8f10a0 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 -- 172.21.15.123:0/1936695742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 msgr2=0x55735d97fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 --2- 172.21.15.123:0/1936695742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97fba0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f486800a5c0 tx=0x7f486801b340 comp rx=0 tx=0).stop 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 -- 172.21.15.123:0/1936695742 shutdown_connections 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 --2- 172.21.15.123:0/1936695742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97fba0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 -- 172.21.15.123:0/1936695742 >> 172.21.15.123:0/1936695742 conn(0x55735d9776c0 msgr2=0x55735d979ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 -- 172.21.15.123:0/1936695742 shutdown_connections 2024-03-20T13:38:11.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.890+0000 7f4878135980 1 -- 172.21.15.123:0/1936695742 wait complete. 2024-03-20T13:38:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 Processor -- start 2024-03-20T13:38:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- start start 2024-03-20T13:38:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735da66e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735d88d620 con 0x55735d8f10a0 2024-03-20T13:38:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4875c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735da66e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4875c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735da66e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33888/0 (socket says 172.21.15.123:33888) 2024-03-20T13:38:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4875c50640 1 -- 172.21.15.123:0/1800496869 learned_addr learned my addr 172.21.15.123:0/1800496869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4875c50640 1 -- 172.21.15.123:0/1800496869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868005df0 con 0x55735d8f10a0 2024-03-20T13:38:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4875c50640 1 --2- 172.21.15.123:0/1800496869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735da66e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4868018f70 tx=0x7f4868003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bea2d8427031fd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4763e07640 1 -- 172.21.15.123:0/1800496869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680aa9c0 con 0x55735d8f10a0 2024-03-20T13:38:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4763e07640 1 -- 172.21.15.123:0/1800496869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48680aab20 con 0x55735d8f10a0 2024-03-20T13:38:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4763e07640 1 -- 172.21.15.123:0/1800496869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680aadc0 con 0x55735d8f10a0 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- 172.21.15.123:0/1800496869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 msgr2=0x55735da66e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 --2- 172.21.15.123:0/1800496869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735da66e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4868018f70 tx=0x7f4868003030 comp rx=0 tx=0).stop 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- 172.21.15.123:0/1800496869 shutdown_connections 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 --2- 172.21.15.123:0/1800496869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735da66e50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- 172.21.15.123:0/1800496869 >> 172.21.15.123:0/1800496869 conn(0x55735d9776c0 msgr2=0x55735da629e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- 172.21.15.123:0/1800496869 shutdown_connections 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.906+0000 7f4878135980 1 -- 172.21.15.123:0/1800496869 wait complete. 2024-03-20T13:38:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 Processor -- start 2024-03-20T13:38:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 -- start start 2024-03-20T13:38:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735d888e00 con 0x55735d8f10a0 2024-03-20T13:38:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33894/0 (socket says 172.21.15.123:33894) 2024-03-20T13:38:11.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 -- 172.21.15.123:0/2793195244 learned_addr learned my addr 172.21.15.123:0/2793195244 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 -- 172.21.15.123:0/2793195244 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735d984cc0 con 0x55735d8f10a0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97d2b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4868018f70 tx=0x7f48680180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4762604640 1 -- 172.21.15.123:0/2793195244 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680cb070 con 0x55735d8f10a0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55735d97d7f0 con 0x55735d8f10a0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4762604640 1 -- 172.21.15.123:0/2793195244 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48680bd810 con 0x55735d8f10a0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4762604640 1 -- 172.21.15.123:0/2793195244 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680bdab0 con 0x55735d8f10a0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55735d97bce0 con 0x55735d8f10a0 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 Processor -- start 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 -- start start 2024-03-20T13:38:11.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da7cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4878135980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735d821e30 con 0x55735da7cb20 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4762604640 1 -- 172.21.15.123:0/2793195244 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f48680bdc10 con 0x55735d8f10a0 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4762604640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f475c0342b0 0x7f475c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4876451640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da7cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4762604640 1 -- 172.21.15.123:0/2793195244 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f48680e4b60 con 0x55735d8f10a0 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4876451640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da7cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33906/0 (socket says 172.21.15.123:33906) 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4876451640 1 -- 172.21.15.123:0/4261887270 learned_addr learned my addr 172.21.15.123:0/4261887270 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f475c0342b0 0x7f475c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4876451640 1 -- 172.21.15.123:0/4261887270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735da7d480 con 0x55735da7cb20 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.910+0000 7f4875c50640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f475c0342b0 0x7f475c036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f48680bafd0 tx=0x7f48680bdf40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4876451640 1 --2- 172.21.15.123:0/4261887270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da7cf40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f487000a430 tx=0x7f487000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9018cee85943786 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f475bfff640 1 -- 172.21.15.123:0/4261887270 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f487000f6e0 con 0x55735da7cb20 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f475bfff640 1 -- 172.21.15.123:0/4261887270 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487000f860 con 0x55735da7cb20 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f475bfff640 1 -- 172.21.15.123:0/4261887270 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f487000fb40 con 0x55735da7cb20 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/4261887270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 msgr2=0x55735da7cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 --2- 172.21.15.123:0/4261887270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da7cf40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f487000a430 tx=0x7f487000a8f0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/4261887270 shutdown_connections 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 --2- 172.21.15.123:0/4261887270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da7cf40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/4261887270 >> 172.21.15.123:0/4261887270 conn(0x55735d9800e0 msgr2=0x55735da77f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/4261887270 shutdown_connections 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/4261887270 wait complete. 2024-03-20T13:38:11.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 Processor -- start 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- start start 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da83b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735d815790 con 0x55735da7cb20 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4876451640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da83b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4876451640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da83b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33908/0 (socket says 172.21.15.123:33908) 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4876451640 1 -- 172.21.15.123:0/1016147897 learned_addr learned my addr 172.21.15.123:0/1016147897 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4876451640 1 -- 172.21.15.123:0/1016147897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487000a0e0 con 0x55735da7cb20 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4876451640 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da83b90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f487000a3d0 tx=0x7f4870003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f475a7fc640 1 -- 172.21.15.123:0/1016147897 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48700109a0 con 0x55735da7cb20 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55735da840d0 con 0x55735da7cb20 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f475a7fc640 1 -- 172.21.15.123:0/1016147897 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4870010b00 con 0x55735da7cb20 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f475a7fc640 1 -- 172.21.15.123:0/1016147897 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4870010e20 con 0x55735da7cb20 2024-03-20T13:38:11.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.914+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55735da84560 con 0x55735da7cb20 2024-03-20T13:38:11.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f475a7fc640 1 -- 172.21.15.123:0/1016147897 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f487001a480 con 0x55735da7cb20 2024-03-20T13:38:11.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f475a7fc640 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f47500342b0 0x7f4750036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f475a7fc640 1 -- 172.21.15.123:0/1016147897 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4870049ce0 con 0x55735da7cb20 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f487544f640 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f47500342b0 0x7f4750036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 1 Processor -- start 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 1 -- start start 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 0x55735da9dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f487544f640 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f47500342b0 0x7f4750036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55735da78bd0 tx=0x7f486c001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735da9e130 con 0x55735da9d7d0 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4875c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 0x55735da9dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4875c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 0x55735da9dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33916/0 (socket says 172.21.15.123:33916) 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4875c50640 1 -- 172.21.15.123:0/3629831600 learned_addr learned my addr 172.21.15.123:0/3629831600 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4875c50640 1 -- 172.21.15.123:0/3629831600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735da9e270 con 0x55735da9d7d0 2024-03-20T13:38:11.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4875c50640 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 0x55735da9dbf0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f48680d1ff0 tx=0x7f48680e2ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f473a7e4640 1 -- 172.21.15.123:0/3629831600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680e9070 con 0x55735da9d7d0 2024-03-20T13:38:11.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f473a7e4640 1 -- 172.21.15.123:0/3629831600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48680de070 con 0x55735da9d7d0 2024-03-20T13:38:11.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55735da9ebf0 con 0x55735da9d7d0 2024-03-20T13:38:11.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f473a7e4640 1 -- 172.21.15.123:0/3629831600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48680b3620 con 0x55735da9d7d0 2024-03-20T13:38:11.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55735da9f080 con 0x55735da9d7d0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.918+0000 7f473a7e4640 1 -- 172.21.15.123:0/3629831600 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f48680cfbd0 con 0x55735da9d7d0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f473a7e4640 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f46b8034260 0x7f46b8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f473a7e4640 1 -- 172.21.15.123:0/3629831600 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f48680e0070 con 0x55735da9d7d0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f487544f640 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f46b8034260 0x7f46b8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f46abfff640 20 reqs_thread_entry: start 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55735da746c0 0x55735daa47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55735daa4db0 con 0x55735da746c0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f487544f640 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f46b8034260 0x7f46b8036720 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f486c000f70 tx=0x7f486c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4876451640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55735da746c0 0x55735daa47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4876451640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55735da746c0 0x55735daa47e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4876451640 1 -- 172.21.15.123:0/2793195244 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4870016020 con 0x55735da746c0 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55735daa5910 0x55735daa7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55735daa8550 con 0x55735daa5910 2024-03-20T13:38:11.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4875c50640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55735daa5910 0x55735daa7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:11.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4875c50640 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55735daa5910 0x55735daa7dd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4875c50640 1 -- 172.21.15.123:0/2793195244 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f48680cd070 con 0x55735daa5910 2024-03-20T13:38:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55735daa9d60 con 0x55735da746c0 2024-03-20T13:38:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.922+0000 7f4876451640 1 -- 172.21.15.123:0/2793195244 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(3 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4870016020 con 0x55735da746c0 2024-03-20T13:38:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f47500342b0 msgr2=0x7f4750036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f47500342b0 0x7f4750036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55735da78bd0 tx=0x7f486c001330 comp rx=0 tx=0).stop 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 msgr2=0x55735da83b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da83b90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f487000a3d0 tx=0x7f4870003380 comp rx=0 tx=0).stop 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 shutdown_connections 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f47500342b0 0x7f4750036770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/1016147897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da7cb20 0x55735da83b90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 >> 172.21.15.123:0/1016147897 conn(0x55735d9800e0 msgr2=0x55735da76d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 shutdown_connections 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/1016147897 wait complete. 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f46b8034260 msgr2=0x7f46b8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f46b8034260 0x7f46b8036720 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f486c000f70 tx=0x7f486c00f000 comp rx=0 tx=0).stop 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 msgr2=0x55735da9dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 0x55735da9dbf0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f48680d1ff0 tx=0x7f48680e2ea0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 shutdown_connections 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f46b8034260 0x7f46b8036720 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/3629831600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735da9d7d0 0x55735da9dbf0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 >> 172.21.15.123:0/3629831600 conn(0x55735da92530 msgr2=0x55735da92f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 shutdown_connections 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/3629831600 wait complete. 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55735daa5910 msgr2=0x55735daa7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55735daa5910 0x55735daa7dd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55735da746c0 msgr2=0x55735daa47e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55735da746c0 0x55735daa47e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f475c0342b0 msgr2=0x7f475c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f475c0342b0 0x7f475c036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f48680bafd0 tx=0x7f48680bdf40 comp rx=0 tx=0).stop 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 msgr2=0x55735d97d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97d2b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4868018f70 tx=0x7f48680180e0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 shutdown_connections 2024-03-20T13:38:11.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55735daa5910 0x55735daa7dd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55735da746c0 0x55735daa47e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f475c0342b0 0x7f475c036770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 --2- 172.21.15.123:0/2793195244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55735d8f10a0 0x55735d97d2b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 >> 172.21.15.123:0/2793195244 conn(0x55735d9776c0 msgr2=0x55735da614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 shutdown_connections 2024-03-20T13:38:11.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:11.926+0000 7f4878135980 1 -- 172.21.15.123:0/2793195244 wait complete. 2024-03-20T13:38:11.940 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"8ee97edf-01dc-402c-a19d-759426cef768","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"0d7d802a-c721-48a5-bb28-ec9d694bd027","zones":[{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-03-20T13:38:11.940 DEBUG:tasks.util.rgw: json result: {'id': '8ee97edf-01dc-402c-a19d-759426cef768', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'zones': [{'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-03-20T13:38:11.940 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-03-20T13:38:11.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-03-20T13:38:11.941 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-03-20T13:38:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9594a79980 1 Processor -- start 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9594a79980 1 -- start start 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9594a79980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555da479a020 0x555da479a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9594a79980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555da46e64c0 con 0x555da479a940 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9594a79980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x555da46ad0f0 con 0x555da479a020 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9592594640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555da479a020 0x555da479a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9592594640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555da479a020 0x555da479a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33922/0 (socket says 172.21.15.123:33922) 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9592594640 1 -- 172.21.15.123:0/3910732308 learned_addr learned my addr 172.21.15.123:0/3910732308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9591d93640 1 --1- 172.21.15.123:0/3910732308 >> v1:172.21.15.89:6789/0 conn(0x555da479a940 0x555da479b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59408/0 (socket says 172.21.15.123:59408) 2024-03-20T13:38:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9592594640 1 -- 172.21.15.123:0/3910732308 >> v1:172.21.15.89:6789/0 conn(0x555da479a940 legacy=0x555da479b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.018+0000 7f9592594640 1 -- 172.21.15.123:0/3910732308 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555da479bae0 con 0x555da479a020 2024-03-20T13:38:12.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9592594640 1 --2- 172.21.15.123:0/3910732308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da479a400 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f958c00a4e0 tx=0x7f958c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3931487dc0582c63 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9591592640 1 -- 172.21.15.123:0/3910732308 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0aa540 con 0x555da479a020 2024-03-20T13:38:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9591592640 1 -- 172.21.15.123:0/3910732308 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0a6070 con 0x555da479a020 2024-03-20T13:38:12.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9591592640 1 -- 172.21.15.123:0/3910732308 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0aa850 con 0x555da479a020 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 -- 172.21.15.123:0/3910732308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 msgr2=0x555da479a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 --2- 172.21.15.123:0/3910732308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da479a400 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f958c00a4e0 tx=0x7f958c01b090 comp rx=0 tx=0).stop 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 -- 172.21.15.123:0/3910732308 shutdown_connections 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 --2- 172.21.15.123:0/3910732308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da479a400 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 -- 172.21.15.123:0/3910732308 >> 172.21.15.123:0/3910732308 conn(0x555da47958f0 msgr2=0x555da4797d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 -- 172.21.15.123:0/3910732308 shutdown_connections 2024-03-20T13:38:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.022+0000 7f9594a79980 1 -- 172.21.15.123:0/3910732308 wait complete. 2024-03-20T13:38:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 Processor -- start 2024-03-20T13:38:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- start start 2024-03-20T13:38:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da4710900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da46aa620 con 0x555da479a020 2024-03-20T13:38:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9592594640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da4710900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9592594640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da4710900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33938/0 (socket says 172.21.15.123:33938) 2024-03-20T13:38:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9592594640 1 -- 172.21.15.123:0/1106342278 learned_addr learned my addr 172.21.15.123:0/1106342278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9592594640 1 -- 172.21.15.123:0/1106342278 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c00a1c0 con 0x555da479a020 2024-03-20T13:38:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9592594640 1 --2- 172.21.15.123:0/1106342278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da4710900 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f958c017ca0 tx=0x7f958c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bca12456fc4c0b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9480608640 1 -- 172.21.15.123:0/1106342278 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0aa780 con 0x555da479a020 2024-03-20T13:38:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9480608640 1 -- 172.21.15.123:0/1106342278 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0aa8e0 con 0x555da479a020 2024-03-20T13:38:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9480608640 1 -- 172.21.15.123:0/1106342278 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0aab80 con 0x555da479a020 2024-03-20T13:38:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- 172.21.15.123:0/1106342278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 msgr2=0x555da4710900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 --2- 172.21.15.123:0/1106342278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da4710900 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f958c017ca0 tx=0x7f958c0033b0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- 172.21.15.123:0/1106342278 shutdown_connections 2024-03-20T13:38:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 --2- 172.21.15.123:0/1106342278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da4710900 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- 172.21.15.123:0/1106342278 >> 172.21.15.123:0/1106342278 conn(0x555da47958f0 msgr2=0x555da4880120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- 172.21.15.123:0/1106342278 shutdown_connections 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.038+0000 7f9594a79980 1 -- 172.21.15.123:0/1106342278 wait complete. 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 Processor -- start 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 -- start start 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da488d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da46a5e00 con 0x555da479a020 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592594640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da488d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592594640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da488d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33952/0 (socket says 172.21.15.123:33952) 2024-03-20T13:38:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592594640 1 -- 172.21.15.123:0/1295593717 learned_addr learned my addr 172.21.15.123:0/1295593717 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592594640 1 -- 172.21.15.123:0/1295593717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555da479bae0 con 0x555da479a020 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592594640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da488d520 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f958c01aec0 tx=0x7f958c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f947ee05640 1 -- 172.21.15.123:0/1295593717 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0c4070 con 0x555da479a020 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555da488da60 con 0x555da479a020 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f947ee05640 1 -- 172.21.15.123:0/1295593717 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0b5650 con 0x555da479a020 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f947ee05640 1 -- 172.21.15.123:0/1295593717 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0b5910 con 0x555da479a020 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555da488de90 con 0x555da479a020 2024-03-20T13:38:12.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 Processor -- start 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 -- start start 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da489a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9594a79980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da463ee30 con 0x555da489a2c0 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da489a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da489a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33954/0 (socket says 172.21.15.123:33954) 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592d95640 1 -- 172.21.15.123:0/2458388835 learned_addr learned my addr 172.21.15.123:0/2458388835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f947ee05640 1 -- 172.21.15.123:0/1295593717 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f958c0a8070 con 0x555da479a020 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f947ee05640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f94780342b0 0x7f9478036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f947ee05640 1 -- 172.21.15.123:0/1295593717 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f958c0e3890 con 0x555da479a020 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592594640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f94780342b0 0x7f9478036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.042+0000 7f9592d95640 1 -- 172.21.15.123:0/2458388835 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555da489ac20 con 0x555da489a2c0 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592d95640 1 --2- 172.21.15.123:0/2458388835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da489a6e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f958400a440 tx=0x7f958400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b730520eb17b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592594640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f94780342b0 0x7f9478036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f958c0b4fd0 tx=0x7f958c0a9f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f947ce01640 1 -- 172.21.15.123:0/2458388835 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9584008850 con 0x555da489a2c0 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f947ce01640 1 -- 172.21.15.123:0/2458388835 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95840089d0 con 0x555da489a2c0 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f947ce01640 1 -- 172.21.15.123:0/2458388835 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9584008cb0 con 0x555da489a2c0 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/2458388835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 msgr2=0x555da489a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 --2- 172.21.15.123:0/2458388835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da489a6e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f958400a440 tx=0x7f958400a900 comp rx=0 tx=0).stop 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/2458388835 shutdown_connections 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 --2- 172.21.15.123:0/2458388835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da489a6e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/2458388835 >> 172.21.15.123:0/2458388835 conn(0x555da479a940 msgr2=0x555da4895730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/2458388835 shutdown_connections 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/2458388835 wait complete. 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 Processor -- start 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- start start 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da48a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da4632790 con 0x555da489a2c0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da48a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da48a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33960/0 (socket says 172.21.15.123:33960) 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592d95640 1 -- 172.21.15.123:0/514615969 learned_addr learned my addr 172.21.15.123:0/514615969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592d95640 1 -- 172.21.15.123:0/514615969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584005cd0 con 0x555da489a2c0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9592d95640 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da48a1250 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x555da489b0a0 tx=0x7f9584003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9476ffd640 1 -- 172.21.15.123:0/514615969 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9584013aa0 con 0x555da489a2c0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555da48a1790 con 0x555da489a2c0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9476ffd640 1 -- 172.21.15.123:0/514615969 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584013c00 con 0x555da489a2c0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9476ffd640 1 -- 172.21.15.123:0/514615969 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9584013ea0 con 0x555da489a2c0 2024-03-20T13:38:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.046+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555da48a1bc0 con 0x555da489a2c0 2024-03-20T13:38:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9476ffd640 1 -- 172.21.15.123:0/514615969 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9584028460 con 0x555da489a2c0 2024-03-20T13:38:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9476ffd640 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f946c0342b0 0x7f946c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9476ffd640 1 -- 172.21.15.123:0/514615969 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9584049880 con 0x555da489a2c0 2024-03-20T13:38:12.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 Processor -- start 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592d95640 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f946c0342b0 0x7f946c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 -- start start 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 0x555da48bb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da48bb8d0 con 0x555da48baf70 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592d95640 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f946c0342b0 0x7f946c036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f95840058b0 tx=0x7f9584028710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592594640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 0x555da48bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592594640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 0x555da48bb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33976/0 (socket says 172.21.15.123:33976) 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592594640 1 -- 172.21.15.123:0/143413342 learned_addr learned my addr 172.21.15.123:0/143413342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592594640 1 -- 172.21.15.123:0/143413342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555da48bba10 con 0x555da48baf70 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9592594640 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 0x555da48bb390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f958c0ac010 tx=0x7f958c0a9820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9456fe5640 1 -- 172.21.15.123:0/143413342 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0a9ab0 con 0x555da48baf70 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555da48bc360 con 0x555da48baf70 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9456fe5640 1 -- 172.21.15.123:0/143413342 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0df070 con 0x555da48baf70 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9456fe5640 1 -- 172.21.15.123:0/143413342 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f958c0e3b60 con 0x555da48baf70 2024-03-20T13:38:12.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555da48bc7f0 con 0x555da48baf70 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9456fe5640 1 -- 172.21.15.123:0/143413342 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f958c0e1030 con 0x555da48baf70 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9456fe5640 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93d40342b0 0x7f93d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9456fe5640 1 -- 172.21.15.123:0/143413342 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f958c0eed60 con 0x555da48baf70 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9591d93640 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93d40342b0 0x7f93d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9454fe1640 20 reqs_thread_entry: start 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555da48bff40 0x555da48c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.050+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x555da48c2870 con 0x555da48bff40 2024-03-20T13:38:12.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9591d93640 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93d40342b0 0x7f93d4036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f957c000f70 tx=0x7f957c001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9592d95640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555da48bff40 0x555da48c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9592d95640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555da48bff40 0x555da48c2330 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9592d95640 1 -- 172.21.15.123:0/1295593717 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9584024020 con 0x555da48bff40 2024-03-20T13:38:12.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555da48c42f0 0x555da48c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x555da48c6f20 con 0x555da48c42f0 2024-03-20T13:38:12.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9592594640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555da48c42f0 0x555da48c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9592594640 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555da48c42f0 0x555da48c6790 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9592594640 1 -- 172.21.15.123:0/1295593717 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(2 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f958c0e1940 con 0x555da48c42f0 2024-03-20T13:38:12.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.054+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x555da48cb9c0 con 0x555da48c42f0 2024-03-20T13:38:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9592594640 1 -- 172.21.15.123:0/1295593717 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(3 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [stat,call,call,writefull 0~421] v34'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f958c0e1940 con 0x555da48c42f0 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f946c0342b0 msgr2=0x7f946c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f946c0342b0 0x7f946c036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f95840058b0 tx=0x7f9584028710 comp rx=0 tx=0).stop 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 msgr2=0x555da48a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da48a1250 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x555da489b0a0 tx=0x7f9584003000 comp rx=0 tx=0).stop 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 shutdown_connections 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f946c0342b0 0x7f946c036770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/514615969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da489a2c0 0x555da48a1250 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 >> 172.21.15.123:0/514615969 conn(0x555da479a940 msgr2=0x555da4894530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 shutdown_connections 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/514615969 wait complete. 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93d40342b0 msgr2=0x7f93d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93d40342b0 0x7f93d4036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f957c000f70 tx=0x7f957c001300 comp rx=0 tx=0).stop 2024-03-20T13:38:12.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 msgr2=0x555da48bb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 0x555da48bb390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f958c0ac010 tx=0x7f958c0a9820 comp rx=0 tx=0).stop 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 shutdown_connections 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93d40342b0 0x7f93d4036770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/143413342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da48baf70 0x555da48bb390 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 >> 172.21.15.123:0/143413342 conn(0x555da48afcf0 msgr2=0x555da48b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 shutdown_connections 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/143413342 wait complete. 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555da48bff40 msgr2=0x555da48c2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555da48bff40 0x555da48c2330 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555da48c42f0 msgr2=0x555da48c6790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555da48c42f0 0x555da48c6790 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f94780342b0 msgr2=0x7f9478036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f94780342b0 0x7f9478036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f958c0b4fd0 tx=0x7f958c0a9f90 comp rx=0 tx=0).stop 2024-03-20T13:38:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 msgr2=0x555da488d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da488d520 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f958c01aec0 tx=0x7f958c017e30 comp rx=0 tx=0).stop 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 shutdown_connections 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x555da48c42f0 0x555da48c6790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x555da48bff40 0x555da48c2330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f94780342b0 0x7f9478036770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 --2- 172.21.15.123:0/1295593717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555da479a020 0x555da488d520 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 >> 172.21.15.123:0/1295593717 conn(0x555da47958f0 msgr2=0x555da470f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 shutdown_connections 2024-03-20T13:38:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.058+0000 7f9594a79980 1 -- 172.21.15.123:0/1295593717 wait complete. 2024-03-20T13:38:12.072 INFO:teuthology.orchestra.run.smithi123.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-03-20T13:38:12.073 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-03-20T13:38:12.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-03-20T13:38:12.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-03-20T13:38:12.073 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-03-20T13:38:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912d40f980 1 Processor -- start 2024-03-20T13:38:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912d40f980 1 -- start start 2024-03-20T13:38:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912d40f980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56449d4554f0 0x56449d4578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912d40f980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56449d39d4c0 con 0x56449d451030 2024-03-20T13:38:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912d40f980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56449d3640f0 con 0x56449d4554f0 2024-03-20T13:38:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912a729640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56449d4554f0 0x56449d4578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912af2a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56449d451030 0x56449d451410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:59412/0 (socket says 172.21.15.123:59412) 2024-03-20T13:38:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912a729640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56449d4554f0 0x56449d4578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:33990/0 (socket says 172.21.15.123:33990) 2024-03-20T13:38:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.146+0000 7f912af2a640 1 -- 172.21.15.123:0/3309433121 learned_addr learned my addr 172.21.15.123:0/3309433121 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-03-20T13:38:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912a729640 1 -- 172.21.15.123:0/3309433121 >> v1:172.21.15.89:6789/0 conn(0x56449d451030 legacy=0x56449d451410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912a729640 1 -- 172.21.15.123:0/3309433121 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56449d458e30 con 0x56449d4554f0 2024-03-20T13:38:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912a729640 1 --2- 172.21.15.123:0/3309433121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d4554f0 0x56449d4578e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f911c00a420 tx=0x7f911c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b7248fdca7a339 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f9129f28640 1 -- 172.21.15.123:0/3309433121 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911c0aa530 con 0x56449d4554f0 2024-03-20T13:38:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f9129f28640 1 -- 172.21.15.123:0/3309433121 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0a6050 con 0x56449d4554f0 2024-03-20T13:38:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f9129f28640 1 -- 172.21.15.123:0/3309433121 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911c0aa800 con 0x56449d4554f0 2024-03-20T13:38:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 -- 172.21.15.123:0/3309433121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d4554f0 msgr2=0x56449d4578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 --2- 172.21.15.123:0/3309433121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d4554f0 0x56449d4578e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f911c00a420 tx=0x7f911c01afd0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 -- 172.21.15.123:0/3309433121 shutdown_connections 2024-03-20T13:38:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 --2- 172.21.15.123:0/3309433121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d4554f0 0x56449d4578e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 -- 172.21.15.123:0/3309433121 >> 172.21.15.123:0/3309433121 conn(0x56449d44c900 msgr2=0x56449d44ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 -- 172.21.15.123:0/3309433121 shutdown_connections 2024-03-20T13:38:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.150+0000 7f912d40f980 1 -- 172.21.15.123:0/3309433121 wait complete. 2024-03-20T13:38:12.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 Processor -- start 2024-03-20T13:38:12.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- start start 2024-03-20T13:38:12.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d53afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449d361620 con 0x56449d451030 2024-03-20T13:38:12.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912af2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d53afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912af2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d53afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34004/0 (socket says 172.21.15.123:34004) 2024-03-20T13:38:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912af2a640 1 -- 172.21.15.123:0/2598387948 learned_addr learned my addr 172.21.15.123:0/2598387948 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912af2a640 1 -- 172.21.15.123:0/2598387948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c00a100 con 0x56449d451030 2024-03-20T13:38:12.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912af2a640 1 --2- 172.21.15.123:0/2598387948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d53afd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9114001c00 tx=0x7f911400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeaee1fe7c60646 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f9018e09640 1 -- 172.21.15.123:0/2598387948 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911400e690 con 0x56449d451030 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f9018e09640 1 -- 172.21.15.123:0/2598387948 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911400e810 con 0x56449d451030 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f9018e09640 1 -- 172.21.15.123:0/2598387948 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911400eb30 con 0x56449d451030 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- 172.21.15.123:0/2598387948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 msgr2=0x56449d53afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 --2- 172.21.15.123:0/2598387948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d53afd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9114001c00 tx=0x7f911400b6d0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- 172.21.15.123:0/2598387948 shutdown_connections 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 --2- 172.21.15.123:0/2598387948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d53afd0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- 172.21.15.123:0/2598387948 >> 172.21.15.123:0/2598387948 conn(0x56449d44c900 msgr2=0x56449d536b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- 172.21.15.123:0/2598387948 shutdown_connections 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- 172.21.15.123:0/2598387948 wait complete. 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 Processor -- start 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 -- start start 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.166+0000 7f912d40f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d541e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449d35ce00 con 0x56449d451030 2024-03-20T13:38:12.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d541e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d541e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34014/0 (socket says 172.21.15.123:34014) 2024-03-20T13:38:12.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 -- 172.21.15.123:0/697014577 learned_addr learned my addr 172.21.15.123:0/697014577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56449d39d4c0 con 0x56449d451030 2024-03-20T13:38:12.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d541e20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f911400b710 tx=0x7f9114000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9017606640 1 -- 172.21.15.123:0/697014577 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911401f070 con 0x56449d451030 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9017606640 1 -- 172.21.15.123:0/697014577 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911401a910 con 0x56449d451030 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56449d542360 con 0x56449d451030 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9017606640 1 -- 172.21.15.123:0/697014577 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f911401abf0 con 0x56449d451030 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56449d542790 con 0x56449d451030 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 Processor -- start 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 -- start start 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d54f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912d40f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449d2f5e30 con 0x56449d54ec60 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912b72b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d54f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9017606640 1 -- 172.21.15.123:0/697014577 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f911400a040 con 0x56449d451030 2024-03-20T13:38:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912b72b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d54f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34028/0 (socket says 172.21.15.123:34028) 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912b72b640 1 -- 172.21.15.123:0/966894402 learned_addr learned my addr 172.21.15.123:0/966894402 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9017606640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90100342b0 0x7f9010036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9017606640 1 -- 172.21.15.123:0/697014577 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9114049ff0 con 0x56449d451030 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90100342b0 0x7f9010036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912b72b640 1 -- 172.21.15.123:0/966894402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56449d54f5c0 con 0x56449d54ec60 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912b72b640 1 --2- 172.21.15.123:0/966894402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d54f080 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f912400a440 tx=0x7f912400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9e61ffe7efa82a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f912af2a640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90100342b0 0x7f9010036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9114048400 tx=0x7f911400df90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9015602640 1 -- 172.21.15.123:0/966894402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9124008850 con 0x56449d54ec60 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9015602640 1 -- 172.21.15.123:0/966894402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240089d0 con 0x56449d54ec60 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.170+0000 7f9015602640 1 -- 172.21.15.123:0/966894402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9124008cb0 con 0x56449d54ec60 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/966894402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 msgr2=0x56449d54f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 --2- 172.21.15.123:0/966894402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d54f080 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f912400a440 tx=0x7f912400a900 comp rx=0 tx=0).stop 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/966894402 shutdown_connections 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 --2- 172.21.15.123:0/966894402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d54f080 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/966894402 >> 172.21.15.123:0/966894402 conn(0x56449d4554f0 msgr2=0x56449d54a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/966894402 shutdown_connections 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/966894402 wait complete. 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 Processor -- start 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- start start 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d555b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449d2e9790 con 0x56449d54ec60 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912b72b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d555b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912b72b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d555b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34038/0 (socket says 172.21.15.123:34038) 2024-03-20T13:38:12.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912b72b640 1 -- 172.21.15.123:0/3378656366 learned_addr learned my addr 172.21.15.123:0/3378656366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912b72b640 1 -- 172.21.15.123:0/3378656366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124005cd0 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912b72b640 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d555b70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x56449d54fa40 tx=0x7f9124003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f900f7fe640 1 -- 172.21.15.123:0/3378656366 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9124013aa0 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56449d5560b0 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f900f7fe640 1 -- 172.21.15.123:0/3378656366 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124013c00 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f900f7fe640 1 -- 172.21.15.123:0/3378656366 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9124013ea0 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56449d5564e0 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f900f7fe640 1 -- 172.21.15.123:0/3378656366 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9124028460 con 0x56449d54ec60 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f900f7fe640 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90040342b0 0x7f9004036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:12.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f900f7fe640 1 -- 172.21.15.123:0/3378656366 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f91240499a0 con 0x56449d54ec60 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912a729640 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90040342b0 0x7f9004036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 Processor -- start 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.174+0000 7f912d40f980 1 -- start start 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912a729640 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90040342b0 0x7f9004036770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f911c0ac000 tx=0x7f911c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912d40f980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 0x56449d56fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912d40f980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449d570170 con 0x56449d56f810 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912af2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 0x56449d56fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912af2a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 0x56449d56fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:34048/0 (socket says 172.21.15.123:34048) 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912af2a640 1 -- 172.21.15.123:0/3138927209 learned_addr learned my addr 172.21.15.123:0/3138927209 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912af2a640 1 -- 172.21.15.123:0/3138927209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56449d5702b0 con 0x56449d56f810 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912af2a640 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 0x56449d56fc30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9114048370 tx=0x7f9114023b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8feaffd640 1 -- 172.21.15.123:0/3138927209 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114048120 con 0x56449d56f810 2024-03-20T13:38:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8feaffd640 1 -- 172.21.15.123:0/3138927209 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114017900 con 0x56449d56f810 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56449d570c10 con 0x56449d56f810 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8feaffd640 1 -- 172.21.15.123:0/3138927209 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91140173e0 con 0x56449d56f810 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56449d570c10 con 0x56449d56f810 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8feaffd640 1 -- 172.21.15.123:0/3138927209 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f91140233c0 con 0x56449d56f810 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8feaffd640 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8f640342b0 0x7f8f64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8feaffd640 1 -- 172.21.15.123:0/3138927209 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9114041040 con 0x56449d56f810 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912a729640 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8f640342b0 0x7f8f64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f8fe8ff9640 20 reqs_thread_entry: start 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56449d5747f0 0x56449d576be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56449d545d80 con 0x56449d5747f0 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912a729640 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8f640342b0 0x7f8f64036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f911c01b010 tx=0x7f911c005d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.178+0000 7f912b72b640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56449d5747f0 0x56449d576be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912b72b640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56449d5747f0 0x56449d576be0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912b72b640 1 -- 172.21.15.123:0/697014577 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9124024020 con 0x56449d5747f0 2024-03-20T13:38:12.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56449d578230 con 0x56449d5747f0 2024-03-20T13:38:12.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912b72b640 1 -- 172.21.15.123:0/697014577 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(2 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9124024020 con 0x56449d5747f0 2024-03-20T13:38:12.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56449d577c40 0x56449d57a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56449d57abb0 con 0x56449d577c40 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912af2a640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56449d577c40 0x56449d57a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912af2a640 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56449d577c40 0x56449d57a670 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912af2a640 1 -- 172.21.15.123:0/697014577 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9114008be0 con 0x56449d577c40 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56449d57b000 con 0x56449d5747f0 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912b72b640 1 -- 172.21.15.123:0/697014577 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9124024020 con 0x56449d5747f0 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x56449d57c570 con 0x56449d577c40 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912af2a640 1 -- 172.21.15.123:0/697014577 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f9114008be0 con 0x56449d577c40 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x56449d2f5c20 con 0x56449d54ec60 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f900f7fe640 1 -- 172.21.15.123:0/3378656366 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91240277e0 con 0x56449d54ec60 2024-03-20T13:38:12.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.182+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:6 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~921 in=921b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x56449d581080 con 0x56449d5747f0 2024-03-20T13:38:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912b72b640 1 -- 172.21.15.123:0/697014577 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(6 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [stat,call,call,writefull 0~921] v34'5 uv5 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f9124024020 con 0x56449d5747f0 2024-03-20T13:38:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90040342b0 msgr2=0x7f9004036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90040342b0 0x7f9004036770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f911c0ac000 tx=0x7f911c0a5000 comp rx=0 tx=0).stop 2024-03-20T13:38:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 msgr2=0x56449d555b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d555b70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x56449d54fa40 tx=0x7f9124003000 comp rx=0 tx=0).stop 2024-03-20T13:38:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 shutdown_connections 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90040342b0 0x7f9004036770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3378656366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d54ec60 0x56449d555b70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 >> 172.21.15.123:0/3378656366 conn(0x56449d4554f0 msgr2=0x56449d548ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 shutdown_connections 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3378656366 wait complete. 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8f640342b0 msgr2=0x7f8f64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8f640342b0 0x7f8f64036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f911c01b010 tx=0x7f911c005d90 comp rx=0 tx=0).stop 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 msgr2=0x56449d56fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 0x56449d56fc30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9114048370 tx=0x7f9114023b10 comp rx=0 tx=0).stop 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 shutdown_connections 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8f640342b0 0x7f8f64036770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 --2- 172.21.15.123:0/3138927209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d56f810 0x56449d56fc30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 >> 172.21.15.123:0/3138927209 conn(0x56449d5644e0 msgr2=0x56449d564f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 shutdown_connections 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.186+0000 7f912d40f980 1 -- 172.21.15.123:0/3138927209 wait complete. 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56449d5747f0 msgr2=0x56449d576be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56449d5747f0 0x56449d576be0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56449d577c40 msgr2=0x56449d57a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56449d577c40 0x56449d57a670 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90100342b0 msgr2=0x7f9010036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90100342b0 0x7f9010036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9114048400 tx=0x7f911400df90 comp rx=0 tx=0).stop 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 msgr2=0x56449d541e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d541e20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f911400b710 tx=0x7f9114000bd0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 shutdown_connections 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x56449d577c40 0x56449d57a670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x56449d5747f0 0x56449d576be0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f90100342b0 0x7f9010036770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 --2- 172.21.15.123:0/697014577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56449d451030 0x56449d541e20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:12.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 >> 172.21.15.123:0/697014577 conn(0x56449d44c900 msgr2=0x56449d535670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:12.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 shutdown_connections 2024-03-20T13:38:12.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:12.190+0000 7f912d40f980 1 -- 172.21.15.123:0/697014577 wait complete. 2024-03-20T13:38:12.202 INFO:teuthology.orchestra.run.smithi123.stdout:{"id":"0d7d802a-c721-48a5-bb28-ec9d694bd027","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:38:12.202 DEBUG:tasks.util.rgw: json result: {'id': '0d7d802a-c721-48a5-bb28-ec9d694bd027', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:38:12.204 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000005c3b92b8254e3809-0065fae6c4-4227-default4227-default-default 2024-03-20T13:38:12.447 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=480f71887f2147e58ac4763a21b6133a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000005c3b92b8254e3809-0065fae6c4-4227-default4227-default-default 2024-03-20T13:38:12.449 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-20T13:38:12.458 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-20T13:38:12.458 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:12.462 INFO:tasks.rgw.client.0.smithi123.stdout:2024-03-20T13:38:12.458+0000 7f3ac2057640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28104) UID: 0 2024-03-20T13:38:12.462 INFO:tasks.rgw.client.0.smithi123.stdout:2024-03-20T13:38:12.458+0000 7f3ac589fa40 -1 shutting down 2024-03-20T13:38:17.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-20T13:38:18.559 INFO:tasks.rgw.client.0:Stopped 2024-03-20T13:38:18.560 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-20T13:38:18.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/vault-root-token 2024-03-20T13:38:18.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-20T13:38:18.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-20T13:38:18.621 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-20T13:38:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:38:18.701 INFO:teuthology.orchestra.run.smithi123.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:38:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a4037d980 1 Processor -- start 2024-03-20T13:38:18.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a4037d980 1 -- start start 2024-03-20T13:38:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a4037d980 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a3968c68f0 0x55a396954bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a4037d980 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a39689e520 con 0x55a396955130 2024-03-20T13:38:18.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a4037d980 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a3968650f0 con 0x55a3968c68f0 2024-03-20T13:38:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a3de98640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a3968c68f0 0x55a396954bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a3de98640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a3968c68f0 0x55a396954bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:59146/0 (socket says 172.21.15.123:59146) 2024-03-20T13:38:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a3de98640 1 -- 172.21.15.123:0/2285215618 learned_addr learned my addr 172.21.15.123:0/2285215618 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a3d697640 1 --1- 172.21.15.123:0/2285215618 >> v1:172.21.15.89:6789/0 conn(0x55a396955130 0x55a396957520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.123:36490/0 (socket says 172.21.15.123:36490) 2024-03-20T13:38:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a3de98640 1 -- 172.21.15.123:0/2285215618 >> v1:172.21.15.89:6789/0 conn(0x55a396955130 legacy=0x55a396957520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.698+0000 7f4a3de98640 1 -- 172.21.15.123:0/2285215618 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a396959ce0 con 0x55a3968c68f0 2024-03-20T13:38:18.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a3de98640 1 --2- 172.21.15.123:0/2285215618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396954bf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800a5c0 tx=0x7f4a3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68e0211d01e4597 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a3ce96640 1 -- 172.21.15.123:0/2285215618 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a380aa470 con 0x55a3968c68f0 2024-03-20T13:38:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a3ce96640 1 -- 172.21.15.123:0/2285215618 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a380aa5d0 con 0x55a3968c68f0 2024-03-20T13:38:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a3ce96640 1 -- 172.21.15.123:0/2285215618 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a380aa890 con 0x55a3968c68f0 2024-03-20T13:38:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 -- 172.21.15.123:0/2285215618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 msgr2=0x55a396954bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:18.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 --2- 172.21.15.123:0/2285215618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396954bf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800a5c0 tx=0x7f4a3801b340 comp rx=0 tx=0).stop 2024-03-20T13:38:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 -- 172.21.15.123:0/2285215618 shutdown_connections 2024-03-20T13:38:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 --2- 172.21.15.123:0/2285215618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396954bf0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 -- 172.21.15.123:0/2285215618 >> 172.21.15.123:0/2285215618 conn(0x55a39694c710 msgr2=0x55a39694eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 -- 172.21.15.123:0/2285215618 shutdown_connections 2024-03-20T13:38:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.702+0000 7f4a4037d980 1 -- 172.21.15.123:0/2285215618 wait complete. 2024-03-20T13:38:18.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.718+0000 7f4a4037d980 1 Processor -- start 2024-03-20T13:38:18.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.718+0000 7f4a4037d980 1 -- start start 2024-03-20T13:38:18.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.718+0000 7f4a4037d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396a3bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.718+0000 7f4a4037d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a396862620 con 0x55a3968c68f0 2024-03-20T13:38:18.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.718+0000 7f4a3de98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396a3bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396a3bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:59162/0 (socket says 172.21.15.123:59162) 2024-03-20T13:38:18.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 -- 172.21.15.123:0/122827494 learned_addr learned my addr 172.21.15.123:0/122827494 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:18.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 -- 172.21.15.123:0/122827494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38005df0 con 0x55a3968c68f0 2024-03-20T13:38:18.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 --2- 172.21.15.123:0/122827494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396a3bec0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4a380ac040 tx=0x7f4a38003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b0eb9661b276f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f492be07640 1 -- 172.21.15.123:0/122827494 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a380aa930 con 0x55a3968c68f0 2024-03-20T13:38:18.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f492be07640 1 -- 172.21.15.123:0/122827494 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a380aaa90 con 0x55a3968c68f0 2024-03-20T13:38:18.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f492be07640 1 -- 172.21.15.123:0/122827494 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a380aad50 con 0x55a3968c68f0 2024-03-20T13:38:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- 172.21.15.123:0/122827494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 msgr2=0x55a396a3bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 --2- 172.21.15.123:0/122827494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396a3bec0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4a380ac040 tx=0x7f4a38003030 comp rx=0 tx=0).stop 2024-03-20T13:38:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- 172.21.15.123:0/122827494 shutdown_connections 2024-03-20T13:38:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 --2- 172.21.15.123:0/122827494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a3968c68f0 0x55a396a3bec0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- 172.21.15.123:0/122827494 >> 172.21.15.123:0/122827494 conn(0x55a39694c710 msgr2=0x55a396a37a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- 172.21.15.123:0/122827494 shutdown_connections 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- 172.21.15.123:0/122827494 wait complete. 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 Processor -- start 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- start start 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 0x55a396952300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a4037d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a39685de00 con 0x55a396955130 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 0x55a396952300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 0x55a396952300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:59164/0 (socket says 172.21.15.123:59164) 2024-03-20T13:38:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 -- 172.21.15.123:0/3531851645 learned_addr learned my addr 172.21.15.123:0/3531851645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.722+0000 7f4a3de98640 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a396959ce0 con 0x55a396955130 2024-03-20T13:38:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a3de98640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 0x55a396952300 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a38003070 tx=0x7f4a380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f492a604640 1 -- 172.21.15.123:0/3531851645 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a380c6650 con 0x55a396955130 2024-03-20T13:38:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f492a604640 1 -- 172.21.15.123:0/3531851645 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a380c67b0 con 0x55a396955130 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a396952840 con 0x55a396955130 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f492a604640 1 -- 172.21.15.123:0/3531851645 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a380c6a50 con 0x55a396955130 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a396950d30 con 0x55a396955130 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f492a604640 1 -- 172.21.15.123:0/3531851645 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4a380c6bb0 con 0x55a396955130 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f492a604640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49240343a0 0x7f4924036860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f492a604640 1 -- 172.21.15.123:0/3531851645 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4a380e4b60 con 0x55a396955130 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a3d697640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49240343a0 0x7f4924036860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a49dd0 0x55a396a4c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a4c700 con 0x55a396a49dd0 2024-03-20T13:38:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a3e699640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a49dd0 0x55a396a4c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a3d697640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49240343a0 0x7f4924036860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000f70 tx=0x7f4a28001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a3e699640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a49dd0 0x55a396a4c1c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a3e699640 1 -- 172.21.15.123:0/3531851645 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a49dd0 2024-03-20T13:38:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a4cf70 0x55a396a4f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.726+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a4f8a0 con 0x55a396a4cf70 2024-03-20T13:38:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a3de98640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a4cf70 0x55a396a4f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a3de98640 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a4cf70 0x55a396a4f360 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a3de98640 1 -- 172.21.15.123:0/3531851645 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4a380cd070 con 0x55a396a4cf70 2024-03-20T13:38:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:3 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a50d80 con 0x55a396a4cf70 2024-03-20T13:38:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a3de98640 1 -- 172.21.15.123:0/3531851645 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(3 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [call out=48b,read 0~921 out=921b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+969 (crc 0 0 0) 0x7f4a380cd070 con 0x55a396a4cf70 2024-03-20T13:38:18.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a500d0 con 0x55a396a4cf70 2024-03-20T13:38:18.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a3de98640 1 -- 172.21.15.123:0/3531851645 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a380cd070 con 0x55a396a4cf70 2024-03-20T13:38:18.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:5 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a504e0 con 0x55a396a49dd0 2024-03-20T13:38:18.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.730+0000 7f4a3e699640 1 -- 172.21.15.123:0/3531851645 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(5 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a49dd0 2024-03-20T13:38:18.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 Processor -- start 2024-03-20T13:38:18.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 -- start start 2024-03-20T13:38:18.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 0x55a396a5f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3967f6e30 con 0x55a396a5f500 2024-03-20T13:38:18.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3e699640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 0x55a396a5f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3e699640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 0x55a396a5f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:59178/0 (socket says 172.21.15.123:59178) 2024-03-20T13:38:18.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3e699640 1 -- 172.21.15.123:0/1784995457 learned_addr learned my addr 172.21.15.123:0/1784995457 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:18.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3e699640 1 -- 172.21.15.123:0/1784995457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a396a5fe60 con 0x55a396a5f500 2024-03-20T13:38:18.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3e699640 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 0x55a396a5f920 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a30016cf0 tx=0x7f4a3000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f49237fe640 1 -- 172.21.15.123:0/1784995457 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a30017790 con 0x55a396a5f500 2024-03-20T13:38:18.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f49237fe640 1 -- 172.21.15.123:0/1784995457 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a300178f0 con 0x55a396a5f500 2024-03-20T13:38:18.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a396a600b0 con 0x55a396a5f500 2024-03-20T13:38:18.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f49237fe640 1 -- 172.21.15.123:0/1784995457 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a30017b90 con 0x55a396a5f500 2024-03-20T13:38:18.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a396a60c00 con 0x55a396a5f500 2024-03-20T13:38:18.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f49237fe640 1 -- 172.21.15.123:0/1784995457 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4a3001d020 con 0x55a396a5f500 2024-03-20T13:38:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f49237fe640 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49180342b0 0x7f4918036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f49237fe640 1 -- 172.21.15.123:0/1784995457 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4a3004b3f0 con 0x55a396a5f500 2024-03-20T13:38:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3de98640 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49180342b0 0x7f4918036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 Processor -- start 2024-03-20T13:38:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a4037d980 1 -- start start 2024-03-20T13:38:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.734+0000 7f4a3de98640 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49180342b0 0x7f4918036770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55a396951240 tx=0x7f4a380052e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a6c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3967ea790 con 0x55a396a6c480 2024-03-20T13:38:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a6c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a6c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:59190/0 (socket says 172.21.15.123:59190) 2024-03-20T13:38:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 -- 172.21.15.123:0/292787100 learned_addr learned my addr 172.21.15.123:0/292787100 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 -- 172.21.15.123:0/292787100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a396a6ce70 con 0x55a396a6c480 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 --2- 172.21.15.123:0/292787100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a6c8a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4a300496b0 tx=0x7f4a30028920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479abc1760fb73b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f49217fa640 1 -- 172.21.15.123:0/292787100 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a3001fa10 con 0x55a396a6c480 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f49217fa640 1 -- 172.21.15.123:0/292787100 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3003b290 con 0x55a396a6c480 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f49217fa640 1 -- 172.21.15.123:0/292787100 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a3004b0d0 con 0x55a396a6c480 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- 172.21.15.123:0/292787100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 msgr2=0x55a396a6c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 --2- 172.21.15.123:0/292787100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a6c8a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4a300496b0 tx=0x7f4a30028920 comp rx=0 tx=0).stop 2024-03-20T13:38:18.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- 172.21.15.123:0/292787100 shutdown_connections 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 --2- 172.21.15.123:0/292787100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a6c8a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- 172.21.15.123:0/292787100 >> 172.21.15.123:0/292787100 conn(0x55a396a687c0 msgr2=0x55a396a66820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- 172.21.15.123:0/292787100 shutdown_connections 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- 172.21.15.123:0/292787100 wait complete. 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 Processor -- start 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- start start 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a73330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a4037d980 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a396a73870 con 0x55a396a6c480 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a73330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a73330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.123:59192/0 (socket says 172.21.15.123:59192) 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 learned_addr learned my addr 172.21.15.123:0/444916149 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a396a60c00 con 0x55a396a6c480 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.738+0000 7f4a3e699640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a73330 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4a30011e20 tx=0x7f4a30049610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f490f7fe640 1 -- 172.21.15.123:0/444916149 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a300147c0 con 0x55a396a6c480 2024-03-20T13:38:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f490f7fe640 1 -- 172.21.15.123:0/444916149 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a30014920 con 0x55a396a6c480 2024-03-20T13:38:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a396a73a70 con 0x55a396a6c480 2024-03-20T13:38:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f490f7fe640 1 -- 172.21.15.123:0/444916149 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a3001fe00 con 0x55a396a6c480 2024-03-20T13:38:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a396a73ea0 con 0x55a396a6c480 2024-03-20T13:38:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f490f7fe640 1 -- 172.21.15.123:0/444916149 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4a30013ab0 con 0x55a396a6c480 2024-03-20T13:38:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f490f7fe640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49080342b0 0x7f4908036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f490f7fe640 1 -- 172.21.15.123:0/444916149 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4a300185d0 con 0x55a396a6c480 2024-03-20T13:38:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3de98640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49080342b0 0x7f4908036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a7ea10 0x55a396a80ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a81620 con 0x55a396a7ea10 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3d697640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a7ea10 0x55a396a80ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3de98640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49080342b0 0x7f4908036770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a380b3c80 tx=0x7f4a380b3f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3d697640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a7ea10 0x55a396a80ed0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 realm 2024-03-20T13:38:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a7de70 con 0x55a396a7ea10 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a820a0 con 0x55a396a7ea10 2024-03-20T13:38:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a82e30 0x55a396a85220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a858a0 con 0x55a396a82e30 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.742+0000 7f4a3e699640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a82e30 0x55a396a85220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3e699640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a82e30 0x55a396a85220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:5 5.1b 5:ddd4b076:::zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a860a0 con 0x55a396a82e30 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== osd_op_reply(5 zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 [read 0~921 out=921b] v0'0 uv5 ondisk = 0) v8 ==== 190+0+921 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 20 rados_obj.operate() r=0 bl.length=921 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 20 searching for the correct realm 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a396a88180 0x55a396a8a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a88180 2024-03-20T13:38:18.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3de98640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a396a88180 0x55a396a8a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3de98640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a396a88180 0x55a396a8a640 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a82e30 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3e699640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4a30020c00 0x7f4a300382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.746+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x7f4a30020c00 2024-03-20T13:38:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4a30020c00 0x7f4a300382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4a30020c00 0x7f4a300382a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a7ea10 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a7ea10 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a88180 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a7ea10 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a82e30 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a82e30 2024-03-20T13:38:18.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a7ea10 2024-03-20T13:38:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.750+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x7f4a30020c00 2024-03-20T13:38:18.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8ad10 con 0x55a396a7ea10 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v34'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x7f4a30020c00 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a82e30 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a88180 2024-03-20T13:38:18.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a7ea10 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a82e30 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a88180 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a7ea10 2024-03-20T13:38:18.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a7ea10 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.754+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a7ea10 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a88180 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x7f4a30020c00 2024-03-20T13:38:18.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a7ea10 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x7f4a30020c00 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a88180 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x7f4a30020c00 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a82e30 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v34'5 uv5 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a82e30 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a88180 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.758+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a82e30 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) v8 -- 0x7f4a2802d080 con 0x55a396a82e30 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 RGWRados::pool_iterate: got zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 RGWRados::pool_iterate: got zone_info.0d7d802a-c721-48a5-bb28-ec9d694bd027 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:38:18.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a876e0 con 0x55a396a7ea10 2024-03-20T13:38:18.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a86b00 con 0x55a396a82e30 2024-03-20T13:38:18.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:38:18.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:40 5.1a 5:5c769645:::zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a86b20 con 0x55a396a7ea10 2024-03-20T13:38:18.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 15 ==== osd_op_reply(40 zonegroup_info.8ee97edf-01dc-402c-a19d-759426cef768 [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados_obj.operate() r=0 bl.length=421 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 zone default found 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 4 Realm: () 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 4 ZoneGroup: default (8ee97edf-01dc-402c-a19d-759426cef768) 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 4 Zone: default (0d7d802a-c721-48a5-bb28-ec9d694bd027) 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 zonegroup default 2024-03-20T13:38:18.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a87130 con 0x7f4a30020c00 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8d0f0 con 0x55a396a88180 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 20 rados->read ofs=0 len=0 2024-03-20T13:38:18.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.762+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8d570 con 0x55a396a88180 2024-03-20T13:38:18.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a4037d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:38:18.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a4037d980 20 started sync module instance, tier type = 2024-03-20T13:38:18.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a4037d980 20 started zone id=0d7d802a-c721-48a5-bb28-ec9d694bd027 (name=default) with tier type = 2024-03-20T13:38:18.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8cd20 con 0x55a396a82e30 2024-03-20T13:38:18.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 13 ==== osd_op_reply(44 notify.0 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94161095671664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8d990 con 0x55a396a82e30 2024-03-20T13:38:18.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.766+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8e190 con 0x55a396a7ea10 2024-03-20T13:38:18.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 16 ==== osd_op_reply(46 notify.1 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94161095678352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8e990 con 0x55a396a7ea10 2024-03-20T13:38:18.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8f300 con 0x55a396a82e30 2024-03-20T13:38:18.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94161095671664] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94161095678352] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 15 ==== osd_op_reply(48 notify.2 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94161095681264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8e910 con 0x55a396a82e30 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8f7a0 con 0x7f4a30020c00 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 8 ==== osd_op_reply(50 notify.3 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.770+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94161095684864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8fbc0 con 0x7f4a30020c00 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a90590 con 0x55a396a82e30 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94161095684864] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94161095681264] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 17 ==== osd_op_reply(52 notify.4 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94161095688336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8f720 con 0x55a396a82e30 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a90de0 con 0x55a396a88180 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 10 ==== osd_op_reply(54 notify.5 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94161095690560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8f720 con 0x55a396a88180 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.774+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a91810 con 0x55a396a88180 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94161095688336] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94161095690560] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 12 ==== osd_op_reply(56 notify.6 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94161095691616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a91370 con 0x55a396a88180 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a92060 con 0x7f4a30020c00 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94161095691616] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 10 ==== osd_op_reply(58 notify.7 [create] v34'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94161095683680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a92060 con 0x7f4a30020c00 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=0 2024-03-20T13:38:18.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=1 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=2 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=3 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=4 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=5 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=6 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94161095683680] v34'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 20 add_watcher() i=7 2024-03-20T13:38:18.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 2 all 8 watchers are set, enabling cache 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.778+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a95300 con 0x55a396a7ea10 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94161095707872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a920e0 con 0x55a396a7ea10 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94161095707872] v34'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f48ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f4a4037d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f4a4037d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:38:18.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.782+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9d810 con 0x55a396a82e30 2024-03-20T13:38:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.786+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.786+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9d810 con 0x7f4a30020c00 2024-03-20T13:38:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.786+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.786+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9dec0 con 0x55a396a88180 2024-03-20T13:38:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.790+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.790+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9e3f0 con 0x55a396a7ea10 2024-03-20T13:38:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.790+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'241 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.790+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9e920 con 0x55a396a82e30 2024-03-20T13:38:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.794+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'78 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.794+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9ee50 con 0x55a396a88180 2024-03-20T13:38:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.794+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.794+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9f380 con 0x55a396a82e30 2024-03-20T13:38:18.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.798+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.798+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9f8b0 con 0x55a396a7ea10 2024-03-20T13:38:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.798+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.798+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fd50 con 0x55a396a82e30 2024-03-20T13:38:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.802+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.802+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fb80 con 0x55a396a82e30 2024-03-20T13:38:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.802+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.802+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fb60 con 0x55a396a82e30 2024-03-20T13:38:18.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.806+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'79 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.806+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fb60 con 0x55a396a88180 2024-03-20T13:38:18.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.806+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.806+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fb60 con 0x55a396a82e30 2024-03-20T13:38:18.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.810+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.810+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fb60 con 0x55a396a7ea10 2024-03-20T13:38:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.810+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.810+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fb60 con 0x55a396a7ea10 2024-03-20T13:38:18.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.814+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'242 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.814+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fbf0 con 0x55a396a82e30 2024-03-20T13:38:18.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.814+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.814+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fbf0 con 0x55a396a82e30 2024-03-20T13:38:18.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.818+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'80 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.818+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fbf0 con 0x55a396a88180 2024-03-20T13:38:18.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.822+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.822+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fce0 con 0x55a396a82e30 2024-03-20T13:38:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.822+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.822+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fce0 con 0x55a396a7ea10 2024-03-20T13:38:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.826+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'243 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.826+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9f6c0 con 0x55a396a82e30 2024-03-20T13:38:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.826+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.826+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a82e30 2024-03-20T13:38:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.830+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.830+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a88180 2024-03-20T13:38:18.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.830+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.830+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a82e30 2024-03-20T13:38:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.834+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.834+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a88180 2024-03-20T13:38:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.834+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.838+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a88180 2024-03-20T13:38:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.838+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.838+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a88180 2024-03-20T13:38:18.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.842+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.842+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a82e30 2024-03-20T13:38:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.842+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.842+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fc80 con 0x55a396a7ea10 2024-03-20T13:38:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.846+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.846+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fbf0 con 0x55a396a82e30 2024-03-20T13:38:18.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.846+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.846+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fbf0 con 0x55a396a7ea10 2024-03-20T13:38:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9fbf0 con 0x7f4a30020c00 2024-03-20T13:38:18.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f4a4037d980 20 init_complete bucket index max shards: 11 2024-03-20T13:38:18.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f48ee7fc640 20 reqs_thread_entry: start 2024-03-20T13:38:18.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f4a4037d980 20 Filter name: none 2024-03-20T13:38:18.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.850+0000 7f485ffff640 20 reqs_thread_entry: start 2024-03-20T13:38:18.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-20T13:38:18.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:94 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 34 ==== osd_op_reply(94 gc.18 [call] v34'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:95 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 35 ==== osd_op_reply(95 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.854+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:96 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 36 ==== osd_op_reply(96 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:97 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 37 ==== osd_op_reply(97 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:98 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 38 ==== osd_op_reply(98 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:99 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 39 ==== osd_op_reply(99 gc.18 [call] v34'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.858+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-20T13:38:18.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:100 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 27 ==== osd_op_reply(100 gc.19 [call] v34'244 uv244 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:101 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 28 ==== osd_op_reply(101 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:102 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:18.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 29 ==== osd_op_reply(102 gc.19 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:103 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:18.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 30 ==== osd_op_reply(103 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.862+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:104 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:18.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.866+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 31 ==== osd_op_reply(104 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.866+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.866+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:105 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.866+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 32 ==== osd_op_reply(105 gc.19 [call] v34'245 uv245 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.866+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-20T13:38:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.866+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:106 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 40 ==== osd_op_reply(106 gc.20 [call] v34'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:107 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 41 ==== osd_op_reply(107 gc.20 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:108 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 42 ==== osd_op_reply(108 gc.20 [call out=24b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:109 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 43 ==== osd_op_reply(109 gc.20 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:110 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.870+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 44 ==== osd_op_reply(110 gc.20 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.874+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.874+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:111 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.874+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 45 ==== osd_op_reply(111 gc.20 [call] v34'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.874+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-20T13:38:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.874+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:112 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 46 ==== osd_op_reply(112 gc.21 [call] v34'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:113 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 47 ==== osd_op_reply(113 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:114 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 48 ==== osd_op_reply(114 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:115 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 49 ==== osd_op_reply(115 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:116 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 50 ==== osd_op_reply(116 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.878+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:117 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.882+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 51 ==== osd_op_reply(117 gc.21 [call] v34'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.882+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-20T13:38:18.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.882+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:118 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 22 ==== osd_op_reply(118 gc.22 [call] v34'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:119 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 23 ==== osd_op_reply(119 gc.22 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:120 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:18.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 24 ==== osd_op_reply(120 gc.22 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:121 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 25 ==== osd_op_reply(121 gc.22 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:122 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 26 ==== osd_op_reply(122 gc.22 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:123 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 27 ==== osd_op_reply(123 gc.22 [call] v34'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-20T13:38:18.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.886+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:124 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 52 ==== osd_op_reply(124 gc.23 [call] v34'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:125 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 53 ==== osd_op_reply(125 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:126 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 54 ==== osd_op_reply(126 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:127 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 55 ==== osd_op_reply(127 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.890+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:128 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.894+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 56 ==== osd_op_reply(128 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.894+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.894+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:129 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.894+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 57 ==== osd_op_reply(129 gc.23 [call] v34'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.894+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-20T13:38:18.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.894+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:130 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 28 ==== osd_op_reply(130 gc.24 [call] v34'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:131 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 29 ==== osd_op_reply(131 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:132 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:18.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 30 ==== osd_op_reply(132 gc.24 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:133 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 31 ==== osd_op_reply(133 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:134 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 32 ==== osd_op_reply(134 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.898+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:135 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 33 ==== osd_op_reply(135 gc.24 [call] v34'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-20T13:38:18.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:136 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 34 ==== osd_op_reply(136 gc.25 [call] v34'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:137 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 35 ==== osd_op_reply(137 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:138 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 36 ==== osd_op_reply(138 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:139 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 37 ==== osd_op_reply(139 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:140 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 38 ==== osd_op_reply(140 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.902+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:141 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 39 ==== osd_op_reply(141 gc.25 [call] v34'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-20T13:38:18.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:142 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 40 ==== osd_op_reply(142 gc.26 [call] v34'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:143 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 41 ==== osd_op_reply(143 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.906+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:144 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 42 ==== osd_op_reply(144 gc.26 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:145 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 43 ==== osd_op_reply(145 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:146 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 44 ==== osd_op_reply(146 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:147 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 45 ==== osd_op_reply(147 gc.26 [call] v34'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-20T13:38:18.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.910+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:148 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 58 ==== osd_op_reply(148 gc.27 [call] v34'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:149 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 59 ==== osd_op_reply(149 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:150 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 60 ==== osd_op_reply(150 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:151 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 61 ==== osd_op_reply(151 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.914+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:152 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.918+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 62 ==== osd_op_reply(152 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.918+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.918+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:153 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.918+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 63 ==== osd_op_reply(153 gc.27 [call] v34'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.918+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-20T13:38:18.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.918+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:154 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 33 ==== osd_op_reply(154 gc.28 [call] v34'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:155 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 34 ==== osd_op_reply(155 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:156 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 35 ==== osd_op_reply(156 gc.28 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:157 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 36 ==== osd_op_reply(157 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:158 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 37 ==== osd_op_reply(158 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.922+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:159 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.926+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 38 ==== osd_op_reply(159 gc.28 [call] v34'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.926+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-20T13:38:18.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.926+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:160 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.926+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 64 ==== osd_op_reply(160 gc.29 [call] v34'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.926+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:161 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 65 ==== osd_op_reply(161 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:162 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 66 ==== osd_op_reply(162 gc.29 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:163 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 67 ==== osd_op_reply(163 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:164 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 68 ==== osd_op_reply(164 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.930+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:165 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.934+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 69 ==== osd_op_reply(165 gc.29 [call] v34'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.934+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-20T13:38:18.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.934+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:166 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 39 ==== osd_op_reply(166 gc.30 [call] v34'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:167 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 40 ==== osd_op_reply(167 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:168 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:18.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 41 ==== osd_op_reply(168 gc.30 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:169 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 42 ==== osd_op_reply(169 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:170 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 43 ==== osd_op_reply(170 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.938+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:171 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 44 ==== osd_op_reply(171 gc.30 [call] v34'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-20T13:38:18.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:172 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 14 ==== osd_op_reply(172 gc.31 [call] v34'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:173 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 15 ==== osd_op_reply(173 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:174 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x7f4a30020c00 2024-03-20T13:38:18.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 16 ==== osd_op_reply(174 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.942+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:175 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 17 ==== osd_op_reply(175 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:176 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 18 ==== osd_op_reply(176 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:177 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 19 ==== osd_op_reply(177 gc.31 [call] v34'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-20T13:38:18.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.946+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:178 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 70 ==== osd_op_reply(178 gc.0 [call] v34'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:179 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 71 ==== osd_op_reply(179 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:180 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 72 ==== osd_op_reply(180 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.950+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:181 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.954+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 73 ==== osd_op_reply(181 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.954+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.954+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:182 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.954+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 74 ==== osd_op_reply(182 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.954+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.954+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:183 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.958+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 75 ==== osd_op_reply(183 gc.0 [call] v34'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.958+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-20T13:38:18.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.958+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:184 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.958+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 20 ==== osd_op_reply(184 gc.1 [call] v34'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.958+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:185 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 21 ==== osd_op_reply(185 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:186 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x7f4a30020c00 2024-03-20T13:38:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 22 ==== osd_op_reply(186 gc.1 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:187 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 23 ==== osd_op_reply(187 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:188 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 24 ==== osd_op_reply(188 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:189 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x7f4a30020c00 2024-03-20T13:38:18.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 25 ==== osd_op_reply(189 gc.1 [call] v34'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:18.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-20T13:38:18.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.962+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:190 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 46 ==== osd_op_reply(190 gc.2 [call] v34'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:191 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 47 ==== osd_op_reply(191 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:192 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:18.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 48 ==== osd_op_reply(192 gc.2 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:193 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 49 ==== osd_op_reply(193 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.966+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:194 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.970+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 50 ==== osd_op_reply(194 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.970+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.970+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:195 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.970+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 51 ==== osd_op_reply(195 gc.2 [call] v34'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.970+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-20T13:38:18.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.970+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:196 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 45 ==== osd_op_reply(196 gc.3 [call] v34'246 uv246 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:197 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 46 ==== osd_op_reply(197 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:198 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:18.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 47 ==== osd_op_reply(198 gc.3 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:199 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 48 ==== osd_op_reply(199 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:200 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.974+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 49 ==== osd_op_reply(200 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.978+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.978+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:201 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.978+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 50 ==== osd_op_reply(201 gc.3 [call] v34'247 uv247 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.978+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-20T13:38:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.978+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:202 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 76 ==== osd_op_reply(202 gc.4 [call] v34'81 uv81 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:203 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 77 ==== osd_op_reply(203 gc.4 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:204 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 78 ==== osd_op_reply(204 gc.4 [call out=24b] v0'0 uv81 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:205 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 79 ==== osd_op_reply(205 gc.4 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.982+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:206 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 80 ==== osd_op_reply(206 gc.4 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:207 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 81 ==== osd_op_reply(207 gc.4 [call] v34'82 uv82 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-20T13:38:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.986+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:208 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 52 ==== osd_op_reply(208 gc.5 [call] v34'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:209 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 53 ==== osd_op_reply(209 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:210 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 54 ==== osd_op_reply(210 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:211 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 55 ==== osd_op_reply(211 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.990+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:212 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.994+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 56 ==== osd_op_reply(212 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.994+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.994+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:213 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.994+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 57 ==== osd_op_reply(213 gc.5 [call] v34'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.994+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-20T13:38:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.994+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:214 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 82 ==== osd_op_reply(214 gc.6 [call] v34'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:215 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 83 ==== osd_op_reply(215 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:216 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 84 ==== osd_op_reply(216 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:18.998+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:217 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.002+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 85 ==== osd_op_reply(217 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.002+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.002+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:218 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.002+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 86 ==== osd_op_reply(218 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.002+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.002+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:219 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 87 ==== osd_op_reply(219 gc.6 [call] v34'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-20T13:38:19.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:220 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 51 ==== osd_op_reply(220 gc.7 [call] v34'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:221 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 52 ==== osd_op_reply(221 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:222 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:19.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 53 ==== osd_op_reply(222 gc.7 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.006+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:223 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 54 ==== osd_op_reply(223 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:224 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 55 ==== osd_op_reply(224 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:225 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 56 ==== osd_op_reply(225 gc.7 [call] v34'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-20T13:38:19.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.010+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:226 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 88 ==== osd_op_reply(226 gc.8 [call] v34'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:227 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 89 ==== osd_op_reply(227 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:228 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 90 ==== osd_op_reply(228 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.014+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:229 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.018+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 91 ==== osd_op_reply(229 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.018+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.018+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:230 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.018+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 92 ==== osd_op_reply(230 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.018+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.018+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:231 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.022+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 93 ==== osd_op_reply(231 gc.8 [call] v34'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.022+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-20T13:38:19.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.022+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:232 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.022+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 94 ==== osd_op_reply(232 gc.9 [call] v34'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.022+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:233 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 95 ==== osd_op_reply(233 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:234 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 96 ==== osd_op_reply(234 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:235 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 97 ==== osd_op_reply(235 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.026+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:236 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.030+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 98 ==== osd_op_reply(236 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.030+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.030+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:237 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.030+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 99 ==== osd_op_reply(237 gc.9 [call] v34'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.030+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-20T13:38:19.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.034+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:238 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.034+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 100 ==== osd_op_reply(238 gc.10 [call] v34'83 uv83 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.034+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:239 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.034+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 101 ==== osd_op_reply(239 gc.10 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.034+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.034+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:240 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 102 ==== osd_op_reply(240 gc.10 [call out=24b] v0'0 uv83 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:241 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 103 ==== osd_op_reply(241 gc.10 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:242 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 104 ==== osd_op_reply(242 gc.10 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.038+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:243 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.042+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 105 ==== osd_op_reply(243 gc.10 [call] v34'84 uv84 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.042+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-20T13:38:19.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.042+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:244 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 58 ==== osd_op_reply(244 gc.11 [call] v34'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:245 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 59 ==== osd_op_reply(245 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:246 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:19.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 60 ==== osd_op_reply(246 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:247 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 61 ==== osd_op_reply(247 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:248 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 62 ==== osd_op_reply(248 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.046+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:249 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.050+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 63 ==== osd_op_reply(249 gc.11 [call] v34'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.050+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-20T13:38:19.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.050+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:250 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 106 ==== osd_op_reply(250 gc.12 [call] v34'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:251 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 107 ==== osd_op_reply(251 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:252 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 108 ==== osd_op_reply(252 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:253 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 109 ==== osd_op_reply(253 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.054+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:254 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.058+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 110 ==== osd_op_reply(254 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.058+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.058+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:255 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.058+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 111 ==== osd_op_reply(255 gc.12 [call] v34'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.058+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-20T13:38:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.058+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:256 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.062+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 57 ==== osd_op_reply(256 gc.13 [call] v34'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.062+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:257 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.062+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 58 ==== osd_op_reply(257 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.062+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.062+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:258 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 59 ==== osd_op_reply(258 gc.13 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:259 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:19.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 60 ==== osd_op_reply(259 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:260 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:19.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 61 ==== osd_op_reply(260 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:261 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.066+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 62 ==== osd_op_reply(261 gc.13 [call] v34'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.070+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-20T13:38:19.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.070+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:262 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.070+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 63 ==== osd_op_reply(262 gc.14 [call] v34'248 uv248 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.070+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:263 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.070+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 64 ==== osd_op_reply(263 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:264 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a7ea10 2024-03-20T13:38:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 65 ==== osd_op_reply(264 gc.14 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:265 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 66 ==== osd_op_reply(265 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:266 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 67 ==== osd_op_reply(266 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.074+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:267 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a7ea10 2024-03-20T13:38:19.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.078+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 68 ==== osd_op_reply(267 gc.14 [call] v34'249 uv249 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.078+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-20T13:38:19.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.078+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:268 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 112 ==== osd_op_reply(268 gc.15 [call] v34'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:269 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 113 ==== osd_op_reply(269 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:270 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 114 ==== osd_op_reply(270 gc.15 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:271 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 115 ==== osd_op_reply(271 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:272 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 116 ==== osd_op_reply(272 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.082+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:273 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.086+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 117 ==== osd_op_reply(273 gc.15 [call] v34'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.086+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-20T13:38:19.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.086+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:274 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 118 ==== osd_op_reply(274 gc.16 [call] v34'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:275 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 119 ==== osd_op_reply(275 gc.16 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:276 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a82e30 2024-03-20T13:38:19.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 120 ==== osd_op_reply(276 gc.16 [call out=24b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.090+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:277 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.094+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 121 ==== osd_op_reply(277 gc.16 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.094+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.094+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:278 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.094+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 122 ==== osd_op_reply(278 gc.16 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.094+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.094+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:279 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a82e30 2024-03-20T13:38:19.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.098+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 123 ==== osd_op_reply(279 gc.16 [call] v34'86 uv86 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.098+0000 7f4a4037d980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-20T13:38:19.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.098+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:280 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.098+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 64 ==== osd_op_reply(280 gc.17 [call] v34'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.098+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:281 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 65 ==== osd_op_reply(281 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:282 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a9b300 con 0x55a396a88180 2024-03-20T13:38:19.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 66 ==== osd_op_reply(282 gc.17 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:283 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 67 ==== osd_op_reply(283 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:38:19.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:284 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 68 ==== osd_op_reply(284 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:38:19.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.102+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:285 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396abb3c0 con 0x55a396a88180 2024-03-20T13:38:19.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.106+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 69 ==== osd_op_reply(285 gc.17 [call] v34'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.106+0000 7f48ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:38:19.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.106+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94161095707872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a7bcb0 con 0x55a396a7ea10 2024-03-20T13:38:19.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.110+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 69 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94161095707872] v34'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.110+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94161095671664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a94ce0 con 0x55a396a82e30 2024-03-20T13:38:19.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 124 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94161095671664] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a4037d980 20 remove_watcher() i=0 2024-03-20T13:38:19.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a4037d980 2 removed watcher, disabling cache 2024-03-20T13:38:19.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94161095678352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8bf70 con 0x55a396a7ea10 2024-03-20T13:38:19.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.1 v2:172.21.15.123:6800/3706732118 70 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94161095678352] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x55a396a7ea10 2024-03-20T13:38:19.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a4037d980 20 remove_watcher() i=1 2024-03-20T13:38:19.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.114+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94161095681264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8bf70 con 0x55a396a82e30 2024-03-20T13:38:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.118+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 125 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94161095681264] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.118+0000 7f4a4037d980 20 remove_watcher() i=2 2024-03-20T13:38:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.118+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94161095684864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8bf70 con 0x7f4a30020c00 2024-03-20T13:38:19.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.118+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 26 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94161095684864] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:19.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.118+0000 7f4a4037d980 20 remove_watcher() i=3 2024-03-20T13:38:19.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.118+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94161095688336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8bf70 con 0x55a396a82e30 2024-03-20T13:38:19.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.122+0000 7f4a3e699640 1 -- 172.21.15.123:0/444916149 <== osd.0 v2:172.21.15.89:6800/854515999 126 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94161095688336] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a3000a4d0 con 0x55a396a82e30 2024-03-20T13:38:19.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.122+0000 7f4a4037d980 20 remove_watcher() i=4 2024-03-20T13:38:19.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.122+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94161095690560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a90090 con 0x55a396a88180 2024-03-20T13:38:19.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.122+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 70 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94161095690560] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.122+0000 7f4a4037d980 20 remove_watcher() i=5 2024-03-20T13:38:19.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.122+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94161095691616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a8bf70 con 0x55a396a88180 2024-03-20T13:38:19.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a3de98640 1 -- 172.21.15.123:0/444916149 <== osd.3 v2:172.21.15.123:6816/3519650013 71 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94161095691616] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a380f9040 con 0x55a396a88180 2024-03-20T13:38:19.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 20 remove_watcher() i=6 2024-03-20T13:38:19.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94161095683680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) v8 -- 0x55a396a90090 con 0x7f4a30020c00 2024-03-20T13:38:19.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 <== osd.2 v2:172.21.15.123:6803/1251286685 27 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94161095683680] v34'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2800f620 con 0x7f4a30020c00 2024-03-20T13:38:19.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 20 remove_watcher() i=7 2024-03-20T13:38:19.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a82e30 msgr2=0x55a396a85220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a82e30 0x55a396a85220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a7ea10 msgr2=0x55a396a80ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a7ea10 0x55a396a80ed0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4a30020c00 msgr2=0x7f4a300382a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.126+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f4a30020c00 0x7f4a300382a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a396a88180 msgr2=0x55a396a8a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x55a396a88180 0x55a396a8a640 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49080342b0 msgr2=0x7f4908036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49080342b0 0x7f4908036770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a380b3c80 tx=0x7f4a380b3f90 comp rx=0 tx=0).stop 2024-03-20T13:38:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 msgr2=0x55a396a73330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a3d697640 1 -- 172.21.15.123:0/444916149 reap_dead start 2024-03-20T13:38:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a73330 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4a30011e20 tx=0x7f4a30049610 comp rx=0 tx=0).stop 2024-03-20T13:38:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 shutdown_connections 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/444916149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a6c480 0x55a396a73330 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 >> 172.21.15.123:0/444916149 conn(0x55a396a687c0 msgr2=0x55a396a65e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 shutdown_connections 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/444916149 wait complete. 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49180342b0 msgr2=0x7f4918036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49180342b0 0x7f4918036770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55a396951240 tx=0x7f4a380052e0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 msgr2=0x55a396a5f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 0x55a396a5f920 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a30016cf0 tx=0x7f4a3000d7a0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 shutdown_connections 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49180342b0 0x7f4918036770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/1784995457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396a5f500 0x55a396a5f920 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 >> 172.21.15.123:0/1784995457 conn(0x7f4a380dd000 msgr2=0x55a396a551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 shutdown_connections 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/1784995457 wait complete. 2024-03-20T13:38:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a4cf70 msgr2=0x55a396a4f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a4cf70 0x55a396a4f360 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a49dd0 msgr2=0x55a396a4c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a49dd0 0x55a396a4c1c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49240343a0 msgr2=0x7f4924036860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49240343a0 0x7f4924036860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000f70 tx=0x7f4a28001380 comp rx=0 tx=0).stop 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 msgr2=0x55a396952300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 0x55a396952300 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a38003070 tx=0x7f4a380180e0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 shutdown_connections 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x55a396a4cf70 0x55a396a4f360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x55a396a49dd0 0x55a396a4c1c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f49240343a0 0x7f4924036860 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 --2- 172.21.15.123:0/3531851645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a396955130 0x55a396952300 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 >> 172.21.15.123:0/3531851645 conn(0x55a39694c710 msgr2=0x55a396a36560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 shutdown_connections 2024-03-20T13:38:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-03-20T13:38:19.130+0000 7f4a4037d980 1 -- 172.21.15.123:0/3531851645 wait complete. 2024-03-20T13:38:19.152 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-20T13:38:19.161 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-20T13:38:19.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:38:19.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.286+0000 7f93ffc24640 1 Processor -- start 2024-03-20T13:38:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.286+0000 7f93ffc24640 1 -- start start 2024-03-20T13:38:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.286+0000 7f93ffc24640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93f8098830 0x7f93f8098c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.286+0000 7f93ffc24640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f809a490 con 0x7f93f8099150 2024-03-20T13:38:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.286+0000 7f93ffc24640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f8072800 con 0x7f93f8098830 2024-03-20T13:38:19.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fd9c0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93f8098830 0x7f93f8098c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fd1bf640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f93f8099150 0x7f93f8096490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60084/0 (socket says 172.21.15.89:60084) 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fd1bf640 1 -- 172.21.15.89:0/2710081625 learned_addr learned my addr 172.21.15.89:0/2710081625 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fc9be640 1 -- 172.21.15.89:0/2710081625 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068532975 0 0) 0x7f93f809a490 con 0x7f93f8099150 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fc9be640 1 -- 172.21.15.89:0/2710081625 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4003530 con 0x7f93f8099150 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fd9c0640 1 -- 172.21.15.89:0/2710081625 >> v1:172.21.15.89:6789/0 conn(0x7f93f8099150 legacy=0x7f93f8096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fc9be640 1 -- 172.21.15.89:0/2710081625 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893677996 0 0) 0x7f93e4003530 con 0x7f93f8099150 2024-03-20T13:38:19.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fd9c0640 1 -- 172.21.15.89:0/2710081625 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f809d790 con 0x7f93f8098830 2024-03-20T13:38:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fd9c0640 1 --2- 172.21.15.89:0/2710081625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f8098c10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009740 tx=0x7f93ec01c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7291000350ed8946 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fc9be640 1 -- 172.21.15.89:0/2710081625 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93f4001930 con 0x7f93f8098830 2024-03-20T13:38:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fc9be640 1 -- 172.21.15.89:0/2710081625 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec0a4ce0 con 0x7f93f8098830 2024-03-20T13:38:19.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.290+0000 7f93fc9be640 1 -- 172.21.15.89:0/2710081625 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0ac440 con 0x7f93f8098830 2024-03-20T13:38:19.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2710081625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 msgr2=0x7f93f8098c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 --2- 172.21.15.89:0/2710081625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f8098c10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009740 tx=0x7f93ec01c290 comp rx=0 tx=0).stop 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2710081625 shutdown_connections 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 --2- 172.21.15.89:0/2710081625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f8098c10 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2710081625 >> 172.21.15.89:0/2710081625 conn(0x7f93f80a0920 msgr2=0x7f93f809ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2710081625 shutdown_connections 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2710081625 wait complete. 2024-03-20T13:38:19.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 Processor -- start 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- start start 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f812fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81315d0 con 0x7f93f8098830 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93fd9c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f812fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93fd9c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f812fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34944/0 (socket says 172.21.15.89:34944) 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93fd9c0640 1 -- 172.21.15.89:0/2980968528 learned_addr learned my addr 172.21.15.89:0/2980968528 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93fd9c0640 1 -- 172.21.15.89:0/2980968528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec009420 con 0x7f93f8098830 2024-03-20T13:38:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93fd9c0640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f812fc80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f93ec019ec0 tx=0x7f93ec019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0ace50 con 0x7f93f8098830 2024-03-20T13:38:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec0b5410 con 0x7f93f8098830 2024-03-20T13:38:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f8132650 con 0x7f93f8098830 2024-03-20T13:38:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0b56d0 con 0x7f93f8098830 2024-03-20T13:38:19.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f8132120 con 0x7f93f8098830 2024-03-20T13:38:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f93ec0b3040 con 0x7f93f8098830 2024-03-20T13:38:19.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f8133570 con 0x7f93f8098830 2024-03-20T13:38:19.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ea7fc640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93dc035a10 0x7f93dc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:19.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.294+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f93ec0e2980 con 0x7f93f8098830 2024-03-20T13:38:19.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.298+0000 7f93fd1bf640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93dc035a10 0x7f93dc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:19.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.298+0000 7f93fd1bf640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93dc035a10 0x7f93dc037ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005c10 tx=0x7f93f40015c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:19.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.302+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93f8133570 con 0x7f93f8098830 2024-03-20T13:38:19.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.458+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93f8126630 con 0x7f93dc035a10 2024-03-20T13:38:19.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.506+0000 7f93ea7fc640 1 -- 172.21.15.89:0/2980968528 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673721 (secure 0 0 0) 0x7f93f8126630 con 0x7f93dc035a10 2024-03-20T13:38:19.514 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:38:19.521 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:38:19.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93dc035a10 msgr2=0x7f93dc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93dc035a10 0x7f93dc037ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005c10 tx=0x7f93f40015c0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 msgr2=0x7f93f812fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f812fc80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f93ec019ec0 tx=0x7f93ec019030 comp rx=0 tx=0).stop 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 shutdown_connections 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f93dc035a10 0x7f93dc037ed0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 --2- 172.21.15.89:0/2980968528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8098830 0x7f93f812fc80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 >> 172.21.15.89:0/2980968528 conn(0x7f93f80a0920 msgr2=0x7f93f809ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 shutdown_connections 2024-03-20T13:38:19.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.514+0000 7f93ffc24640 1 -- 172.21.15.89:0/2980968528 wait complete. 2024-03-20T13:38:19.535 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-03-20T13:38:18.285166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3794,"num_read_kb":3437,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-19,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":348,"num_read_kb":331,"num_write":116,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006249"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353220+0000","last_change":"2024-03-20T13:36:36.834585+0000","last_active":"2024-03-20T13:37:17.353220+0000","last_peered":"2024-03-20T13:37:17.353220+0000","last_clean":"2024-03-20T13:37:17.353220+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:37:17.353220+0000","last_undegraded":"2024-03-20T13:37:17.353220+0000","last_fullsized":"2024-03-20T13:37:17.353220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:42.695830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348328+0000","last_change":"2024-03-20T13:36:38.833359+0000","last_active":"2024-03-20T13:37:17.348328+0000","last_peered":"2024-03-20T13:37:17.348328+0000","last_clean":"2024-03-20T13:37:17.348328+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:37:17.348328+0000","last_undegraded":"2024-03-20T13:37:17.348328+0000","last_fullsized":"2024-03-20T13:37:17.348328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359019+0000","last_change":"2024-03-20T13:36:36.849152+0000","last_active":"2024-03-20T13:37:17.359019+0000","last_peered":"2024-03-20T13:37:17.359019+0000","last_clean":"2024-03-20T13:37:17.359019+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:37:17.359019+0000","last_undegraded":"2024-03-20T13:37:17.359019+0000","last_fullsized":"2024-03-20T13:37:17.359019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:26.137179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038312+0000","last_change":"2024-03-20T13:36:38.817960+0000","last_active":"2024-03-20T13:38:11.038312+0000","last_peered":"2024-03-20T13:38:11.038312+0000","last_clean":"2024-03-20T13:38:11.038312+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:38:11.038312+0000","last_undegraded":"2024-03-20T13:38:11.038312+0000","last_fullsized":"2024-03-20T13:38:11.038312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:21:08.799966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351979+0000","last_change":"2024-03-20T13:36:36.848291+0000","last_active":"2024-03-20T13:37:17.351979+0000","last_peered":"2024-03-20T13:37:17.351979+0000","last_clean":"2024-03-20T13:37:17.351979+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:37:17.351979+0000","last_undegraded":"2024-03-20T13:37:17.351979+0000","last_fullsized":"2024-03-20T13:37:17.351979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559658+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:04.559658+0000","last_peered":"2024-03-20T13:38:04.559658+0000","last_clean":"2024-03-20T13:38:04.559658+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:04.559658+0000","last_undegraded":"2024-03-20T13:38:04.559658+0000","last_fullsized":"2024-03-20T13:38:04.559658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:50.112294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338808+0000","last_change":"2024-03-20T13:36:36.813481+0000","last_active":"2024-03-20T13:37:17.338808+0000","last_peered":"2024-03-20T13:37:17.338808+0000","last_clean":"2024-03-20T13:37:17.338808+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:37:17.338808+0000","last_undegraded":"2024-03-20T13:37:17.338808+0000","last_fullsized":"2024-03-20T13:37:17.338808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:54.373470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.335849+0000","last_change":"2024-03-20T13:36:38.821653+0000","last_active":"2024-03-20T13:37:21.335849+0000","last_peered":"2024-03-20T13:37:21.335849+0000","last_clean":"2024-03-20T13:37:21.335849+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:37:21.335849+0000","last_undegraded":"2024-03-20T13:37:21.335849+0000","last_fullsized":"2024-03-20T13:37:21.335849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.030141+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:11.030141+0000","last_peered":"2024-03-20T13:38:11.030141+0000","last_clean":"2024-03-20T13:38:11.030141+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:11.030141+0000","last_undegraded":"2024-03-20T13:38:11.030141+0000","last_fullsized":"2024-03-20T13:38:11.030141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361558+0000","last_change":"2024-03-20T13:36:38.841957+0000","last_active":"2024-03-20T13:38:05.361558+0000","last_peered":"2024-03-20T13:38:05.361558+0000","last_clean":"2024-03-20T13:38:05.361558+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:05.361558+0000","last_undegraded":"2024-03-20T13:38:05.361558+0000","last_fullsized":"2024-03-20T13:38:05.361558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:10.770393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349494+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:37:17.349494+0000","last_peered":"2024-03-20T13:37:17.349494+0000","last_clean":"2024-03-20T13:37:17.349494+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:37:17.349494+0000","last_undegraded":"2024-03-20T13:37:17.349494+0000","last_fullsized":"2024-03-20T13:37:17.349494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.779828+0000","last_change":"2024-03-20T13:36:38.846021+0000","last_active":"2024-03-20T13:37:21.779828+0000","last_peered":"2024-03-20T13:37:21.779828+0000","last_clean":"2024-03-20T13:37:21.779828+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:37:21.779828+0000","last_undegraded":"2024-03-20T13:37:21.779828+0000","last_fullsized":"2024-03-20T13:37:21.779828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342434+0000","last_change":"2024-03-20T13:36:36.844496+0000","last_active":"2024-03-20T13:37:17.342434+0000","last_peered":"2024-03-20T13:37:17.342434+0000","last_clean":"2024-03-20T13:37:17.342434+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:37:17.342434+0000","last_undegraded":"2024-03-20T13:37:17.342434+0000","last_fullsized":"2024-03-20T13:37:17.342434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356403+0000","last_change":"2024-03-20T13:36:38.843718+0000","last_active":"2024-03-20T13:37:17.356403+0000","last_peered":"2024-03-20T13:37:17.356403+0000","last_clean":"2024-03-20T13:37:17.356403+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:37:17.356403+0000","last_undegraded":"2024-03-20T13:37:17.356403+0000","last_fullsized":"2024-03-20T13:37:17.356403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:16.103447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.529939+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:37:20.529939+0000","last_peered":"2024-03-20T13:37:20.529939+0000","last_clean":"2024-03-20T13:37:20.529939+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:37:20.529939+0000","last_undegraded":"2024-03-20T13:37:20.529939+0000","last_fullsized":"2024-03-20T13:37:20.529939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:29.131356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048710+0000","last_change":"2024-03-20T13:36:38.830884+0000","last_active":"2024-03-20T13:38:11.048710+0000","last_peered":"2024-03-20T13:38:11.048710+0000","last_clean":"2024-03-20T13:38:11.048710+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:11.048710+0000","last_undegraded":"2024-03-20T13:38:11.048710+0000","last_fullsized":"2024-03-20T13:38:11.048710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:06.433353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348004+0000","last_change":"2024-03-20T13:36:38.833138+0000","last_active":"2024-03-20T13:37:17.348004+0000","last_peered":"2024-03-20T13:37:17.348004+0000","last_clean":"2024-03-20T13:37:17.348004+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:37:17.348004+0000","last_undegraded":"2024-03-20T13:37:17.348004+0000","last_fullsized":"2024-03-20T13:37:17.348004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.070212+0000","last_change":"2024-03-20T13:36:36.832461+0000","last_active":"2024-03-20T13:37:22.070212+0000","last_peered":"2024-03-20T13:37:22.070212+0000","last_clean":"2024-03-20T13:37:22.070212+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:37:22.070212+0000","last_undegraded":"2024-03-20T13:37:22.070212+0000","last_fullsized":"2024-03-20T13:37:22.070212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:29:37.186470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.039239+0000","last_change":"2024-03-20T13:36:38.843593+0000","last_active":"2024-03-20T13:38:11.039239+0000","last_peered":"2024-03-20T13:38:11.039239+0000","last_clean":"2024-03-20T13:38:11.039239+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:11.039239+0000","last_undegraded":"2024-03-20T13:38:11.039239+0000","last_fullsized":"2024-03-20T13:38:11.039239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347887+0000","last_change":"2024-03-20T13:36:36.818443+0000","last_active":"2024-03-20T13:37:17.347887+0000","last_peered":"2024-03-20T13:37:17.347887+0000","last_clean":"2024-03-20T13:37:17.347887+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:37:17.347887+0000","last_undegraded":"2024-03-20T13:37:17.347887+0000","last_fullsized":"2024-03-20T13:37:17.347887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:58:23.109004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362815+0000","last_change":"2024-03-20T13:36:38.831759+0000","last_active":"2024-03-20T13:38:05.362815+0000","last_peered":"2024-03-20T13:38:05.362815+0000","last_clean":"2024-03-20T13:38:05.362815+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:05.362815+0000","last_undegraded":"2024-03-20T13:38:05.362815+0000","last_fullsized":"2024-03-20T13:38:05.362815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:21.180969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353762+0000","last_change":"2024-03-20T13:36:36.840606+0000","last_active":"2024-03-20T13:37:17.353762+0000","last_peered":"2024-03-20T13:37:17.353762+0000","last_clean":"2024-03-20T13:37:17.353762+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:37:17.353762+0000","last_undegraded":"2024-03-20T13:37:17.353762+0000","last_fullsized":"2024-03-20T13:37:17.353762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038457+0000","last_change":"2024-03-20T13:36:38.828329+0000","last_active":"2024-03-20T13:38:11.038457+0000","last_peered":"2024-03-20T13:38:11.038457+0000","last_clean":"2024-03-20T13:38:11.038457+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:11.038457+0000","last_undegraded":"2024-03-20T13:38:11.038457+0000","last_fullsized":"2024-03-20T13:38:11.038457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:12.734298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.088045+0000","last_change":"2024-03-20T13:36:36.826166+0000","last_active":"2024-03-20T13:37:22.088045+0000","last_peered":"2024-03-20T13:37:22.088045+0000","last_clean":"2024-03-20T13:37:22.088045+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:37:22.088045+0000","last_undegraded":"2024-03-20T13:37:22.088045+0000","last_fullsized":"2024-03-20T13:37:22.088045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.337413+0000","last_change":"2024-03-20T13:36:38.825590+0000","last_active":"2024-03-20T13:37:21.337413+0000","last_peered":"2024-03-20T13:37:21.337413+0000","last_clean":"2024-03-20T13:37:21.337413+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:37:21.337413+0000","last_undegraded":"2024-03-20T13:37:21.337413+0000","last_fullsized":"2024-03-20T13:37:21.337413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:35.374667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355672+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:37:17.355672+0000","last_peered":"2024-03-20T13:37:17.355672+0000","last_clean":"2024-03-20T13:37:17.355672+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:37:17.355672+0000","last_undegraded":"2024-03-20T13:37:17.355672+0000","last_fullsized":"2024-03-20T13:37:17.355672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:27.631307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.336262+0000","last_change":"2024-03-20T13:36:38.836549+0000","last_active":"2024-03-20T13:37:21.336262+0000","last_peered":"2024-03-20T13:37:21.336262+0000","last_clean":"2024-03-20T13:37:21.336262+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:37:21.336262+0000","last_undegraded":"2024-03-20T13:37:21.336262+0000","last_fullsized":"2024-03-20T13:37:21.336262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:33.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356996+0000","last_change":"2024-03-20T13:36:36.848317+0000","last_active":"2024-03-20T13:37:17.356996+0000","last_peered":"2024-03-20T13:37:17.356996+0000","last_clean":"2024-03-20T13:37:17.356996+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:37:17.356996+0000","last_undegraded":"2024-03-20T13:37:17.356996+0000","last_fullsized":"2024-03-20T13:37:17.356996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.021474+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:11.021474+0000","last_peered":"2024-03-20T13:38:11.021474+0000","last_clean":"2024-03-20T13:38:11.021474+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:11.021474+0000","last_undegraded":"2024-03-20T13:38:11.021474+0000","last_fullsized":"2024-03-20T13:38:11.021474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:59:50.691433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361696+0000","last_change":"2024-03-20T13:36:38.833120+0000","last_active":"2024-03-20T13:38:05.361696+0000","last_peered":"2024-03-20T13:38:05.361696+0000","last_clean":"2024-03-20T13:38:05.361696+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:05.361696+0000","last_undegraded":"2024-03-20T13:38:05.361696+0000","last_fullsized":"2024-03-20T13:38:05.361696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350014+0000","last_change":"2024-03-20T13:36:36.847955+0000","last_active":"2024-03-20T13:37:17.350014+0000","last_peered":"2024-03-20T13:37:17.350014+0000","last_clean":"2024-03-20T13:37:17.350014+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:37:17.350014+0000","last_undegraded":"2024-03-20T13:37:17.350014+0000","last_fullsized":"2024-03-20T13:37:17.350014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358800+0000","last_change":"2024-03-20T13:36:40.850195+0000","last_active":"2024-03-20T13:37:17.358800+0000","last_peered":"2024-03-20T13:37:17.358800+0000","last_clean":"2024-03-20T13:37:17.358800+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:37:17.358800+0000","last_undegraded":"2024-03-20T13:37:17.358800+0000","last_fullsized":"2024-03-20T13:37:17.358800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.321997+0000","last_change":"2024-03-20T13:36:42.847305+0000","last_active":"2024-03-20T13:38:05.321997+0000","last_peered":"2024-03-20T13:38:05.321997+0000","last_clean":"2024-03-20T13:38:05.321997+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:05.321997+0000","last_undegraded":"2024-03-20T13:38:05.321997+0000","last_fullsized":"2024-03-20T13:38:05.321997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351069+0000","last_change":"2024-03-20T13:36:44.870120+0000","last_active":"2024-03-20T13:37:17.351069+0000","last_peered":"2024-03-20T13:37:17.351069+0000","last_clean":"2024-03-20T13:37:17.351069+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:37:17.351069+0000","last_undegraded":"2024-03-20T13:37:17.351069+0000","last_fullsized":"2024-03-20T13:37:17.351069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:00.348882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.510685+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:37:59.510685+0000","last_peered":"2024-03-20T13:37:59.510685+0000","last_clean":"2024-03-20T13:37:59.510685+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:37:59.510685+0000","last_undegraded":"2024-03-20T13:37:59.510685+0000","last_fullsized":"2024-03-20T13:37:59.510685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099067+0000","last_change":"2024-03-20T13:36:38.822857+0000","last_active":"2024-03-20T13:37:22.099067+0000","last_peered":"2024-03-20T13:37:22.099067+0000","last_clean":"2024-03-20T13:37:22.099067+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:37:22.099067+0000","last_undegraded":"2024-03-20T13:37:22.099067+0000","last_fullsized":"2024-03-20T13:37:22.099067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337639+0000","last_change":"2024-03-20T13:36:36.815979+0000","last_active":"2024-03-20T13:37:17.337639+0000","last_peered":"2024-03-20T13:37:17.337639+0000","last_clean":"2024-03-20T13:37:17.337639+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:37:17.337639+0000","last_undegraded":"2024-03-20T13:37:17.337639+0000","last_fullsized":"2024-03-20T13:37:17.337639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:15:50.640696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351375+0000","last_change":"2024-03-20T13:36:40.852967+0000","last_active":"2024-03-20T13:37:17.351375+0000","last_peered":"2024-03-20T13:37:17.351375+0000","last_clean":"2024-03-20T13:37:17.351375+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:37:17.351375+0000","last_undegraded":"2024-03-20T13:37:17.351375+0000","last_fullsized":"2024-03-20T13:37:17.351375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:13:55.770914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358636+0000","last_change":"2024-03-20T13:36:42.851506+0000","last_active":"2024-03-20T13:37:17.358636+0000","last_peered":"2024-03-20T13:37:17.358636+0000","last_clean":"2024-03-20T13:37:17.358636+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:37:17.358636+0000","last_undegraded":"2024-03-20T13:37:17.358636+0000","last_fullsized":"2024-03-20T13:37:17.358636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:47:54.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352979+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:37:17.352979+0000","last_peered":"2024-03-20T13:37:17.352979+0000","last_clean":"2024-03-20T13:37:17.352979+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:37:17.352979+0000","last_undegraded":"2024-03-20T13:37:17.352979+0000","last_fullsized":"2024-03-20T13:37:17.352979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:55:33.559340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355634+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:37:17.355634+0000","last_peered":"2024-03-20T13:37:17.355634+0000","last_clean":"2024-03-20T13:37:17.355634+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:37:17.355634+0000","last_undegraded":"2024-03-20T13:37:17.355634+0000","last_fullsized":"2024-03-20T13:37:17.355634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:19.393599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038369+0000","last_change":"2024-03-20T13:37:17.351202+0000","last_active":"2024-03-20T13:38:11.038369+0000","last_peered":"2024-03-20T13:38:11.038369+0000","last_clean":"2024-03-20T13:38:11.038369+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:38:11.038369+0000","last_undegraded":"2024-03-20T13:38:11.038369+0000","last_fullsized":"2024-03-20T13:38:11.038369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:50.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347515+0000","last_change":"2024-03-20T13:36:36.825659+0000","last_active":"2024-03-20T13:37:17.347515+0000","last_peered":"2024-03-20T13:37:17.347515+0000","last_clean":"2024-03-20T13:37:17.347515+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:37:17.347515+0000","last_undegraded":"2024-03-20T13:37:17.347515+0000","last_fullsized":"2024-03-20T13:37:17.347515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359882+0000","last_change":"2024-03-20T13:36:40.850731+0000","last_active":"2024-03-20T13:37:17.359882+0000","last_peered":"2024-03-20T13:37:17.359882+0000","last_clean":"2024-03-20T13:37:17.359882+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:37:17.359882+0000","last_undegraded":"2024-03-20T13:37:17.359882+0000","last_fullsized":"2024-03-20T13:37:17.359882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:23:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338522+0000","last_change":"2024-03-20T13:36:42.855730+0000","last_active":"2024-03-20T13:37:17.338522+0000","last_peered":"2024-03-20T13:37:17.338522+0000","last_clean":"2024-03-20T13:37:17.338522+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:37:17.338522+0000","last_undegraded":"2024-03-20T13:37:17.338522+0000","last_fullsized":"2024-03-20T13:37:17.338522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:03:28.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'240","reported_seq":305,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.269990+0000","last_change":"2024-03-20T13:36:44.878389+0000","last_active":"2024-03-20T13:38:11.269990+0000","last_peered":"2024-03-20T13:38:11.269990+0000","last_clean":"2024-03-20T13:38:11.269990+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:38:11.269990+0000","last_undegraded":"2024-03-20T13:38:11.269990+0000","last_fullsized":"2024-03-20T13:38:11.269990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:53.957445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335764+0000","last_change":"2024-03-20T13:36:46.888952+0000","last_active":"2024-03-20T13:37:17.335764+0000","last_peered":"2024-03-20T13:37:17.335764+0000","last_clean":"2024-03-20T13:37:17.335764+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:37:17.335764+0000","last_undegraded":"2024-03-20T13:37:17.335764+0000","last_fullsized":"2024-03-20T13:37:17.335764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:04:07.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.804073+0000","last_change":"2024-03-20T13:36:38.835366+0000","last_active":"2024-03-20T13:37:22.804073+0000","last_peered":"2024-03-20T13:37:22.804073+0000","last_clean":"2024-03-20T13:37:22.804073+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:37:22.804073+0000","last_undegraded":"2024-03-20T13:37:22.804073+0000","last_fullsized":"2024-03-20T13:37:22.804073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347002+0000","last_change":"2024-03-20T13:36:36.838074+0000","last_active":"2024-03-20T13:37:17.347002+0000","last_peered":"2024-03-20T13:37:17.347002+0000","last_clean":"2024-03-20T13:37:17.347002+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:37:17.347002+0000","last_undegraded":"2024-03-20T13:37:17.347002+0000","last_fullsized":"2024-03-20T13:37:17.347002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356582+0000","last_change":"2024-03-20T13:36:40.859660+0000","last_active":"2024-03-20T13:37:17.356582+0000","last_peered":"2024-03-20T13:37:17.356582+0000","last_clean":"2024-03-20T13:37:17.356582+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:37:17.356582+0000","last_undegraded":"2024-03-20T13:37:17.356582+0000","last_fullsized":"2024-03-20T13:37:17.356582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:53.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.314066+0000","last_change":"2024-03-20T13:36:42.860645+0000","last_active":"2024-03-20T13:38:05.314066+0000","last_peered":"2024-03-20T13:38:05.314066+0000","last_clean":"2024-03-20T13:38:05.314066+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:05.314066+0000","last_undegraded":"2024-03-20T13:38:05.314066+0000","last_fullsized":"2024-03-20T13:38:05.314066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:31:48.342447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'240","reported_seq":319,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.275024+0000","last_change":"2024-03-20T13:36:44.897812+0000","last_active":"2024-03-20T13:38:11.275024+0000","last_peered":"2024-03-20T13:38:11.275024+0000","last_clean":"2024-03-20T13:38:11.275024+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:11.275024+0000","last_undegraded":"2024-03-20T13:38:11.275024+0000","last_fullsized":"2024-03-20T13:38:11.275024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:31.390443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357541+0000","last_change":"2024-03-20T13:37:17.356166+0000","last_active":"2024-03-20T13:37:17.357541+0000","last_peered":"2024-03-20T13:37:17.357541+0000","last_clean":"2024-03-20T13:37:17.357541+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:37:17.357541+0000","last_undegraded":"2024-03-20T13:37:17.357541+0000","last_fullsized":"2024-03-20T13:37:17.357541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:05.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353407+0000","last_change":"2024-03-20T13:36:36.834443+0000","last_active":"2024-03-20T13:37:17.353407+0000","last_peered":"2024-03-20T13:37:17.353407+0000","last_clean":"2024-03-20T13:37:17.353407+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:37:17.353407+0000","last_undegraded":"2024-03-20T13:37:17.353407+0000","last_fullsized":"2024-03-20T13:37:17.353407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:29:03.754269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344058+0000","last_change":"2024-03-20T13:36:40.857714+0000","last_active":"2024-03-20T13:37:17.344058+0000","last_peered":"2024-03-20T13:37:17.344058+0000","last_clean":"2024-03-20T13:37:17.344058+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:37:17.344058+0000","last_undegraded":"2024-03-20T13:37:17.344058+0000","last_fullsized":"2024-03-20T13:37:17.344058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:24:44.271212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.331094+0000","last_change":"2024-03-20T13:36:42.873431+0000","last_active":"2024-03-20T13:38:05.331094+0000","last_peered":"2024-03-20T13:38:05.331094+0000","last_clean":"2024-03-20T13:38:05.331094+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:05.331094+0000","last_undegraded":"2024-03-20T13:38:05.331094+0000","last_fullsized":"2024-03-20T13:38:05.331094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:08:30.363113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":54,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349777+0000","last_change":"2024-03-20T13:36:44.866647+0000","last_active":"2024-03-20T13:37:17.349777+0000","last_peered":"2024-03-20T13:37:17.349777+0000","last_clean":"2024-03-20T13:37:17.349777+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:37:17.349777+0000","last_undegraded":"2024-03-20T13:37:17.349777+0000","last_fullsized":"2024-03-20T13:37:17.349777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:19.236268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.105778+0000","last_change":"2024-03-20T13:36:46.889608+0000","last_active":"2024-03-20T13:38:05.105778+0000","last_peered":"2024-03-20T13:38:05.105778+0000","last_clean":"2024-03-20T13:38:05.105778+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:05.105778+0000","last_undegraded":"2024-03-20T13:38:05.105778+0000","last_fullsized":"2024-03-20T13:38:05.105778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:14.771685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345198+0000","last_change":"2024-03-20T13:36:38.831983+0000","last_active":"2024-03-20T13:37:17.345198+0000","last_peered":"2024-03-20T13:37:17.345198+0000","last_clean":"2024-03-20T13:37:17.345198+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:37:17.345198+0000","last_undegraded":"2024-03-20T13:37:17.345198+0000","last_fullsized":"2024-03-20T13:37:17.345198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:57:18.786192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353826+0000","last_change":"2024-03-20T13:36:36.839624+0000","last_active":"2024-03-20T13:37:17.353826+0000","last_peered":"2024-03-20T13:37:17.353826+0000","last_clean":"2024-03-20T13:37:17.353826+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:37:17.353826+0000","last_undegraded":"2024-03-20T13:37:17.353826+0000","last_fullsized":"2024-03-20T13:37:17.353826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:14:30.338597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336329+0000","last_change":"2024-03-20T13:36:40.856999+0000","last_active":"2024-03-20T13:37:17.336329+0000","last_peered":"2024-03-20T13:37:17.336329+0000","last_clean":"2024-03-20T13:37:17.336329+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:37:17.336329+0000","last_undegraded":"2024-03-20T13:37:17.336329+0000","last_fullsized":"2024-03-20T13:37:17.336329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:58.874311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.296019+0000","last_change":"2024-03-20T13:36:42.844797+0000","last_active":"2024-03-20T13:38:05.296019+0000","last_peered":"2024-03-20T13:38:05.296019+0000","last_clean":"2024-03-20T13:38:05.296019+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:05.296019+0000","last_undegraded":"2024-03-20T13:38:05.296019+0000","last_fullsized":"2024-03-20T13:38:05.296019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:15:52.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356072+0000","last_change":"2024-03-20T13:36:44.888691+0000","last_active":"2024-03-20T13:37:17.356072+0000","last_peered":"2024-03-20T13:37:17.356072+0000","last_clean":"2024-03-20T13:37:17.356072+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:37:17.356072+0000","last_undegraded":"2024-03-20T13:37:17.356072+0000","last_fullsized":"2024-03-20T13:37:17.356072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:29.837819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.378145+0000","last_change":"2024-03-20T13:36:46.873147+0000","last_active":"2024-03-20T13:37:59.378145+0000","last_peered":"2024-03-20T13:37:59.378145+0000","last_clean":"2024-03-20T13:37:59.378145+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:37:59.378145+0000","last_undegraded":"2024-03-20T13:37:59.378145+0000","last_fullsized":"2024-03-20T13:37:59.378145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:16.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350555+0000","last_change":"2024-03-20T13:36:38.827772+0000","last_active":"2024-03-20T13:37:17.350555+0000","last_peered":"2024-03-20T13:37:17.350555+0000","last_clean":"2024-03-20T13:37:17.350555+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:37:17.350555+0000","last_undegraded":"2024-03-20T13:37:17.350555+0000","last_fullsized":"2024-03-20T13:37:17.350555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354432+0000","last_change":"2024-03-20T13:36:36.826408+0000","last_active":"2024-03-20T13:37:17.354432+0000","last_peered":"2024-03-20T13:37:17.354432+0000","last_clean":"2024-03-20T13:37:17.354432+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:37:17.354432+0000","last_undegraded":"2024-03-20T13:37:17.354432+0000","last_fullsized":"2024-03-20T13:37:17.354432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:21.851320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338772+0000","last_change":"2024-03-20T13:36:40.846177+0000","last_active":"2024-03-20T13:37:17.338772+0000","last_peered":"2024-03-20T13:37:17.338772+0000","last_clean":"2024-03-20T13:37:17.338772+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:37:17.338772+0000","last_undegraded":"2024-03-20T13:37:17.338772+0000","last_fullsized":"2024-03-20T13:37:17.338772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:09.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.334061+0000","last_change":"2024-03-20T13:36:42.841973+0000","last_active":"2024-03-20T13:38:05.334061+0000","last_peered":"2024-03-20T13:38:05.334061+0000","last_clean":"2024-03-20T13:38:05.334061+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:05.334061+0000","last_undegraded":"2024-03-20T13:38:05.334061+0000","last_fullsized":"2024-03-20T13:38:05.334061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'240","reported_seq":284,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.276315+0000","last_change":"2024-03-20T13:36:44.881852+0000","last_active":"2024-03-20T13:38:11.276315+0000","last_peered":"2024-03-20T13:38:11.276315+0000","last_clean":"2024-03-20T13:38:11.276315+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:11.276315+0000","last_undegraded":"2024-03-20T13:38:11.276315+0000","last_fullsized":"2024-03-20T13:38:11.276315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:56.157507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351002+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:37:17.351002+0000","last_peered":"2024-03-20T13:37:17.351002+0000","last_clean":"2024-03-20T13:37:17.351002+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:37:17.351002+0000","last_undegraded":"2024-03-20T13:37:17.351002+0000","last_fullsized":"2024-03-20T13:37:17.351002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:18.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361689+0000","last_change":"2024-03-20T13:36:38.840955+0000","last_active":"2024-03-20T13:38:05.361689+0000","last_peered":"2024-03-20T13:38:05.361689+0000","last_clean":"2024-03-20T13:38:05.361689+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:05.361689+0000","last_undegraded":"2024-03-20T13:38:05.361689+0000","last_fullsized":"2024-03-20T13:38:05.361689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:33.249228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350421+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:37:17.350421+0000","last_peered":"2024-03-20T13:37:17.350421+0000","last_clean":"2024-03-20T13:37:17.350421+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:37:17.350421+0000","last_undegraded":"2024-03-20T13:37:17.350421+0000","last_fullsized":"2024-03-20T13:37:17.350421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343195+0000","last_change":"2024-03-20T13:36:40.845768+0000","last_active":"2024-03-20T13:37:17.343195+0000","last_peered":"2024-03-20T13:37:17.343195+0000","last_clean":"2024-03-20T13:37:17.343195+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:37:17.343195+0000","last_undegraded":"2024-03-20T13:37:17.343195+0000","last_fullsized":"2024-03-20T13:37:17.343195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:33:29.320718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'50","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.961328+0000","last_change":"2024-03-20T13:36:42.869009+0000","last_active":"2024-03-20T13:38:10.961328+0000","last_peered":"2024-03-20T13:38:10.961328+0000","last_clean":"2024-03-20T13:38:10.961328+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:10.961328+0000","last_undegraded":"2024-03-20T13:38:10.961328+0000","last_fullsized":"2024-03-20T13:38:10.961328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:14.441521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335490+0000","last_change":"2024-03-20T13:36:44.867134+0000","last_active":"2024-03-20T13:37:17.335490+0000","last_peered":"2024-03-20T13:37:17.335490+0000","last_clean":"2024-03-20T13:37:17.335490+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:37:17.335490+0000","last_undegraded":"2024-03-20T13:37:17.335490+0000","last_fullsized":"2024-03-20T13:37:17.335490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:26.218996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:46.886740+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:16.012802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361855+0000","last_change":"2024-03-20T13:36:38.832987+0000","last_active":"2024-03-20T13:38:05.361855+0000","last_peered":"2024-03-20T13:38:05.361855+0000","last_clean":"2024-03-20T13:38:05.361855+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:38:05.361855+0000","last_undegraded":"2024-03-20T13:38:05.361855+0000","last_fullsized":"2024-03-20T13:38:05.361855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:53:17.091959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.064409+0000","last_change":"2024-03-20T13:36:36.846257+0000","last_active":"2024-03-20T13:37:22.064409+0000","last_peered":"2024-03-20T13:37:22.064409+0000","last_clean":"2024-03-20T13:37:22.064409+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:37:22.064409+0000","last_undegraded":"2024-03-20T13:37:22.064409+0000","last_fullsized":"2024-03-20T13:37:22.064409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343865+0000","last_change":"2024-03-20T13:36:40.839225+0000","last_active":"2024-03-20T13:37:17.343865+0000","last_peered":"2024-03-20T13:37:17.343865+0000","last_clean":"2024-03-20T13:37:17.343865+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:37:17.343865+0000","last_undegraded":"2024-03-20T13:37:17.343865+0000","last_fullsized":"2024-03-20T13:37:17.343865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:25.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.304039+0000","last_change":"2024-03-20T13:36:42.876207+0000","last_active":"2024-03-20T13:38:05.304039+0000","last_peered":"2024-03-20T13:38:05.304039+0000","last_clean":"2024-03-20T13:38:05.304039+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:05.304039+0000","last_undegraded":"2024-03-20T13:38:05.304039+0000","last_fullsized":"2024-03-20T13:38:05.304039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:23.373578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360601+0000","last_change":"2024-03-20T13:36:44.899145+0000","last_active":"2024-03-20T13:37:17.360601+0000","last_peered":"2024-03-20T13:37:17.360601+0000","last_clean":"2024-03-20T13:37:17.360601+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:37:17.360601+0000","last_undegraded":"2024-03-20T13:37:17.360601+0000","last_fullsized":"2024-03-20T13:37:17.360601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338015+0000","last_change":"2024-03-20T13:36:46.875764+0000","last_active":"2024-03-20T13:37:17.338015+0000","last_peered":"2024-03-20T13:37:17.338015+0000","last_clean":"2024-03-20T13:37:17.338015+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:37:17.338015+0000","last_undegraded":"2024-03-20T13:37:17.338015+0000","last_fullsized":"2024-03-20T13:37:17.338015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:43.408023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356084+0000","last_change":"2024-03-20T13:36:38.831920+0000","last_active":"2024-03-20T13:37:17.356084+0000","last_peered":"2024-03-20T13:37:17.356084+0000","last_clean":"2024-03-20T13:37:17.356084+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:37:17.356084+0000","last_undegraded":"2024-03-20T13:37:17.356084+0000","last_fullsized":"2024-03-20T13:37:17.356084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.081235+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:37:22.081235+0000","last_peered":"2024-03-20T13:37:22.081235+0000","last_clean":"2024-03-20T13:37:22.081235+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:37:22.081235+0000","last_undegraded":"2024-03-20T13:37:22.081235+0000","last_fullsized":"2024-03-20T13:37:22.081235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350463+0000","last_change":"2024-03-20T13:36:40.847551+0000","last_active":"2024-03-20T13:37:17.350463+0000","last_peered":"2024-03-20T13:37:17.350463+0000","last_clean":"2024-03-20T13:37:17.350463+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:37:17.350463+0000","last_undegraded":"2024-03-20T13:37:17.350463+0000","last_fullsized":"2024-03-20T13:37:17.350463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:03:22.247918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.345847+0000","last_change":"2024-03-20T13:36:42.845589+0000","last_active":"2024-03-20T13:38:05.345847+0000","last_peered":"2024-03-20T13:38:05.345847+0000","last_clean":"2024-03-20T13:38:05.345847+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:05.345847+0000","last_undegraded":"2024-03-20T13:38:05.345847+0000","last_fullsized":"2024-03-20T13:38:05.345847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:56.555692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'240","reported_seq":321,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.270399+0000","last_change":"2024-03-20T13:36:44.879458+0000","last_active":"2024-03-20T13:38:11.270399+0000","last_peered":"2024-03-20T13:38:11.270399+0000","last_clean":"2024-03-20T13:38:11.270399+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:11.270399+0000","last_undegraded":"2024-03-20T13:38:11.270399+0000","last_fullsized":"2024-03-20T13:38:11.270399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:14.860829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.376315+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:05.376315+0000","last_peered":"2024-03-20T13:38:05.376315+0000","last_clean":"2024-03-20T13:38:05.376315+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:05.376315+0000","last_undegraded":"2024-03-20T13:38:05.376315+0000","last_fullsized":"2024-03-20T13:38:05.376315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:30.005016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345914+0000","last_change":"2024-03-20T13:36:38.825748+0000","last_active":"2024-03-20T13:37:17.345914+0000","last_peered":"2024-03-20T13:37:17.345914+0000","last_clean":"2024-03-20T13:37:17.345914+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:37:17.345914+0000","last_undegraded":"2024-03-20T13:37:17.345914+0000","last_fullsized":"2024-03-20T13:37:17.345914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:17.486304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.565297+0000","last_change":"2024-03-20T13:36:36.846954+0000","last_active":"2024-03-20T13:38:04.565297+0000","last_peered":"2024-03-20T13:38:04.565297+0000","last_clean":"2024-03-20T13:38:04.565297+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:38:04.565297+0000","last_undegraded":"2024-03-20T13:38:04.565297+0000","last_fullsized":"2024-03-20T13:38:04.565297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":359,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.187801+0000","last_change":"2024-03-20T13:36:40.855511+0000","last_active":"2024-03-20T13:38:12.187801+0000","last_peered":"2024-03-20T13:38:12.187801+0000","last_clean":"2024-03-20T13:38:12.187801+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:12.187801+0000","last_undegraded":"2024-03-20T13:38:12.187801+0000","last_fullsized":"2024-03-20T13:38:12.187801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:36:09.090540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348292+0000","last_change":"2024-03-20T13:36:42.844667+0000","last_active":"2024-03-20T13:37:17.348292+0000","last_peered":"2024-03-20T13:37:17.348292+0000","last_clean":"2024-03-20T13:37:17.348292+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:37:17.348292+0000","last_undegraded":"2024-03-20T13:37:17.348292+0000","last_fullsized":"2024-03-20T13:37:17.348292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:57.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'240","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.273196+0000","last_change":"2024-03-20T13:36:44.878660+0000","last_active":"2024-03-20T13:38:11.273196+0000","last_peered":"2024-03-20T13:38:11.273196+0000","last_clean":"2024-03-20T13:38:11.273196+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:38:11.273196+0000","last_undegraded":"2024-03-20T13:38:11.273196+0000","last_fullsized":"2024-03-20T13:38:11.273196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:17.394132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335236+0000","last_change":"2024-03-20T13:36:46.894365+0000","last_active":"2024-03-20T13:37:17.335236+0000","last_peered":"2024-03-20T13:37:17.335236+0000","last_clean":"2024-03-20T13:37:17.335236+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:37:17.335236+0000","last_undegraded":"2024-03-20T13:37:17.335236+0000","last_fullsized":"2024-03-20T13:37:17.335236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:16:31.162761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362064+0000","last_change":"2024-03-20T13:36:38.827417+0000","last_active":"2024-03-20T13:38:05.362064+0000","last_peered":"2024-03-20T13:38:05.362064+0000","last_clean":"2024-03-20T13:38:05.362064+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:05.362064+0000","last_undegraded":"2024-03-20T13:38:05.362064+0000","last_fullsized":"2024-03-20T13:38:05.362064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:01.821428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340325+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:37:17.340325+0000","last_peered":"2024-03-20T13:37:17.340325+0000","last_clean":"2024-03-20T13:37:17.340325+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:37:17.340325+0000","last_undegraded":"2024-03-20T13:37:17.340325+0000","last_fullsized":"2024-03-20T13:37:17.340325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:34.568110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362408+0000","last_change":"2024-03-20T13:36:40.850087+0000","last_active":"2024-03-20T13:37:17.362408+0000","last_peered":"2024-03-20T13:37:17.362408+0000","last_clean":"2024-03-20T13:37:17.362408+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:37:17.362408+0000","last_undegraded":"2024-03-20T13:37:17.362408+0000","last_fullsized":"2024-03-20T13:37:17.362408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.325183+0000","last_change":"2024-03-20T13:36:42.876289+0000","last_active":"2024-03-20T13:38:05.325183+0000","last_peered":"2024-03-20T13:38:05.325183+0000","last_clean":"2024-03-20T13:38:05.325183+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:05.325183+0000","last_undegraded":"2024-03-20T13:38:05.325183+0000","last_fullsized":"2024-03-20T13:38:05.325183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:11.362564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356204+0000","last_change":"2024-03-20T13:36:44.871091+0000","last_active":"2024-03-20T13:37:17.356204+0000","last_peered":"2024-03-20T13:37:17.356204+0000","last_clean":"2024-03-20T13:37:17.356204+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:37:17.356204+0000","last_undegraded":"2024-03-20T13:37:17.356204+0000","last_fullsized":"2024-03-20T13:37:17.356204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:17.175441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347541+0000","last_change":"2024-03-20T13:36:46.872197+0000","last_active":"2024-03-20T13:37:17.347541+0000","last_peered":"2024-03-20T13:37:17.347541+0000","last_clean":"2024-03-20T13:37:17.347541+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:37:17.347541+0000","last_undegraded":"2024-03-20T13:37:17.347541+0000","last_fullsized":"2024-03-20T13:37:17.347541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:03:54.127026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354510+0000","last_change":"2024-03-20T13:36:38.845564+0000","last_active":"2024-03-20T13:37:17.354510+0000","last_peered":"2024-03-20T13:37:17.354510+0000","last_clean":"2024-03-20T13:37:17.354510+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:37:17.354510+0000","last_undegraded":"2024-03-20T13:37:17.354510+0000","last_fullsized":"2024-03-20T13:37:17.354510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":201,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341737+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:37:17.341737+0000","last_peered":"2024-03-20T13:37:17.341737+0000","last_clean":"2024-03-20T13:37:17.341737+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:37:17.341737+0000","last_undegraded":"2024-03-20T13:37:17.341737+0000","last_fullsized":"2024-03-20T13:37:17.341737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:11.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350038+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:37:17.350038+0000","last_peered":"2024-03-20T13:37:17.350038+0000","last_clean":"2024-03-20T13:37:17.350038+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:37:17.350038+0000","last_undegraded":"2024-03-20T13:37:17.350038+0000","last_fullsized":"2024-03-20T13:37:17.350038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:20.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356573+0000","last_change":"2024-03-20T13:36:36.849187+0000","last_active":"2024-03-20T13:37:17.356573+0000","last_peered":"2024-03-20T13:37:17.356573+0000","last_clean":"2024-03-20T13:37:17.356573+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:37:17.356573+0000","last_undegraded":"2024-03-20T13:37:17.356573+0000","last_fullsized":"2024-03-20T13:37:17.356573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350872+0000","last_change":"2024-03-20T13:36:40.848822+0000","last_active":"2024-03-20T13:37:17.350872+0000","last_peered":"2024-03-20T13:37:17.350872+0000","last_clean":"2024-03-20T13:37:17.350872+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:37:17.350872+0000","last_undegraded":"2024-03-20T13:37:17.350872+0000","last_fullsized":"2024-03-20T13:37:17.350872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:47.518308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'70","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.995929+0000","last_change":"2024-03-20T13:36:42.846779+0000","last_active":"2024-03-20T13:38:10.995929+0000","last_peered":"2024-03-20T13:38:10.995929+0000","last_clean":"2024-03-20T13:38:10.995929+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:10.995929+0000","last_undegraded":"2024-03-20T13:38:10.995929+0000","last_fullsized":"2024-03-20T13:38:10.995929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:25.956347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360479+0000","last_change":"2024-03-20T13:36:44.899269+0000","last_active":"2024-03-20T13:37:17.360479+0000","last_peered":"2024-03-20T13:37:17.360479+0000","last_clean":"2024-03-20T13:37:17.360479+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:37:17.360479+0000","last_undegraded":"2024-03-20T13:37:17.360479+0000","last_fullsized":"2024-03-20T13:37:17.360479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'51","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.055469+0000","last_change":"2024-03-20T13:36:46.893348+0000","last_active":"2024-03-20T13:38:11.055469+0000","last_peered":"2024-03-20T13:38:11.055469+0000","last_clean":"2024-03-20T13:38:11.055469+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:38:11.055469+0000","last_undegraded":"2024-03-20T13:38:11.055469+0000","last_fullsized":"2024-03-20T13:38:11.055469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:20.181051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.803949+0000","last_change":"2024-03-20T13:36:38.835115+0000","last_active":"2024-03-20T13:37:22.803949+0000","last_peered":"2024-03-20T13:37:22.803949+0000","last_clean":"2024-03-20T13:37:22.803949+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:37:22.803949+0000","last_undegraded":"2024-03-20T13:37:22.803949+0000","last_fullsized":"2024-03-20T13:37:22.803949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348446+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:37:17.348446+0000","last_peered":"2024-03-20T13:37:17.348446+0000","last_clean":"2024-03-20T13:37:17.348446+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:37:17.348446+0000","last_undegraded":"2024-03-20T13:37:17.348446+0000","last_fullsized":"2024-03-20T13:37:17.348446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:03.493778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344968+0000","last_change":"2024-03-20T13:36:36.833258+0000","last_active":"2024-03-20T13:37:17.344968+0000","last_peered":"2024-03-20T13:37:17.344968+0000","last_clean":"2024-03-20T13:37:17.344968+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:37:17.344968+0000","last_undegraded":"2024-03-20T13:37:17.344968+0000","last_fullsized":"2024-03-20T13:37:17.344968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:55.537677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356009+0000","last_change":"2024-03-20T13:36:40.850671+0000","last_active":"2024-03-20T13:37:17.356009+0000","last_peered":"2024-03-20T13:37:17.356009+0000","last_clean":"2024-03-20T13:37:17.356009+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:37:17.356009+0000","last_undegraded":"2024-03-20T13:37:17.356009+0000","last_fullsized":"2024-03-20T13:37:17.356009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:49:00.124639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'239","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.263813+0000","last_change":"2024-03-20T13:36:42.863211+0000","last_active":"2024-03-20T13:38:11.263813+0000","last_peered":"2024-03-20T13:38:11.263813+0000","last_clean":"2024-03-20T13:38:11.263813+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:11.263813+0000","last_undegraded":"2024-03-20T13:38:11.263813+0000","last_fullsized":"2024-03-20T13:38:11.263813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:58.451631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351365+0000","last_change":"2024-03-20T13:36:44.897832+0000","last_active":"2024-03-20T13:37:17.351365+0000","last_peered":"2024-03-20T13:37:17.351365+0000","last_clean":"2024-03-20T13:37:17.351365+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:37:17.351365+0000","last_undegraded":"2024-03-20T13:37:17.351365+0000","last_fullsized":"2024-03-20T13:37:17.351365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:52:08.639163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.523020+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:37:59.523020+0000","last_peered":"2024-03-20T13:37:59.523020+0000","last_clean":"2024-03-20T13:37:59.523020+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:37:59.523020+0000","last_undegraded":"2024-03-20T13:37:59.523020+0000","last_fullsized":"2024-03-20T13:37:59.523020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:46.638563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362220+0000","last_change":"2024-03-20T13:36:38.832205+0000","last_active":"2024-03-20T13:38:05.362220+0000","last_peered":"2024-03-20T13:38:05.362220+0000","last_clean":"2024-03-20T13:38:05.362220+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:38:05.362220+0000","last_undegraded":"2024-03-20T13:38:05.362220+0000","last_fullsized":"2024-03-20T13:38:05.362220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:00.408558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334481+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:37:17.334481+0000","last_peered":"2024-03-20T13:37:17.334481+0000","last_clean":"2024-03-20T13:37:17.334481+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.334481+0000","last_undegraded":"2024-03-20T13:37:17.334481+0000","last_fullsized":"2024-03-20T13:37:17.334481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342328+0000","last_change":"2024-03-20T13:36:36.836293+0000","last_active":"2024-03-20T13:37:17.342328+0000","last_peered":"2024-03-20T13:37:17.342328+0000","last_clean":"2024-03-20T13:37:17.342328+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:37:17.342328+0000","last_undegraded":"2024-03-20T13:37:17.342328+0000","last_fullsized":"2024-03-20T13:37:17.342328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:33.995435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349061+0000","last_change":"2024-03-20T13:36:40.842771+0000","last_active":"2024-03-20T13:37:17.349061+0000","last_peered":"2024-03-20T13:37:17.349061+0000","last_clean":"2024-03-20T13:37:17.349061+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:37:17.349061+0000","last_undegraded":"2024-03-20T13:37:17.349061+0000","last_fullsized":"2024-03-20T13:37:17.349061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:42:22.678474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.996348+0000","last_change":"2024-03-20T13:36:42.842816+0000","last_active":"2024-03-20T13:38:10.996348+0000","last_peered":"2024-03-20T13:38:10.996348+0000","last_clean":"2024-03-20T13:38:10.996348+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:10.996348+0000","last_undegraded":"2024-03-20T13:38:10.996348+0000","last_fullsized":"2024-03-20T13:38:10.996348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:03.696208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352701+0000","last_change":"2024-03-20T13:36:44.872161+0000","last_active":"2024-03-20T13:37:17.352701+0000","last_peered":"2024-03-20T13:37:17.352701+0000","last_clean":"2024-03-20T13:37:17.352701+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:37:17.352701+0000","last_undegraded":"2024-03-20T13:37:17.352701+0000","last_fullsized":"2024-03-20T13:37:17.352701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:39.436728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347395+0000","last_change":"2024-03-20T13:36:46.874361+0000","last_active":"2024-03-20T13:37:17.347395+0000","last_peered":"2024-03-20T13:37:17.347395+0000","last_clean":"2024-03-20T13:37:17.347395+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:37:17.347395+0000","last_undegraded":"2024-03-20T13:37:17.347395+0000","last_fullsized":"2024-03-20T13:37:17.347395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048631+0000","last_change":"2024-03-20T13:36:38.839568+0000","last_active":"2024-03-20T13:38:11.048631+0000","last_peered":"2024-03-20T13:38:11.048631+0000","last_clean":"2024-03-20T13:38:11.048631+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:11.048631+0000","last_undegraded":"2024-03-20T13:38:11.048631+0000","last_fullsized":"2024-03-20T13:38:11.048631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:16.107824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348452+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:37:17.348452+0000","last_peered":"2024-03-20T13:37:17.348452+0000","last_clean":"2024-03-20T13:37:17.348452+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:37:17.348452+0000","last_undegraded":"2024-03-20T13:37:17.348452+0000","last_fullsized":"2024-03-20T13:37:17.348452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:49:35.289474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350154+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:37:17.350154+0000","last_peered":"2024-03-20T13:37:17.350154+0000","last_clean":"2024-03-20T13:37:17.350154+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:37:17.350154+0000","last_undegraded":"2024-03-20T13:37:17.350154+0000","last_fullsized":"2024-03-20T13:37:17.350154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353282+0000","last_change":"2024-03-20T13:36:40.846094+0000","last_active":"2024-03-20T13:37:17.353282+0000","last_peered":"2024-03-20T13:37:17.353282+0000","last_clean":"2024-03-20T13:37:17.353282+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:37:17.353282+0000","last_undegraded":"2024-03-20T13:37:17.353282+0000","last_fullsized":"2024-03-20T13:37:17.353282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:25:10.138463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.375043+0000","last_change":"2024-03-20T13:36:42.847334+0000","last_active":"2024-03-20T13:38:05.375043+0000","last_peered":"2024-03-20T13:38:05.375043+0000","last_clean":"2024-03-20T13:38:05.375043+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:05.375043+0000","last_undegraded":"2024-03-20T13:38:05.375043+0000","last_fullsized":"2024-03-20T13:38:05.375043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361433+0000","last_change":"2024-03-20T13:36:44.900807+0000","last_active":"2024-03-20T13:37:17.361433+0000","last_peered":"2024-03-20T13:37:17.361433+0000","last_clean":"2024-03-20T13:37:17.361433+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:37:17.361433+0000","last_undegraded":"2024-03-20T13:37:17.361433+0000","last_fullsized":"2024-03-20T13:37:17.361433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341228+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:37:17.341228+0000","last_peered":"2024-03-20T13:37:17.341228+0000","last_clean":"2024-03-20T13:37:17.341228+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:37:17.341228+0000","last_undegraded":"2024-03-20T13:37:17.341228+0000","last_fullsized":"2024-03-20T13:37:17.341228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:47.541449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559479+0000","last_change":"2024-03-20T13:36:38.835114+0000","last_active":"2024-03-20T13:38:04.559479+0000","last_peered":"2024-03-20T13:38:04.559479+0000","last_clean":"2024-03-20T13:38:04.559479+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:38:04.559479+0000","last_undegraded":"2024-03-20T13:38:04.559479+0000","last_fullsized":"2024-03-20T13:38:04.559479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:02.712312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356076+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:37:17.356076+0000","last_peered":"2024-03-20T13:37:17.356076+0000","last_clean":"2024-03-20T13:37:17.356076+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:37:17.356076+0000","last_undegraded":"2024-03-20T13:37:17.356076+0000","last_fullsized":"2024-03-20T13:37:17.356076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:36:17.674002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353028+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:37:17.353028+0000","last_peered":"2024-03-20T13:37:17.353028+0000","last_clean":"2024-03-20T13:37:17.353028+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.353028+0000","last_undegraded":"2024-03-20T13:37:17.353028+0000","last_fullsized":"2024-03-20T13:37:17.353028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:01:29.010451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337078+0000","last_change":"2024-03-20T13:36:40.847185+0000","last_active":"2024-03-20T13:37:17.337078+0000","last_peered":"2024-03-20T13:37:17.337078+0000","last_clean":"2024-03-20T13:37:17.337078+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:37:17.337078+0000","last_undegraded":"2024-03-20T13:37:17.337078+0000","last_fullsized":"2024-03-20T13:37:17.337078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:07:18.240810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'56","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.978774+0000","last_change":"2024-03-20T13:36:42.851741+0000","last_active":"2024-03-20T13:38:10.978774+0000","last_peered":"2024-03-20T13:38:10.978774+0000","last_clean":"2024-03-20T13:38:10.978774+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:10.978774+0000","last_undegraded":"2024-03-20T13:38:10.978774+0000","last_fullsized":"2024-03-20T13:38:10.978774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:54:44.968029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347209+0000","last_change":"2024-03-20T13:36:44.869776+0000","last_active":"2024-03-20T13:37:17.347209+0000","last_peered":"2024-03-20T13:37:17.347209+0000","last_clean":"2024-03-20T13:37:17.347209+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:37:17.347209+0000","last_undegraded":"2024-03-20T13:37:17.347209+0000","last_fullsized":"2024-03-20T13:37:17.347209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.347425+0000","last_change":"2024-03-20T13:36:46.889089+0000","last_active":"2024-03-20T13:38:05.347425+0000","last_peered":"2024-03-20T13:38:05.347425+0000","last_clean":"2024-03-20T13:38:05.347425+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:05.347425+0000","last_undegraded":"2024-03-20T13:38:05.347425+0000","last_fullsized":"2024-03-20T13:38:05.347425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:44.885863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.805147+0000","last_change":"2024-03-20T13:36:38.827949+0000","last_active":"2024-03-20T13:37:22.805147+0000","last_peered":"2024-03-20T13:37:22.805147+0000","last_clean":"2024-03-20T13:37:22.805147+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:37:22.805147+0000","last_undegraded":"2024-03-20T13:37:22.805147+0000","last_fullsized":"2024-03-20T13:37:22.805147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:06.009730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353286+0000","last_change":"2024-03-20T13:36:36.830990+0000","last_active":"2024-03-20T13:37:17.353286+0000","last_peered":"2024-03-20T13:37:17.353286+0000","last_clean":"2024-03-20T13:37:17.353286+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:37:17.353286+0000","last_undegraded":"2024-03-20T13:37:17.353286+0000","last_fullsized":"2024-03-20T13:37:17.353286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:34.861573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354027+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:37:17.354027+0000","last_peered":"2024-03-20T13:37:17.354027+0000","last_clean":"2024-03-20T13:37:17.354027+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:37:17.354027+0000","last_undegraded":"2024-03-20T13:37:17.354027+0000","last_fullsized":"2024-03-20T13:37:17.354027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:05.095676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348014+0000","last_change":"2024-03-20T13:36:40.850909+0000","last_active":"2024-03-20T13:37:17.348014+0000","last_peered":"2024-03-20T13:37:17.348014+0000","last_clean":"2024-03-20T13:37:17.348014+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:37:17.348014+0000","last_undegraded":"2024-03-20T13:37:17.348014+0000","last_fullsized":"2024-03-20T13:37:17.348014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341928+0000","last_change":"2024-03-20T13:36:42.864332+0000","last_active":"2024-03-20T13:37:17.341928+0000","last_peered":"2024-03-20T13:37:17.341928+0000","last_clean":"2024-03-20T13:37:17.341928+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:37:17.341928+0000","last_undegraded":"2024-03-20T13:37:17.341928+0000","last_fullsized":"2024-03-20T13:37:17.341928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:16.666345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'240","reported_seq":318,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.267232+0000","last_change":"2024-03-20T13:36:44.872646+0000","last_active":"2024-03-20T13:38:11.267232+0000","last_peered":"2024-03-20T13:38:11.267232+0000","last_clean":"2024-03-20T13:38:11.267232+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:11.267232+0000","last_undegraded":"2024-03-20T13:38:11.267232+0000","last_fullsized":"2024-03-20T13:38:11.267232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:04.548860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358653+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:37:17.358653+0000","last_peered":"2024-03-20T13:37:17.358653+0000","last_clean":"2024-03-20T13:37:17.358653+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:37:17.358653+0000","last_undegraded":"2024-03-20T13:37:17.358653+0000","last_fullsized":"2024-03-20T13:37:17.358653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.098925+0000","last_change":"2024-03-20T13:36:38.813661+0000","last_active":"2024-03-20T13:37:22.098925+0000","last_peered":"2024-03-20T13:37:22.098925+0000","last_clean":"2024-03-20T13:37:22.098925+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:37:22.098925+0000","last_undegraded":"2024-03-20T13:37:22.098925+0000","last_fullsized":"2024-03-20T13:37:22.098925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362921+0000","last_change":"2024-03-20T13:36:36.847617+0000","last_active":"2024-03-20T13:37:17.362921+0000","last_peered":"2024-03-20T13:37:17.362921+0000","last_clean":"2024-03-20T13:37:17.362921+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:37:17.362921+0000","last_undegraded":"2024-03-20T13:37:17.362921+0000","last_fullsized":"2024-03-20T13:37:17.362921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360074+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:37:17.360074+0000","last_peered":"2024-03-20T13:37:17.360074+0000","last_clean":"2024-03-20T13:37:17.360074+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:37:17.360074+0000","last_undegraded":"2024-03-20T13:37:17.360074+0000","last_fullsized":"2024-03-20T13:37:17.360074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:06.931743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349095+0000","last_change":"2024-03-20T13:36:40.857874+0000","last_active":"2024-03-20T13:37:17.349095+0000","last_peered":"2024-03-20T13:37:17.349095+0000","last_clean":"2024-03-20T13:37:17.349095+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:37:17.349095+0000","last_undegraded":"2024-03-20T13:37:17.349095+0000","last_fullsized":"2024-03-20T13:37:17.349095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:18:26.064828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358074+0000","last_change":"2024-03-20T13:36:42.855371+0000","last_active":"2024-03-20T13:37:17.358074+0000","last_peered":"2024-03-20T13:37:17.358074+0000","last_clean":"2024-03-20T13:37:17.358074+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:37:17.358074+0000","last_undegraded":"2024-03-20T13:37:17.358074+0000","last_fullsized":"2024-03-20T13:37:17.358074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:58:21.419980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'240","reported_seq":316,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.273749+0000","last_change":"2024-03-20T13:36:44.894325+0000","last_active":"2024-03-20T13:38:11.273749+0000","last_peered":"2024-03-20T13:38:11.273749+0000","last_clean":"2024-03-20T13:38:11.273749+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:11.273749+0000","last_undegraded":"2024-03-20T13:38:11.273749+0000","last_fullsized":"2024-03-20T13:38:11.273749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:59.125889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.777950+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:37:21.777950+0000","last_peered":"2024-03-20T13:37:21.777950+0000","last_clean":"2024-03-20T13:37:21.777950+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:37:21.777950+0000","last_undegraded":"2024-03-20T13:37:21.777950+0000","last_fullsized":"2024-03-20T13:37:21.777950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:41.446025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099051+0000","last_change":"2024-03-20T13:36:38.825848+0000","last_active":"2024-03-20T13:37:22.099051+0000","last_peered":"2024-03-20T13:37:22.099051+0000","last_clean":"2024-03-20T13:37:22.099051+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:37:22.099051+0000","last_undegraded":"2024-03-20T13:37:22.099051+0000","last_fullsized":"2024-03-20T13:37:22.099051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:41.028184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358700+0000","last_change":"2024-03-20T13:36:36.831337+0000","last_active":"2024-03-20T13:37:17.358700+0000","last_peered":"2024-03-20T13:37:17.358700+0000","last_clean":"2024-03-20T13:37:17.358700+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:37:17.358700+0000","last_undegraded":"2024-03-20T13:37:17.358700+0000","last_fullsized":"2024-03-20T13:37:17.358700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:05.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353981+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:37:17.353981+0000","last_peered":"2024-03-20T13:37:17.353981+0000","last_clean":"2024-03-20T13:37:17.353981+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:37:17.353981+0000","last_undegraded":"2024-03-20T13:37:17.353981+0000","last_fullsized":"2024-03-20T13:37:17.353981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:22.659362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.366089+0000","last_change":"2024-03-20T13:37:17.366089+0000","last_active":"2024-03-20T13:37:17.366089+0000","last_peered":"2024-03-20T13:37:17.366089+0000","last_clean":"2024-03-20T13:37:17.366089+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:37:17.366089+0000","last_undegraded":"2024-03-20T13:37:17.366089+0000","last_fullsized":"2024-03-20T13:37:17.366089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:48.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'77","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.974362+0000","last_change":"2024-03-20T13:36:42.842883+0000","last_active":"2024-03-20T13:38:10.974362+0000","last_peered":"2024-03-20T13:38:10.974362+0000","last_clean":"2024-03-20T13:38:10.974362+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:10.974362+0000","last_undegraded":"2024-03-20T13:38:10.974362+0000","last_fullsized":"2024-03-20T13:38:10.974362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:47.727785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357474+0000","last_change":"2024-03-20T13:36:44.894727+0000","last_active":"2024-03-20T13:37:17.357474+0000","last_peered":"2024-03-20T13:37:17.357474+0000","last_clean":"2024-03-20T13:37:17.357474+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:37:17.357474+0000","last_undegraded":"2024-03-20T13:37:17.357474+0000","last_fullsized":"2024-03-20T13:37:17.357474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:11.857697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339944+0000","last_change":"2024-03-20T13:36:46.888822+0000","last_active":"2024-03-20T13:37:17.339944+0000","last_peered":"2024-03-20T13:37:17.339944+0000","last_clean":"2024-03-20T13:37:17.339944+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:37:17.339944+0000","last_undegraded":"2024-03-20T13:37:17.339944+0000","last_fullsized":"2024-03-20T13:37:17.339944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:28:05.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345713+0000","last_change":"2024-03-20T13:36:46.889735+0000","last_active":"2024-03-20T13:37:17.345713+0000","last_peered":"2024-03-20T13:37:17.345713+0000","last_clean":"2024-03-20T13:37:17.345713+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:37:17.345713+0000","last_undegraded":"2024-03-20T13:37:17.345713+0000","last_fullsized":"2024-03-20T13:37:17.345713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:26.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038995+0000","last_change":"2024-03-20T13:36:38.826974+0000","last_active":"2024-03-20T13:38:11.038995+0000","last_peered":"2024-03-20T13:38:11.038995+0000","last_clean":"2024-03-20T13:38:11.038995+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:11.038995+0000","last_undegraded":"2024-03-20T13:38:11.038995+0000","last_fullsized":"2024-03-20T13:38:11.038995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:47.853154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346955+0000","last_change":"2024-03-20T13:36:40.845473+0000","last_active":"2024-03-20T13:37:17.346955+0000","last_peered":"2024-03-20T13:37:17.346955+0000","last_clean":"2024-03-20T13:37:17.346955+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:37:17.346955+0000","last_undegraded":"2024-03-20T13:37:17.346955+0000","last_fullsized":"2024-03-20T13:37:17.346955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:45:53.190145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.331149+0000","last_change":"2024-03-20T13:36:42.865392+0000","last_active":"2024-03-20T13:38:05.331149+0000","last_peered":"2024-03-20T13:38:05.331149+0000","last_clean":"2024-03-20T13:38:05.331149+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:05.331149+0000","last_undegraded":"2024-03-20T13:38:05.331149+0000","last_fullsized":"2024-03-20T13:38:05.331149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:23.969005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338712+0000","last_change":"2024-03-20T13:36:44.884122+0000","last_active":"2024-03-20T13:37:17.338712+0000","last_peered":"2024-03-20T13:37:17.338712+0000","last_clean":"2024-03-20T13:37:17.338712+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:37:17.338712+0000","last_undegraded":"2024-03-20T13:37:17.338712+0000","last_fullsized":"2024-03-20T13:37:17.338712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:16:30.331163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361092+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:37:17.361092+0000","last_peered":"2024-03-20T13:37:17.361092+0000","last_clean":"2024-03-20T13:37:17.361092+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:37:17.361092+0000","last_undegraded":"2024-03-20T13:37:17.361092+0000","last_fullsized":"2024-03-20T13:37:17.361092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099295+0000","last_change":"2024-03-20T13:36:38.835372+0000","last_active":"2024-03-20T13:37:22.099295+0000","last_peered":"2024-03-20T13:37:22.099295+0000","last_clean":"2024-03-20T13:37:22.099295+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:37:22.099295+0000","last_undegraded":"2024-03-20T13:37:22.099295+0000","last_fullsized":"2024-03-20T13:37:22.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:34.776234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340380+0000","last_change":"2024-03-20T13:36:36.812213+0000","last_active":"2024-03-20T13:37:17.340380+0000","last_peered":"2024-03-20T13:37:17.340380+0000","last_clean":"2024-03-20T13:37:17.340380+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:37:17.340380+0000","last_undegraded":"2024-03-20T13:37:17.340380+0000","last_fullsized":"2024-03-20T13:37:17.340380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:43.391446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348705+0000","last_change":"2024-03-20T13:36:40.849295+0000","last_active":"2024-03-20T13:37:17.348705+0000","last_peered":"2024-03-20T13:37:17.348705+0000","last_clean":"2024-03-20T13:37:17.348705+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:37:17.348705+0000","last_undegraded":"2024-03-20T13:37:17.348705+0000","last_fullsized":"2024-03-20T13:37:17.348705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:20.801941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:57.995056+0000","last_change":"2024-03-20T13:36:42.861263+0000","last_active":"2024-03-20T13:37:57.995056+0000","last_peered":"2024-03-20T13:37:57.995056+0000","last_clean":"2024-03-20T13:37:57.995056+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:37:57.995056+0000","last_undegraded":"2024-03-20T13:37:57.995056+0000","last_fullsized":"2024-03-20T13:37:57.995056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:19.148076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335656+0000","last_change":"2024-03-20T13:36:44.868223+0000","last_active":"2024-03-20T13:37:17.335656+0000","last_peered":"2024-03-20T13:37:17.335656+0000","last_clean":"2024-03-20T13:37:17.335656+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:37:17.335656+0000","last_undegraded":"2024-03-20T13:37:17.335656+0000","last_fullsized":"2024-03-20T13:37:17.335656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:27.229079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.348498+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:05.348498+0000","last_peered":"2024-03-20T13:38:05.348498+0000","last_clean":"2024-03-20T13:38:05.348498+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:05.348498+0000","last_undegraded":"2024-03-20T13:38:05.348498+0000","last_fullsized":"2024-03-20T13:38:05.348498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:11:03.011925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347543+0000","last_change":"2024-03-20T13:36:38.830562+0000","last_active":"2024-03-20T13:37:17.347543+0000","last_peered":"2024-03-20T13:37:17.347543+0000","last_clean":"2024-03-20T13:37:17.347543+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:37:17.347543+0000","last_undegraded":"2024-03-20T13:37:17.347543+0000","last_fullsized":"2024-03-20T13:37:17.347543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354095+0000","last_change":"2024-03-20T13:36:36.836705+0000","last_active":"2024-03-20T13:37:17.354095+0000","last_peered":"2024-03-20T13:37:17.354095+0000","last_clean":"2024-03-20T13:37:17.354095+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:37:17.354095+0000","last_undegraded":"2024-03-20T13:37:17.354095+0000","last_fullsized":"2024-03-20T13:37:17.354095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346933+0000","last_change":"2024-03-20T13:36:40.855508+0000","last_active":"2024-03-20T13:37:17.346933+0000","last_peered":"2024-03-20T13:37:17.346933+0000","last_clean":"2024-03-20T13:37:17.346933+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:37:17.346933+0000","last_undegraded":"2024-03-20T13:37:17.346933+0000","last_fullsized":"2024-03-20T13:37:17.346933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'34","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.731549+0000","last_change":"2024-03-20T13:36:42.868367+0000","last_active":"2024-03-20T13:38:10.731549+0000","last_peered":"2024-03-20T13:38:10.731549+0000","last_clean":"2024-03-20T13:38:10.731549+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:10.731549+0000","last_undegraded":"2024-03-20T13:38:10.731549+0000","last_fullsized":"2024-03-20T13:38:10.731549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:24.991506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345357+0000","last_change":"2024-03-20T13:36:44.888584+0000","last_active":"2024-03-20T13:37:17.345357+0000","last_peered":"2024-03-20T13:37:17.345357+0000","last_clean":"2024-03-20T13:37:17.345357+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:37:17.345357+0000","last_undegraded":"2024-03-20T13:37:17.345357+0000","last_fullsized":"2024-03-20T13:37:17.345357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:50.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349560+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:37:17.349560+0000","last_peered":"2024-03-20T13:37:17.349560+0000","last_clean":"2024-03-20T13:37:17.349560+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:37:17.349560+0000","last_undegraded":"2024-03-20T13:37:17.349560+0000","last_fullsized":"2024-03-20T13:37:17.349560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370915+0000","last_change":"2024-03-20T13:36:38.834173+0000","last_active":"2024-03-20T13:38:05.370915+0000","last_peered":"2024-03-20T13:38:05.370915+0000","last_clean":"2024-03-20T13:38:05.370915+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:05.370915+0000","last_undegraded":"2024-03-20T13:38:05.370915+0000","last_fullsized":"2024-03-20T13:38:05.370915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:44.080119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353785+0000","last_change":"2024-03-20T13:36:36.829532+0000","last_active":"2024-03-20T13:37:17.353785+0000","last_peered":"2024-03-20T13:37:17.353785+0000","last_clean":"2024-03-20T13:37:17.353785+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:37:17.353785+0000","last_undegraded":"2024-03-20T13:37:17.353785+0000","last_fullsized":"2024-03-20T13:37:17.353785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:30:12.679787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339023+0000","last_change":"2024-03-20T13:36:40.852289+0000","last_active":"2024-03-20T13:37:17.339023+0000","last_peered":"2024-03-20T13:37:17.339023+0000","last_clean":"2024-03-20T13:37:17.339023+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:37:17.339023+0000","last_undegraded":"2024-03-20T13:37:17.339023+0000","last_fullsized":"2024-03-20T13:37:17.339023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:08.730342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.306851+0000","last_change":"2024-03-20T13:36:42.860451+0000","last_active":"2024-03-20T13:38:05.306851+0000","last_peered":"2024-03-20T13:38:05.306851+0000","last_clean":"2024-03-20T13:38:05.306851+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:05.306851+0000","last_undegraded":"2024-03-20T13:38:05.306851+0000","last_fullsized":"2024-03-20T13:38:05.306851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336298+0000","last_change":"2024-03-20T13:36:44.862966+0000","last_active":"2024-03-20T13:37:17.336298+0000","last_peered":"2024-03-20T13:37:17.336298+0000","last_clean":"2024-03-20T13:37:17.336298+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:37:17.336298+0000","last_undegraded":"2024-03-20T13:37:17.336298+0000","last_fullsized":"2024-03-20T13:37:17.336298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:59.751229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103956+0000","last_change":"2024-03-20T13:36:38.832438+0000","last_active":"2024-03-20T13:37:22.103956+0000","last_peered":"2024-03-20T13:37:22.103956+0000","last_clean":"2024-03-20T13:37:22.103956+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:37:22.103956+0000","last_undegraded":"2024-03-20T13:37:22.103956+0000","last_fullsized":"2024-03-20T13:37:22.103956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:40.231347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339417+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:37:17.339417+0000","last_peered":"2024-03-20T13:37:17.339417+0000","last_clean":"2024-03-20T13:37:17.339417+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:37:17.339417+0000","last_undegraded":"2024-03-20T13:37:17.339417+0000","last_fullsized":"2024-03-20T13:37:17.339417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:42.936647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353909+0000","last_change":"2024-03-20T13:36:40.854924+0000","last_active":"2024-03-20T13:37:17.353909+0000","last_peered":"2024-03-20T13:37:17.353909+0000","last_clean":"2024-03-20T13:37:17.353909+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:37:17.353909+0000","last_undegraded":"2024-03-20T13:37:17.353909+0000","last_fullsized":"2024-03-20T13:37:17.353909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:58:14.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.965535+0000","last_change":"2024-03-20T13:37:17.384644+0000","last_active":"2024-03-20T13:38:10.965535+0000","last_peered":"2024-03-20T13:38:10.965535+0000","last_clean":"2024-03-20T13:38:10.965535+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:10.965535+0000","last_undegraded":"2024-03-20T13:38:10.965535+0000","last_fullsized":"2024-03-20T13:38:10.965535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:24.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337105+0000","last_change":"2024-03-20T13:36:44.873958+0000","last_active":"2024-03-20T13:37:17.337105+0000","last_peered":"2024-03-20T13:37:17.337105+0000","last_clean":"2024-03-20T13:37:17.337105+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:37:17.337105+0000","last_undegraded":"2024-03-20T13:37:17.337105+0000","last_fullsized":"2024-03-20T13:37:17.337105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:20.295832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.704046+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:04.704046+0000","last_peered":"2024-03-20T13:38:04.704046+0000","last_clean":"2024-03-20T13:38:04.704046+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:04.704046+0000","last_undegraded":"2024-03-20T13:38:04.704046+0000","last_fullsized":"2024-03-20T13:38:04.704046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:33.949395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559430+0000","last_change":"2024-03-20T13:36:38.834011+0000","last_active":"2024-03-20T13:38:04.559430+0000","last_peered":"2024-03-20T13:38:04.559430+0000","last_clean":"2024-03-20T13:38:04.559430+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:38:04.559430+0000","last_undegraded":"2024-03-20T13:38:04.559430+0000","last_fullsized":"2024-03-20T13:38:04.559430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:02.478170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342800+0000","last_change":"2024-03-20T13:36:36.833334+0000","last_active":"2024-03-20T13:37:17.342800+0000","last_peered":"2024-03-20T13:37:17.342800+0000","last_clean":"2024-03-20T13:37:17.342800+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:37:17.342800+0000","last_undegraded":"2024-03-20T13:37:17.342800+0000","last_fullsized":"2024-03-20T13:37:17.342800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:40.299686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353658+0000","last_change":"2024-03-20T13:36:40.840832+0000","last_active":"2024-03-20T13:37:17.353658+0000","last_peered":"2024-03-20T13:37:17.353658+0000","last_clean":"2024-03-20T13:37:17.353658+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:37:17.353658+0000","last_undegraded":"2024-03-20T13:37:17.353658+0000","last_fullsized":"2024-03-20T13:37:17.353658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:18:58.479248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.309071+0000","last_change":"2024-03-20T13:36:42.860856+0000","last_active":"2024-03-20T13:38:05.309071+0000","last_peered":"2024-03-20T13:38:05.309071+0000","last_clean":"2024-03-20T13:38:05.309071+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:05.309071+0000","last_undegraded":"2024-03-20T13:38:05.309071+0000","last_fullsized":"2024-03-20T13:38:05.309071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:44:34.562790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350102+0000","last_change":"2024-03-20T13:36:44.880578+0000","last_active":"2024-03-20T13:37:17.350102+0000","last_peered":"2024-03-20T13:37:17.350102+0000","last_clean":"2024-03-20T13:37:17.350102+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:37:17.350102+0000","last_undegraded":"2024-03-20T13:37:17.350102+0000","last_fullsized":"2024-03-20T13:37:17.350102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:33:34.967987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347355+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:37:17.347355+0000","last_peered":"2024-03-20T13:37:17.347355+0000","last_clean":"2024-03-20T13:37:17.347355+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:37:17.347355+0000","last_undegraded":"2024-03-20T13:37:17.347355+0000","last_fullsized":"2024-03-20T13:37:17.347355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358358+0000","last_change":"2024-03-20T13:36:38.839355+0000","last_active":"2024-03-20T13:37:17.358358+0000","last_peered":"2024-03-20T13:37:17.358358+0000","last_clean":"2024-03-20T13:37:17.358358+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:37:17.358358+0000","last_undegraded":"2024-03-20T13:37:17.358358+0000","last_fullsized":"2024-03-20T13:37:17.358358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349222+0000","last_change":"2024-03-20T13:36:36.835178+0000","last_active":"2024-03-20T13:37:17.349222+0000","last_peered":"2024-03-20T13:37:17.349222+0000","last_clean":"2024-03-20T13:37:17.349222+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:37:17.349222+0000","last_undegraded":"2024-03-20T13:37:17.349222+0000","last_fullsized":"2024-03-20T13:37:17.349222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354014+0000","last_change":"2024-03-20T13:36:40.859670+0000","last_active":"2024-03-20T13:37:17.354014+0000","last_peered":"2024-03-20T13:37:17.354014+0000","last_clean":"2024-03-20T13:37:17.354014+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:37:17.354014+0000","last_undegraded":"2024-03-20T13:37:17.354014+0000","last_fullsized":"2024-03-20T13:37:17.354014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:03.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.337993+0000","last_change":"2024-03-20T13:36:42.853208+0000","last_active":"2024-03-20T13:38:05.337993+0000","last_peered":"2024-03-20T13:38:05.337993+0000","last_clean":"2024-03-20T13:38:05.337993+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:05.337993+0000","last_undegraded":"2024-03-20T13:38:05.337993+0000","last_fullsized":"2024-03-20T13:38:05.337993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353489+0000","last_change":"2024-03-20T13:36:44.881033+0000","last_active":"2024-03-20T13:37:17.353489+0000","last_peered":"2024-03-20T13:37:17.353489+0000","last_clean":"2024-03-20T13:37:17.353489+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:37:17.353489+0000","last_undegraded":"2024-03-20T13:37:17.353489+0000","last_fullsized":"2024-03-20T13:37:17.353489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:51:03.967670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346808+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:37:17.346808+0000","last_peered":"2024-03-20T13:37:17.346808+0000","last_clean":"2024-03-20T13:37:17.346808+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:37:17.346808+0000","last_undegraded":"2024-03-20T13:37:17.346808+0000","last_fullsized":"2024-03-20T13:37:17.346808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340185+0000","last_change":"2024-03-20T13:36:38.841841+0000","last_active":"2024-03-20T13:37:17.340185+0000","last_peered":"2024-03-20T13:37:17.340185+0000","last_clean":"2024-03-20T13:37:17.340185+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:37:17.340185+0000","last_undegraded":"2024-03-20T13:37:17.340185+0000","last_fullsized":"2024-03-20T13:37:17.340185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:32.797279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355510+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:37:17.355510+0000","last_peered":"2024-03-20T13:37:17.355510+0000","last_clean":"2024-03-20T13:37:17.355510+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:37:17.355510+0000","last_undegraded":"2024-03-20T13:37:17.355510+0000","last_fullsized":"2024-03-20T13:37:17.355510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:33:21.986721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351081+0000","last_change":"2024-03-20T13:36:40.847481+0000","last_active":"2024-03-20T13:37:17.351081+0000","last_peered":"2024-03-20T13:37:17.351081+0000","last_clean":"2024-03-20T13:37:17.351081+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:37:17.351081+0000","last_undegraded":"2024-03-20T13:37:17.351081+0000","last_fullsized":"2024-03-20T13:37:17.351081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:49.265948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358102+0000","last_change":"2024-03-20T13:36:42.846652+0000","last_active":"2024-03-20T13:37:17.358102+0000","last_peered":"2024-03-20T13:37:17.358102+0000","last_clean":"2024-03-20T13:37:17.358102+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:37:17.358102+0000","last_undegraded":"2024-03-20T13:37:17.358102+0000","last_fullsized":"2024-03-20T13:37:17.358102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'240","reported_seq":304,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.266733+0000","last_change":"2024-03-20T13:36:44.870739+0000","last_active":"2024-03-20T13:38:11.266733+0000","last_peered":"2024-03-20T13:38:11.266733+0000","last_clean":"2024-03-20T13:38:11.266733+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:11.266733+0000","last_undegraded":"2024-03-20T13:38:11.266733+0000","last_fullsized":"2024-03-20T13:38:11.266733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:00:28.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346663+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:37:17.346663+0000","last_peered":"2024-03-20T13:37:17.346663+0000","last_clean":"2024-03-20T13:37:17.346663+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:37:17.346663+0000","last_undegraded":"2024-03-20T13:37:17.346663+0000","last_fullsized":"2024-03-20T13:37:17.346663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.774657+0000","last_change":"2024-03-20T13:36:38.838732+0000","last_active":"2024-03-20T13:37:21.774657+0000","last_peered":"2024-03-20T13:37:21.774657+0000","last_clean":"2024-03-20T13:37:21.774657+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:37:21.774657+0000","last_undegraded":"2024-03-20T13:37:21.774657+0000","last_fullsized":"2024-03-20T13:37:21.774657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:57.039567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352407+0000","last_change":"2024-03-20T13:36:36.847653+0000","last_active":"2024-03-20T13:37:17.352407+0000","last_peered":"2024-03-20T13:37:17.352407+0000","last_clean":"2024-03-20T13:37:17.352407+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:37:17.352407+0000","last_undegraded":"2024-03-20T13:37:17.352407+0000","last_fullsized":"2024-03-20T13:37:17.352407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:01:47.804240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":192,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.062892+0000","last_change":"2024-03-20T13:36:40.851669+0000","last_active":"2024-03-20T13:38:12.062892+0000","last_peered":"2024-03-20T13:38:12.062892+0000","last_clean":"2024-03-20T13:38:12.062892+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:12.062892+0000","last_undegraded":"2024-03-20T13:38:12.062892+0000","last_fullsized":"2024-03-20T13:38:12.062892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:16.049885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.294210+0000","last_change":"2024-03-20T13:36:42.876652+0000","last_active":"2024-03-20T13:38:05.294210+0000","last_peered":"2024-03-20T13:38:05.294210+0000","last_clean":"2024-03-20T13:38:05.294210+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:05.294210+0000","last_undegraded":"2024-03-20T13:38:05.294210+0000","last_fullsized":"2024-03-20T13:38:05.294210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338477+0000","last_change":"2024-03-20T13:36:44.880706+0000","last_active":"2024-03-20T13:37:17.338477+0000","last_peered":"2024-03-20T13:37:17.338477+0000","last_clean":"2024-03-20T13:37:17.338477+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:37:17.338477+0000","last_undegraded":"2024-03-20T13:37:17.338477+0000","last_fullsized":"2024-03-20T13:37:17.338477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:51.535549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354658+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:37:17.354658+0000","last_peered":"2024-03-20T13:37:17.354658+0000","last_clean":"2024-03-20T13:37:17.354658+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:37:17.354658+0000","last_undegraded":"2024-03-20T13:37:17.354658+0000","last_fullsized":"2024-03-20T13:37:17.354658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350635+0000","last_change":"2024-03-20T13:36:38.827830+0000","last_active":"2024-03-20T13:37:17.350635+0000","last_peered":"2024-03-20T13:37:17.350635+0000","last_clean":"2024-03-20T13:37:17.350635+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:37:17.350635+0000","last_undegraded":"2024-03-20T13:37:17.350635+0000","last_fullsized":"2024-03-20T13:37:17.350635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353488+0000","last_change":"2024-03-20T13:36:36.837596+0000","last_active":"2024-03-20T13:37:17.353488+0000","last_peered":"2024-03-20T13:37:17.353488+0000","last_clean":"2024-03-20T13:37:17.353488+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:37:17.353488+0000","last_undegraded":"2024-03-20T13:37:17.353488+0000","last_fullsized":"2024-03-20T13:37:17.353488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":199,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.188469+0000","last_change":"2024-03-20T13:36:40.851969+0000","last_active":"2024-03-20T13:38:12.188469+0000","last_peered":"2024-03-20T13:38:12.188469+0000","last_clean":"2024-03-20T13:38:12.188469+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:12.188469+0000","last_undegraded":"2024-03-20T13:38:12.188469+0000","last_fullsized":"2024-03-20T13:38:12.188469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:05.906039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.294273+0000","last_change":"2024-03-20T13:36:42.863180+0000","last_active":"2024-03-20T13:38:05.294273+0000","last_peered":"2024-03-20T13:38:05.294273+0000","last_clean":"2024-03-20T13:38:05.294273+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:05.294273+0000","last_undegraded":"2024-03-20T13:38:05.294273+0000","last_fullsized":"2024-03-20T13:38:05.294273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:45:02.764876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347146+0000","last_change":"2024-03-20T13:36:44.869579+0000","last_active":"2024-03-20T13:37:17.347146+0000","last_peered":"2024-03-20T13:37:17.347146+0000","last_clean":"2024-03-20T13:37:17.347146+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:37:17.347146+0000","last_undegraded":"2024-03-20T13:37:17.347146+0000","last_fullsized":"2024-03-20T13:37:17.347146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.022745+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:11.022745+0000","last_peered":"2024-03-20T13:38:11.022745+0000","last_clean":"2024-03-20T13:38:11.022745+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:11.022745+0000","last_undegraded":"2024-03-20T13:38:11.022745+0000","last_fullsized":"2024-03-20T13:38:11.022745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560346+0000","last_change":"2024-03-20T13:36:38.826048+0000","last_active":"2024-03-20T13:38:04.560346+0000","last_peered":"2024-03-20T13:38:04.560346+0000","last_clean":"2024-03-20T13:38:04.560346+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:38:04.560346+0000","last_undegraded":"2024-03-20T13:38:04.560346+0000","last_fullsized":"2024-03-20T13:38:04.560346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:34:12.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362384+0000","last_change":"2024-03-20T13:36:36.848516+0000","last_active":"2024-03-20T13:37:17.362384+0000","last_peered":"2024-03-20T13:37:17.362384+0000","last_clean":"2024-03-20T13:37:17.362384+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:37:17.362384+0000","last_undegraded":"2024-03-20T13:37:17.362384+0000","last_fullsized":"2024-03-20T13:37:17.362384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343154+0000","last_change":"2024-03-20T13:36:40.851382+0000","last_active":"2024-03-20T13:37:17.343154+0000","last_peered":"2024-03-20T13:37:17.343154+0000","last_clean":"2024-03-20T13:37:17.343154+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:37:17.343154+0000","last_undegraded":"2024-03-20T13:37:17.343154+0000","last_fullsized":"2024-03-20T13:37:17.343154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:56.202294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'24","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.334890+0000","last_change":"2024-03-20T13:36:42.845176+0000","last_active":"2024-03-20T13:38:05.334890+0000","last_peered":"2024-03-20T13:38:05.334890+0000","last_clean":"2024-03-20T13:38:05.334890+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:05.334890+0000","last_undegraded":"2024-03-20T13:38:05.334890+0000","last_fullsized":"2024-03-20T13:38:05.334890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:22.548562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348416+0000","last_change":"2024-03-20T13:36:44.871360+0000","last_active":"2024-03-20T13:37:17.348416+0000","last_peered":"2024-03-20T13:37:17.348416+0000","last_clean":"2024-03-20T13:37:17.348416+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:37:17.348416+0000","last_undegraded":"2024-03-20T13:37:17.348416+0000","last_fullsized":"2024-03-20T13:37:17.348416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.055574+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:37:22.055574+0000","last_peered":"2024-03-20T13:37:22.055574+0000","last_clean":"2024-03-20T13:37:22.055574+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:37:22.055574+0000","last_undegraded":"2024-03-20T13:37:22.055574+0000","last_fullsized":"2024-03-20T13:37:22.055574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103962+0000","last_change":"2024-03-20T13:36:38.844162+0000","last_active":"2024-03-20T13:37:22.103962+0000","last_peered":"2024-03-20T13:37:22.103962+0000","last_clean":"2024-03-20T13:37:22.103962+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:37:22.103962+0000","last_undegraded":"2024-03-20T13:37:22.103962+0000","last_fullsized":"2024-03-20T13:37:22.103962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354264+0000","last_change":"2024-03-20T13:36:36.832558+0000","last_active":"2024-03-20T13:37:17.354264+0000","last_peered":"2024-03-20T13:37:17.354264+0000","last_clean":"2024-03-20T13:37:17.354264+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:37:17.354264+0000","last_undegraded":"2024-03-20T13:37:17.354264+0000","last_fullsized":"2024-03-20T13:37:17.354264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:27.481357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342345+0000","last_change":"2024-03-20T13:36:40.857715+0000","last_active":"2024-03-20T13:37:17.342345+0000","last_peered":"2024-03-20T13:37:17.342345+0000","last_clean":"2024-03-20T13:37:17.342345+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:37:17.342345+0000","last_undegraded":"2024-03-20T13:37:17.342345+0000","last_fullsized":"2024-03-20T13:37:17.342345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:54.489899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'29","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.012261+0000","last_change":"2024-03-20T13:36:42.860634+0000","last_active":"2024-03-20T13:38:11.012261+0000","last_peered":"2024-03-20T13:38:11.012261+0000","last_clean":"2024-03-20T13:38:11.012261+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:11.012261+0000","last_undegraded":"2024-03-20T13:38:11.012261+0000","last_fullsized":"2024-03-20T13:38:11.012261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336050+0000","last_change":"2024-03-20T13:36:44.875311+0000","last_active":"2024-03-20T13:37:17.336050+0000","last_peered":"2024-03-20T13:37:17.336050+0000","last_clean":"2024-03-20T13:37:17.336050+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:37:17.336050+0000","last_undegraded":"2024-03-20T13:37:17.336050+0000","last_fullsized":"2024-03-20T13:37:17.336050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:40.597951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354486+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:37:17.354486+0000","last_peered":"2024-03-20T13:37:17.354486+0000","last_clean":"2024-03-20T13:37:17.354486+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:37:17.354486+0000","last_undegraded":"2024-03-20T13:37:17.354486+0000","last_fullsized":"2024-03-20T13:37:17.354486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362094+0000","last_change":"2024-03-20T13:36:38.834433+0000","last_active":"2024-03-20T13:38:05.362094+0000","last_peered":"2024-03-20T13:38:05.362094+0000","last_clean":"2024-03-20T13:38:05.362094+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:38:05.362094+0000","last_undegraded":"2024-03-20T13:38:05.362094+0000","last_fullsized":"2024-03-20T13:38:05.362094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:57.952498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334809+0000","last_change":"2024-03-20T13:36:36.812837+0000","last_active":"2024-03-20T13:37:17.334809+0000","last_peered":"2024-03-20T13:37:17.334809+0000","last_clean":"2024-03-20T13:37:17.334809+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:37:17.334809+0000","last_undegraded":"2024-03-20T13:37:17.334809+0000","last_fullsized":"2024-03-20T13:37:17.334809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:34.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.333133+0000","last_change":"2024-03-20T13:36:38.839230+0000","last_active":"2024-03-20T13:37:21.333133+0000","last_peered":"2024-03-20T13:37:21.333133+0000","last_clean":"2024-03-20T13:37:21.333133+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:37:21.333133+0000","last_undegraded":"2024-03-20T13:37:21.333133+0000","last_fullsized":"2024-03-20T13:37:21.333133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:30.816812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334989+0000","last_change":"2024-03-20T13:36:36.814746+0000","last_active":"2024-03-20T13:37:17.334989+0000","last_peered":"2024-03-20T13:37:17.334989+0000","last_clean":"2024-03-20T13:37:17.334989+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:37:17.334989+0000","last_undegraded":"2024-03-20T13:37:17.334989+0000","last_fullsized":"2024-03-20T13:37:17.334989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:55.744070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353374+0000","last_change":"2024-03-20T13:36:38.837487+0000","last_active":"2024-03-20T13:37:17.353374+0000","last_peered":"2024-03-20T13:37:17.353374+0000","last_clean":"2024-03-20T13:37:17.353374+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:37:17.353374+0000","last_undegraded":"2024-03-20T13:37:17.353374+0000","last_fullsized":"2024-03-20T13:37:17.353374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:02:07.258709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356320+0000","last_change":"2024-03-20T13:36:36.851159+0000","last_active":"2024-03-20T13:37:17.356320+0000","last_peered":"2024-03-20T13:37:17.356320+0000","last_clean":"2024-03-20T13:37:17.356320+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:37:17.356320+0000","last_undegraded":"2024-03-20T13:37:17.356320+0000","last_fullsized":"2024-03-20T13:37:17.356320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:19:31.572008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352794+0000","last_change":"2024-03-20T13:36:38.839750+0000","last_active":"2024-03-20T13:37:17.352794+0000","last_peered":"2024-03-20T13:37:17.352794+0000","last_clean":"2024-03-20T13:37:17.352794+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:37:17.352794+0000","last_undegraded":"2024-03-20T13:37:17.352794+0000","last_fullsized":"2024-03-20T13:37:17.352794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:04:09.779028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.353796+0000","last_change":"2024-03-20T13:36:36.811977+0000","last_active":"2024-03-20T13:38:05.353796+0000","last_peered":"2024-03-20T13:38:05.353796+0000","last_clean":"2024-03-20T13:38:05.353796+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:05.353796+0000","last_undegraded":"2024-03-20T13:38:05.353796+0000","last_fullsized":"2024-03-20T13:38:05.353796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:32:12.757319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559426+0000","last_change":"2024-03-20T13:37:17.364712+0000","last_active":"2024-03-20T13:38:04.559426+0000","last_peered":"2024-03-20T13:38:04.559426+0000","last_clean":"2024-03-20T13:38:04.559426+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:38:04.559426+0000","last_undegraded":"2024-03-20T13:38:04.559426+0000","last_fullsized":"2024-03-20T13:38:04.559426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:19.939344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348779+0000","last_change":"2024-03-20T13:36:36.846100+0000","last_active":"2024-03-20T13:37:17.348779+0000","last_peered":"2024-03-20T13:37:17.348779+0000","last_clean":"2024-03-20T13:37:17.348779+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:37:17.348779+0000","last_undegraded":"2024-03-20T13:37:17.348779+0000","last_fullsized":"2024-03-20T13:37:17.348779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348556+0000","last_change":"2024-03-20T13:36:38.837474+0000","last_active":"2024-03-20T13:37:17.348556+0000","last_peered":"2024-03-20T13:37:17.348556+0000","last_clean":"2024-03-20T13:37:17.348556+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:37:17.348556+0000","last_undegraded":"2024-03-20T13:37:17.348556+0000","last_fullsized":"2024-03-20T13:37:17.348556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:44.912843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350563+0000","last_change":"2024-03-20T13:36:36.831139+0000","last_active":"2024-03-20T13:37:17.350563+0000","last_peered":"2024-03-20T13:37:17.350563+0000","last_clean":"2024-03-20T13:37:17.350563+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:37:17.350563+0000","last_undegraded":"2024-03-20T13:37:17.350563+0000","last_fullsized":"2024-03-20T13:37:17.350563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:37.352809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038682+0000","last_change":"2024-03-20T13:36:38.836423+0000","last_active":"2024-03-20T13:38:11.038682+0000","last_peered":"2024-03-20T13:38:11.038682+0000","last_clean":"2024-03-20T13:38:11.038682+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:11.038682+0000","last_undegraded":"2024-03-20T13:38:11.038682+0000","last_fullsized":"2024-03-20T13:38:11.038682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345654+0000","last_change":"2024-03-20T13:36:36.818776+0000","last_active":"2024-03-20T13:37:17.345654+0000","last_peered":"2024-03-20T13:37:17.345654+0000","last_clean":"2024-03-20T13:37:17.345654+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:37:17.345654+0000","last_undegraded":"2024-03-20T13:37:17.345654+0000","last_fullsized":"2024-03-20T13:37:17.345654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:47.923230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349498+0000","last_change":"2024-03-20T13:36:38.831672+0000","last_active":"2024-03-20T13:37:17.349498+0000","last_peered":"2024-03-20T13:37:17.349498+0000","last_clean":"2024-03-20T13:37:17.349498+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:37:17.349498+0000","last_undegraded":"2024-03-20T13:37:17.349498+0000","last_fullsized":"2024-03-20T13:37:17.349498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360818+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:37:17.360818+0000","last_peered":"2024-03-20T13:37:17.360818+0000","last_clean":"2024-03-20T13:37:17.360818+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:37:17.360818+0000","last_undegraded":"2024-03-20T13:37:17.360818+0000","last_fullsized":"2024-03-20T13:37:17.360818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038256+0000","last_change":"2024-03-20T13:36:38.839448+0000","last_active":"2024-03-20T13:38:11.038256+0000","last_peered":"2024-03-20T13:38:11.038256+0000","last_clean":"2024-03-20T13:38:11.038256+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:11.038256+0000","last_undegraded":"2024-03-20T13:38:11.038256+0000","last_fullsized":"2024-03-20T13:38:11.038256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:44:49.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339930+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:37:17.339930+0000","last_peered":"2024-03-20T13:37:17.339930+0000","last_clean":"2024-03-20T13:37:17.339930+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:37:17.339930+0000","last_undegraded":"2024-03-20T13:37:17.339930+0000","last_fullsized":"2024-03-20T13:37:17.339930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361835+0000","last_change":"2024-03-20T13:36:38.828492+0000","last_active":"2024-03-20T13:37:17.361835+0000","last_peered":"2024-03-20T13:37:17.361835+0000","last_clean":"2024-03-20T13:37:17.361835+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:37:17.361835+0000","last_undegraded":"2024-03-20T13:37:17.361835+0000","last_fullsized":"2024-03-20T13:37:17.361835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341186+0000","last_change":"2024-03-20T13:36:36.848972+0000","last_active":"2024-03-20T13:37:17.341186+0000","last_peered":"2024-03-20T13:37:17.341186+0000","last_clean":"2024-03-20T13:37:17.341186+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:37:17.341186+0000","last_undegraded":"2024-03-20T13:37:17.341186+0000","last_fullsized":"2024-03-20T13:37:17.341186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:57.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559674+0000","last_change":"2024-03-20T13:36:38.830672+0000","last_active":"2024-03-20T13:38:04.559674+0000","last_peered":"2024-03-20T13:38:04.559674+0000","last_clean":"2024-03-20T13:38:04.559674+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:04.559674+0000","last_undegraded":"2024-03-20T13:38:04.559674+0000","last_fullsized":"2024-03-20T13:38:04.559674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.951500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.094321+0000","last_change":"2024-03-20T13:36:36.830049+0000","last_active":"2024-03-20T13:37:22.094321+0000","last_peered":"2024-03-20T13:37:22.094321+0000","last_clean":"2024-03-20T13:37:22.094321+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:37:22.094321+0000","last_undegraded":"2024-03-20T13:37:22.094321+0000","last_fullsized":"2024-03-20T13:37:22.094321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.370623+0000","last_change":"2024-03-20T13:37:17.369630+0000","last_active":"2024-03-20T13:37:17.370623+0000","last_peered":"2024-03-20T13:37:17.370623+0000","last_clean":"2024-03-20T13:37:17.370623+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:37:17.370623+0000","last_undegraded":"2024-03-20T13:37:17.370623+0000","last_fullsized":"2024-03-20T13:37:17.370623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:10.411859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348081+0000","last_change":"2024-03-20T13:36:36.831557+0000","last_active":"2024-03-20T13:37:17.348081+0000","last_peered":"2024-03-20T13:37:17.348081+0000","last_clean":"2024-03-20T13:37:17.348081+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:37:17.348081+0000","last_undegraded":"2024-03-20T13:37:17.348081+0000","last_fullsized":"2024-03-20T13:37:17.348081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:10:52.993902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560621+0000","last_change":"2024-03-20T13:36:38.829272+0000","last_active":"2024-03-20T13:38:04.560621+0000","last_peered":"2024-03-20T13:38:04.560621+0000","last_clean":"2024-03-20T13:38:04.560621+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:38:04.560621+0000","last_undegraded":"2024-03-20T13:38:04.560621+0000","last_fullsized":"2024-03-20T13:38:04.560621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349002+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:37:17.349002+0000","last_peered":"2024-03-20T13:37:17.349002+0000","last_clean":"2024-03-20T13:37:17.349002+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:37:17.349002+0000","last_undegraded":"2024-03-20T13:37:17.349002+0000","last_fullsized":"2024-03-20T13:37:17.349002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.775462+0000","last_change":"2024-03-20T13:37:17.354371+0000","last_active":"2024-03-20T13:37:21.775462+0000","last_peered":"2024-03-20T13:37:21.775462+0000","last_clean":"2024-03-20T13:37:21.775462+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:37:21.775462+0000","last_undegraded":"2024-03-20T13:37:21.775462+0000","last_fullsized":"2024-03-20T13:37:21.775462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:51.168656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351746+0000","last_change":"2024-03-20T13:36:36.848902+0000","last_active":"2024-03-20T13:37:17.351746+0000","last_peered":"2024-03-20T13:37:17.351746+0000","last_clean":"2024-03-20T13:37:17.351746+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:37:17.351746+0000","last_undegraded":"2024-03-20T13:37:17.351746+0000","last_fullsized":"2024-03-20T13:37:17.351746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347273+0000","last_change":"2024-03-20T13:36:38.836588+0000","last_active":"2024-03-20T13:37:17.347273+0000","last_peered":"2024-03-20T13:37:17.347273+0000","last_clean":"2024-03-20T13:37:17.347273+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:37:17.347273+0000","last_undegraded":"2024-03-20T13:37:17.347273+0000","last_fullsized":"2024-03-20T13:37:17.347273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346147+0000","last_change":"2024-03-20T13:36:36.818507+0000","last_active":"2024-03-20T13:37:17.346147+0000","last_peered":"2024-03-20T13:37:17.346147+0000","last_clean":"2024-03-20T13:37:17.346147+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:37:17.346147+0000","last_undegraded":"2024-03-20T13:37:17.346147+0000","last_fullsized":"2024-03-20T13:37:17.346147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:42:17.676549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103624+0000","last_change":"2024-03-20T13:36:38.828728+0000","last_active":"2024-03-20T13:37:22.103624+0000","last_peered":"2024-03-20T13:37:22.103624+0000","last_clean":"2024-03-20T13:37:22.103624+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:37:22.103624+0000","last_undegraded":"2024-03-20T13:37:22.103624+0000","last_fullsized":"2024-03-20T13:37:22.103624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:34.549840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.311031+0000","last_change":"2024-03-20T13:36:36.846419+0000","last_active":"2024-03-20T13:37:21.311031+0000","last_peered":"2024-03-20T13:37:21.311031+0000","last_clean":"2024-03-20T13:37:21.311031+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:37:21.311031+0000","last_undegraded":"2024-03-20T13:37:21.311031+0000","last_fullsized":"2024-03-20T13:37:21.311031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347654+0000","last_change":"2024-03-20T13:36:36.834343+0000","last_active":"2024-03-20T13:37:17.347654+0000","last_peered":"2024-03-20T13:37:17.347654+0000","last_clean":"2024-03-20T13:37:17.347654+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:37:17.347654+0000","last_undegraded":"2024-03-20T13:37:17.347654+0000","last_fullsized":"2024-03-20T13:37:17.347654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099296+0000","last_change":"2024-03-20T13:36:38.830650+0000","last_active":"2024-03-20T13:37:22.099296+0000","last_peered":"2024-03-20T13:37:22.099296+0000","last_clean":"2024-03-20T13:37:22.099296+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:37:22.099296+0000","last_undegraded":"2024-03-20T13:37:22.099296+0000","last_fullsized":"2024-03-20T13:37:22.099296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:47.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343075+0000","last_change":"2024-03-20T13:36:36.833552+0000","last_active":"2024-03-20T13:37:17.343075+0000","last_peered":"2024-03-20T13:37:17.343075+0000","last_clean":"2024-03-20T13:37:17.343075+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:37:17.343075+0000","last_undegraded":"2024-03-20T13:37:17.343075+0000","last_fullsized":"2024-03-20T13:37:17.343075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:36.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099152+0000","last_change":"2024-03-20T13:36:38.827748+0000","last_active":"2024-03-20T13:37:22.099152+0000","last_peered":"2024-03-20T13:37:22.099152+0000","last_clean":"2024-03-20T13:37:22.099152+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:37:22.099152+0000","last_undegraded":"2024-03-20T13:37:22.099152+0000","last_fullsized":"2024-03-20T13:37:22.099152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:07.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672987,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.47199999999999998}]}]},{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.73399999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672986,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.54400000000000004}]},{"osd":3,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68899999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.627}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:38:19.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:38:19.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.698+0000 7f62f9498640 1 Processor -- start 2024-03-20T13:38:19.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.698+0000 7f62f9498640 1 -- start start 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62f409d7e0 0x7f62f41332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f4099d80 con 0x7f62f4098910 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f409a340 con 0x7f62f409d7e0 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f27fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62f409d7e0 0x7f62f41332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f62f4098910 0x7f62f4098cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60100/0 (socket says 172.21.15.89:60100) 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f2ffd640 1 -- 172.21.15.89:0/3340826566 learned_addr learned my addr 172.21.15.89:0/3340826566 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f27fc640 1 -- 172.21.15.89:0/3340826566 >> v1:172.21.15.89:6789/0 conn(0x7f62f4098910 legacy=0x7f62f4098cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f27fc640 1 -- 172.21.15.89:0/3340826566 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f409a5e0 con 0x7f62f409d7e0 2024-03-20T13:38:19.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f1ffb640 1 -- 172.21.15.89:0/3340826566 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393372553 0 0) 0x7f62f4099d80 con 0x7f62f4098910 2024-03-20T13:38:19.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f27fc640 1 --2- 172.21.15.89:0/3340826566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f409d7e0 0x7f62f41332f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009740 tx=0x7f62dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2bf901b1247aad server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:19.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f1ffb640 1 -- 172.21.15.89:0/3340826566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62dc0ab530 con 0x7f62f409d7e0 2024-03-20T13:38:19.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f1ffb640 1 -- 172.21.15.89:0/3340826566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0a7050 con 0x7f62f409d7e0 2024-03-20T13:38:19.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f1ffb640 1 -- 172.21.15.89:0/3340826566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62dc0ab7e0 con 0x7f62f409d7e0 2024-03-20T13:38:19.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- 172.21.15.89:0/3340826566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f409d7e0 msgr2=0x7f62f41332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 --2- 172.21.15.89:0/3340826566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f409d7e0 0x7f62f41332f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009740 tx=0x7f62dc01c370 comp rx=0 tx=0).stop 2024-03-20T13:38:19.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- 172.21.15.89:0/3340826566 shutdown_connections 2024-03-20T13:38:19.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 --2- 172.21.15.89:0/3340826566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f409d7e0 0x7f62f41332f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- 172.21.15.89:0/3340826566 >> 172.21.15.89:0/3340826566 conn(0x7f62f40a0a00 msgr2=0x7f62f409cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- 172.21.15.89:0/3340826566 shutdown_connections 2024-03-20T13:38:19.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.702+0000 7f62f9498640 1 -- 172.21.15.89:0/3340826566 wait complete. 2024-03-20T13:38:19.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 Processor -- start 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 -- start start 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 0x7f62f41c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f4132910 con 0x7f62f4098910 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 0x7f62f41c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 0x7f62f41c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34960/0 (socket says 172.21.15.89:34960) 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f2ffd640 1 -- 172.21.15.89:0/3196524891 learned_addr learned my addr 172.21.15.89:0/3196524891 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f2ffd640 1 -- 172.21.15.89:0/3196524891 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009420 con 0x7f62f4098910 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f2ffd640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 0x7f62f41c5940 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c840 tx=0x7f62ec00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62ec00a660 con 0x7f62f4098910 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec00a7e0 con 0x7f62f4098910 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f4132e40 con 0x7f62f4098910 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62ec00aac0 con 0x7f62f4098910 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f41323c0 con 0x7f62f4098910 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f4062860 con 0x7f62f4098910 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62ec00ac20 con 0x7f62f4098910 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62eb7fe640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f62d4035a10 0x7f62d4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f62ec048130 con 0x7f62f4098910 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f27fc640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f62d4035a10 0x7f62d4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.706+0000 7f62f27fc640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f62d4035a10 0x7f62d4037ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ad000 tx=0x7f62dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.710+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f62ec01a6b0 con 0x7f62f4098910 2024-03-20T13:38:19.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.866+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62f4131750 con 0x7f62d4035a10 2024-03-20T13:38:19.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.910+0000 7f62eb7fe640 1 -- 172.21.15.89:0/3196524891 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673721 (secure 0 0 0) 0x7f62f4131750 con 0x7f62d4035a10 2024-03-20T13:38:19.919 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:38:19.925 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:38:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.914+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f62d4035a10 msgr2=0x7f62d4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.914+0000 7f62f9498640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f62d4035a10 0x7f62d4037ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ad000 tx=0x7f62dc008040 comp rx=0 tx=0).stop 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.914+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 msgr2=0x7f62f41c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.914+0000 7f62f9498640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 0x7f62f41c5940 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c840 tx=0x7f62ec00cd00 comp rx=0 tx=0).stop 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.914+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 shutdown_connections 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.914+0000 7f62f9498640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f62d4035a10 0x7f62d4037ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.918+0000 7f62f9498640 1 --2- 172.21.15.89:0/3196524891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f4098910 0x7f62f41c5940 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.918+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 >> 172.21.15.89:0/3196524891 conn(0x7f62f40a0a00 msgr2=0x7f62f412bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.918+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 shutdown_connections 2024-03-20T13:38:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:19.918+0000 7f62f9498640 1 -- 172.21.15.89:0/3196524891 wait complete. 2024-03-20T13:38:19.940 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-03-20T13:38:18.285166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3794,"num_read_kb":3437,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-19,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":348,"num_read_kb":331,"num_write":116,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006249"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353220+0000","last_change":"2024-03-20T13:36:36.834585+0000","last_active":"2024-03-20T13:37:17.353220+0000","last_peered":"2024-03-20T13:37:17.353220+0000","last_clean":"2024-03-20T13:37:17.353220+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:37:17.353220+0000","last_undegraded":"2024-03-20T13:37:17.353220+0000","last_fullsized":"2024-03-20T13:37:17.353220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:42.695830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348328+0000","last_change":"2024-03-20T13:36:38.833359+0000","last_active":"2024-03-20T13:37:17.348328+0000","last_peered":"2024-03-20T13:37:17.348328+0000","last_clean":"2024-03-20T13:37:17.348328+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:37:17.348328+0000","last_undegraded":"2024-03-20T13:37:17.348328+0000","last_fullsized":"2024-03-20T13:37:17.348328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359019+0000","last_change":"2024-03-20T13:36:36.849152+0000","last_active":"2024-03-20T13:37:17.359019+0000","last_peered":"2024-03-20T13:37:17.359019+0000","last_clean":"2024-03-20T13:37:17.359019+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:37:17.359019+0000","last_undegraded":"2024-03-20T13:37:17.359019+0000","last_fullsized":"2024-03-20T13:37:17.359019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:26.137179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038312+0000","last_change":"2024-03-20T13:36:38.817960+0000","last_active":"2024-03-20T13:38:11.038312+0000","last_peered":"2024-03-20T13:38:11.038312+0000","last_clean":"2024-03-20T13:38:11.038312+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:38:11.038312+0000","last_undegraded":"2024-03-20T13:38:11.038312+0000","last_fullsized":"2024-03-20T13:38:11.038312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:21:08.799966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351979+0000","last_change":"2024-03-20T13:36:36.848291+0000","last_active":"2024-03-20T13:37:17.351979+0000","last_peered":"2024-03-20T13:37:17.351979+0000","last_clean":"2024-03-20T13:37:17.351979+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:37:17.351979+0000","last_undegraded":"2024-03-20T13:37:17.351979+0000","last_fullsized":"2024-03-20T13:37:17.351979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559658+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:04.559658+0000","last_peered":"2024-03-20T13:38:04.559658+0000","last_clean":"2024-03-20T13:38:04.559658+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:04.559658+0000","last_undegraded":"2024-03-20T13:38:04.559658+0000","last_fullsized":"2024-03-20T13:38:04.559658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:50.112294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338808+0000","last_change":"2024-03-20T13:36:36.813481+0000","last_active":"2024-03-20T13:37:17.338808+0000","last_peered":"2024-03-20T13:37:17.338808+0000","last_clean":"2024-03-20T13:37:17.338808+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:37:17.338808+0000","last_undegraded":"2024-03-20T13:37:17.338808+0000","last_fullsized":"2024-03-20T13:37:17.338808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:54.373470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.335849+0000","last_change":"2024-03-20T13:36:38.821653+0000","last_active":"2024-03-20T13:37:21.335849+0000","last_peered":"2024-03-20T13:37:21.335849+0000","last_clean":"2024-03-20T13:37:21.335849+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:37:21.335849+0000","last_undegraded":"2024-03-20T13:37:21.335849+0000","last_fullsized":"2024-03-20T13:37:21.335849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.030141+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:11.030141+0000","last_peered":"2024-03-20T13:38:11.030141+0000","last_clean":"2024-03-20T13:38:11.030141+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:11.030141+0000","last_undegraded":"2024-03-20T13:38:11.030141+0000","last_fullsized":"2024-03-20T13:38:11.030141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361558+0000","last_change":"2024-03-20T13:36:38.841957+0000","last_active":"2024-03-20T13:38:05.361558+0000","last_peered":"2024-03-20T13:38:05.361558+0000","last_clean":"2024-03-20T13:38:05.361558+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:05.361558+0000","last_undegraded":"2024-03-20T13:38:05.361558+0000","last_fullsized":"2024-03-20T13:38:05.361558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:10.770393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349494+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:37:17.349494+0000","last_peered":"2024-03-20T13:37:17.349494+0000","last_clean":"2024-03-20T13:37:17.349494+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:37:17.349494+0000","last_undegraded":"2024-03-20T13:37:17.349494+0000","last_fullsized":"2024-03-20T13:37:17.349494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.779828+0000","last_change":"2024-03-20T13:36:38.846021+0000","last_active":"2024-03-20T13:37:21.779828+0000","last_peered":"2024-03-20T13:37:21.779828+0000","last_clean":"2024-03-20T13:37:21.779828+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:37:21.779828+0000","last_undegraded":"2024-03-20T13:37:21.779828+0000","last_fullsized":"2024-03-20T13:37:21.779828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342434+0000","last_change":"2024-03-20T13:36:36.844496+0000","last_active":"2024-03-20T13:37:17.342434+0000","last_peered":"2024-03-20T13:37:17.342434+0000","last_clean":"2024-03-20T13:37:17.342434+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:37:17.342434+0000","last_undegraded":"2024-03-20T13:37:17.342434+0000","last_fullsized":"2024-03-20T13:37:17.342434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356403+0000","last_change":"2024-03-20T13:36:38.843718+0000","last_active":"2024-03-20T13:37:17.356403+0000","last_peered":"2024-03-20T13:37:17.356403+0000","last_clean":"2024-03-20T13:37:17.356403+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:37:17.356403+0000","last_undegraded":"2024-03-20T13:37:17.356403+0000","last_fullsized":"2024-03-20T13:37:17.356403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:16.103447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.529939+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:37:20.529939+0000","last_peered":"2024-03-20T13:37:20.529939+0000","last_clean":"2024-03-20T13:37:20.529939+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:37:20.529939+0000","last_undegraded":"2024-03-20T13:37:20.529939+0000","last_fullsized":"2024-03-20T13:37:20.529939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:29.131356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048710+0000","last_change":"2024-03-20T13:36:38.830884+0000","last_active":"2024-03-20T13:38:11.048710+0000","last_peered":"2024-03-20T13:38:11.048710+0000","last_clean":"2024-03-20T13:38:11.048710+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:11.048710+0000","last_undegraded":"2024-03-20T13:38:11.048710+0000","last_fullsized":"2024-03-20T13:38:11.048710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:06.433353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348004+0000","last_change":"2024-03-20T13:36:38.833138+0000","last_active":"2024-03-20T13:37:17.348004+0000","last_peered":"2024-03-20T13:37:17.348004+0000","last_clean":"2024-03-20T13:37:17.348004+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:37:17.348004+0000","last_undegraded":"2024-03-20T13:37:17.348004+0000","last_fullsized":"2024-03-20T13:37:17.348004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.070212+0000","last_change":"2024-03-20T13:36:36.832461+0000","last_active":"2024-03-20T13:37:22.070212+0000","last_peered":"2024-03-20T13:37:22.070212+0000","last_clean":"2024-03-20T13:37:22.070212+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:37:22.070212+0000","last_undegraded":"2024-03-20T13:37:22.070212+0000","last_fullsized":"2024-03-20T13:37:22.070212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:29:37.186470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.039239+0000","last_change":"2024-03-20T13:36:38.843593+0000","last_active":"2024-03-20T13:38:11.039239+0000","last_peered":"2024-03-20T13:38:11.039239+0000","last_clean":"2024-03-20T13:38:11.039239+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:11.039239+0000","last_undegraded":"2024-03-20T13:38:11.039239+0000","last_fullsized":"2024-03-20T13:38:11.039239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347887+0000","last_change":"2024-03-20T13:36:36.818443+0000","last_active":"2024-03-20T13:37:17.347887+0000","last_peered":"2024-03-20T13:37:17.347887+0000","last_clean":"2024-03-20T13:37:17.347887+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:37:17.347887+0000","last_undegraded":"2024-03-20T13:37:17.347887+0000","last_fullsized":"2024-03-20T13:37:17.347887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:58:23.109004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362815+0000","last_change":"2024-03-20T13:36:38.831759+0000","last_active":"2024-03-20T13:38:05.362815+0000","last_peered":"2024-03-20T13:38:05.362815+0000","last_clean":"2024-03-20T13:38:05.362815+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:05.362815+0000","last_undegraded":"2024-03-20T13:38:05.362815+0000","last_fullsized":"2024-03-20T13:38:05.362815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:21.180969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353762+0000","last_change":"2024-03-20T13:36:36.840606+0000","last_active":"2024-03-20T13:37:17.353762+0000","last_peered":"2024-03-20T13:37:17.353762+0000","last_clean":"2024-03-20T13:37:17.353762+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:37:17.353762+0000","last_undegraded":"2024-03-20T13:37:17.353762+0000","last_fullsized":"2024-03-20T13:37:17.353762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038457+0000","last_change":"2024-03-20T13:36:38.828329+0000","last_active":"2024-03-20T13:38:11.038457+0000","last_peered":"2024-03-20T13:38:11.038457+0000","last_clean":"2024-03-20T13:38:11.038457+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:11.038457+0000","last_undegraded":"2024-03-20T13:38:11.038457+0000","last_fullsized":"2024-03-20T13:38:11.038457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:12.734298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.088045+0000","last_change":"2024-03-20T13:36:36.826166+0000","last_active":"2024-03-20T13:37:22.088045+0000","last_peered":"2024-03-20T13:37:22.088045+0000","last_clean":"2024-03-20T13:37:22.088045+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:37:22.088045+0000","last_undegraded":"2024-03-20T13:37:22.088045+0000","last_fullsized":"2024-03-20T13:37:22.088045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.337413+0000","last_change":"2024-03-20T13:36:38.825590+0000","last_active":"2024-03-20T13:37:21.337413+0000","last_peered":"2024-03-20T13:37:21.337413+0000","last_clean":"2024-03-20T13:37:21.337413+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:37:21.337413+0000","last_undegraded":"2024-03-20T13:37:21.337413+0000","last_fullsized":"2024-03-20T13:37:21.337413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:35.374667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355672+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:37:17.355672+0000","last_peered":"2024-03-20T13:37:17.355672+0000","last_clean":"2024-03-20T13:37:17.355672+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:37:17.355672+0000","last_undegraded":"2024-03-20T13:37:17.355672+0000","last_fullsized":"2024-03-20T13:37:17.355672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:27.631307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.336262+0000","last_change":"2024-03-20T13:36:38.836549+0000","last_active":"2024-03-20T13:37:21.336262+0000","last_peered":"2024-03-20T13:37:21.336262+0000","last_clean":"2024-03-20T13:37:21.336262+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:37:21.336262+0000","last_undegraded":"2024-03-20T13:37:21.336262+0000","last_fullsized":"2024-03-20T13:37:21.336262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:33.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356996+0000","last_change":"2024-03-20T13:36:36.848317+0000","last_active":"2024-03-20T13:37:17.356996+0000","last_peered":"2024-03-20T13:37:17.356996+0000","last_clean":"2024-03-20T13:37:17.356996+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:37:17.356996+0000","last_undegraded":"2024-03-20T13:37:17.356996+0000","last_fullsized":"2024-03-20T13:37:17.356996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.021474+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:11.021474+0000","last_peered":"2024-03-20T13:38:11.021474+0000","last_clean":"2024-03-20T13:38:11.021474+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:11.021474+0000","last_undegraded":"2024-03-20T13:38:11.021474+0000","last_fullsized":"2024-03-20T13:38:11.021474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:59:50.691433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361696+0000","last_change":"2024-03-20T13:36:38.833120+0000","last_active":"2024-03-20T13:38:05.361696+0000","last_peered":"2024-03-20T13:38:05.361696+0000","last_clean":"2024-03-20T13:38:05.361696+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:05.361696+0000","last_undegraded":"2024-03-20T13:38:05.361696+0000","last_fullsized":"2024-03-20T13:38:05.361696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350014+0000","last_change":"2024-03-20T13:36:36.847955+0000","last_active":"2024-03-20T13:37:17.350014+0000","last_peered":"2024-03-20T13:37:17.350014+0000","last_clean":"2024-03-20T13:37:17.350014+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:37:17.350014+0000","last_undegraded":"2024-03-20T13:37:17.350014+0000","last_fullsized":"2024-03-20T13:37:17.350014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358800+0000","last_change":"2024-03-20T13:36:40.850195+0000","last_active":"2024-03-20T13:37:17.358800+0000","last_peered":"2024-03-20T13:37:17.358800+0000","last_clean":"2024-03-20T13:37:17.358800+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:37:17.358800+0000","last_undegraded":"2024-03-20T13:37:17.358800+0000","last_fullsized":"2024-03-20T13:37:17.358800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.321997+0000","last_change":"2024-03-20T13:36:42.847305+0000","last_active":"2024-03-20T13:38:05.321997+0000","last_peered":"2024-03-20T13:38:05.321997+0000","last_clean":"2024-03-20T13:38:05.321997+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:05.321997+0000","last_undegraded":"2024-03-20T13:38:05.321997+0000","last_fullsized":"2024-03-20T13:38:05.321997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351069+0000","last_change":"2024-03-20T13:36:44.870120+0000","last_active":"2024-03-20T13:37:17.351069+0000","last_peered":"2024-03-20T13:37:17.351069+0000","last_clean":"2024-03-20T13:37:17.351069+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:37:17.351069+0000","last_undegraded":"2024-03-20T13:37:17.351069+0000","last_fullsized":"2024-03-20T13:37:17.351069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:00.348882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.510685+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:37:59.510685+0000","last_peered":"2024-03-20T13:37:59.510685+0000","last_clean":"2024-03-20T13:37:59.510685+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:37:59.510685+0000","last_undegraded":"2024-03-20T13:37:59.510685+0000","last_fullsized":"2024-03-20T13:37:59.510685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099067+0000","last_change":"2024-03-20T13:36:38.822857+0000","last_active":"2024-03-20T13:37:22.099067+0000","last_peered":"2024-03-20T13:37:22.099067+0000","last_clean":"2024-03-20T13:37:22.099067+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:37:22.099067+0000","last_undegraded":"2024-03-20T13:37:22.099067+0000","last_fullsized":"2024-03-20T13:37:22.099067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337639+0000","last_change":"2024-03-20T13:36:36.815979+0000","last_active":"2024-03-20T13:37:17.337639+0000","last_peered":"2024-03-20T13:37:17.337639+0000","last_clean":"2024-03-20T13:37:17.337639+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:37:17.337639+0000","last_undegraded":"2024-03-20T13:37:17.337639+0000","last_fullsized":"2024-03-20T13:37:17.337639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:15:50.640696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351375+0000","last_change":"2024-03-20T13:36:40.852967+0000","last_active":"2024-03-20T13:37:17.351375+0000","last_peered":"2024-03-20T13:37:17.351375+0000","last_clean":"2024-03-20T13:37:17.351375+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:37:17.351375+0000","last_undegraded":"2024-03-20T13:37:17.351375+0000","last_fullsized":"2024-03-20T13:37:17.351375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:13:55.770914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358636+0000","last_change":"2024-03-20T13:36:42.851506+0000","last_active":"2024-03-20T13:37:17.358636+0000","last_peered":"2024-03-20T13:37:17.358636+0000","last_clean":"2024-03-20T13:37:17.358636+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:37:17.358636+0000","last_undegraded":"2024-03-20T13:37:17.358636+0000","last_fullsized":"2024-03-20T13:37:17.358636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:47:54.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352979+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:37:17.352979+0000","last_peered":"2024-03-20T13:37:17.352979+0000","last_clean":"2024-03-20T13:37:17.352979+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:37:17.352979+0000","last_undegraded":"2024-03-20T13:37:17.352979+0000","last_fullsized":"2024-03-20T13:37:17.352979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:55:33.559340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355634+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:37:17.355634+0000","last_peered":"2024-03-20T13:37:17.355634+0000","last_clean":"2024-03-20T13:37:17.355634+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:37:17.355634+0000","last_undegraded":"2024-03-20T13:37:17.355634+0000","last_fullsized":"2024-03-20T13:37:17.355634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:19.393599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038369+0000","last_change":"2024-03-20T13:37:17.351202+0000","last_active":"2024-03-20T13:38:11.038369+0000","last_peered":"2024-03-20T13:38:11.038369+0000","last_clean":"2024-03-20T13:38:11.038369+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:38:11.038369+0000","last_undegraded":"2024-03-20T13:38:11.038369+0000","last_fullsized":"2024-03-20T13:38:11.038369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:50.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347515+0000","last_change":"2024-03-20T13:36:36.825659+0000","last_active":"2024-03-20T13:37:17.347515+0000","last_peered":"2024-03-20T13:37:17.347515+0000","last_clean":"2024-03-20T13:37:17.347515+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:37:17.347515+0000","last_undegraded":"2024-03-20T13:37:17.347515+0000","last_fullsized":"2024-03-20T13:37:17.347515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359882+0000","last_change":"2024-03-20T13:36:40.850731+0000","last_active":"2024-03-20T13:37:17.359882+0000","last_peered":"2024-03-20T13:37:17.359882+0000","last_clean":"2024-03-20T13:37:17.359882+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:37:17.359882+0000","last_undegraded":"2024-03-20T13:37:17.359882+0000","last_fullsized":"2024-03-20T13:37:17.359882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:23:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338522+0000","last_change":"2024-03-20T13:36:42.855730+0000","last_active":"2024-03-20T13:37:17.338522+0000","last_peered":"2024-03-20T13:37:17.338522+0000","last_clean":"2024-03-20T13:37:17.338522+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:37:17.338522+0000","last_undegraded":"2024-03-20T13:37:17.338522+0000","last_fullsized":"2024-03-20T13:37:17.338522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:03:28.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'240","reported_seq":305,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.269990+0000","last_change":"2024-03-20T13:36:44.878389+0000","last_active":"2024-03-20T13:38:11.269990+0000","last_peered":"2024-03-20T13:38:11.269990+0000","last_clean":"2024-03-20T13:38:11.269990+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:38:11.269990+0000","last_undegraded":"2024-03-20T13:38:11.269990+0000","last_fullsized":"2024-03-20T13:38:11.269990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:53.957445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335764+0000","last_change":"2024-03-20T13:36:46.888952+0000","last_active":"2024-03-20T13:37:17.335764+0000","last_peered":"2024-03-20T13:37:17.335764+0000","last_clean":"2024-03-20T13:37:17.335764+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:37:17.335764+0000","last_undegraded":"2024-03-20T13:37:17.335764+0000","last_fullsized":"2024-03-20T13:37:17.335764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:04:07.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.804073+0000","last_change":"2024-03-20T13:36:38.835366+0000","last_active":"2024-03-20T13:37:22.804073+0000","last_peered":"2024-03-20T13:37:22.804073+0000","last_clean":"2024-03-20T13:37:22.804073+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:37:22.804073+0000","last_undegraded":"2024-03-20T13:37:22.804073+0000","last_fullsized":"2024-03-20T13:37:22.804073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347002+0000","last_change":"2024-03-20T13:36:36.838074+0000","last_active":"2024-03-20T13:37:17.347002+0000","last_peered":"2024-03-20T13:37:17.347002+0000","last_clean":"2024-03-20T13:37:17.347002+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:37:17.347002+0000","last_undegraded":"2024-03-20T13:37:17.347002+0000","last_fullsized":"2024-03-20T13:37:17.347002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356582+0000","last_change":"2024-03-20T13:36:40.859660+0000","last_active":"2024-03-20T13:37:17.356582+0000","last_peered":"2024-03-20T13:37:17.356582+0000","last_clean":"2024-03-20T13:37:17.356582+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:37:17.356582+0000","last_undegraded":"2024-03-20T13:37:17.356582+0000","last_fullsized":"2024-03-20T13:37:17.356582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:53.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.314066+0000","last_change":"2024-03-20T13:36:42.860645+0000","last_active":"2024-03-20T13:38:05.314066+0000","last_peered":"2024-03-20T13:38:05.314066+0000","last_clean":"2024-03-20T13:38:05.314066+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:05.314066+0000","last_undegraded":"2024-03-20T13:38:05.314066+0000","last_fullsized":"2024-03-20T13:38:05.314066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:31:48.342447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'240","reported_seq":319,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.275024+0000","last_change":"2024-03-20T13:36:44.897812+0000","last_active":"2024-03-20T13:38:11.275024+0000","last_peered":"2024-03-20T13:38:11.275024+0000","last_clean":"2024-03-20T13:38:11.275024+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:11.275024+0000","last_undegraded":"2024-03-20T13:38:11.275024+0000","last_fullsized":"2024-03-20T13:38:11.275024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:31.390443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357541+0000","last_change":"2024-03-20T13:37:17.356166+0000","last_active":"2024-03-20T13:37:17.357541+0000","last_peered":"2024-03-20T13:37:17.357541+0000","last_clean":"2024-03-20T13:37:17.357541+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:37:17.357541+0000","last_undegraded":"2024-03-20T13:37:17.357541+0000","last_fullsized":"2024-03-20T13:37:17.357541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:05.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353407+0000","last_change":"2024-03-20T13:36:36.834443+0000","last_active":"2024-03-20T13:37:17.353407+0000","last_peered":"2024-03-20T13:37:17.353407+0000","last_clean":"2024-03-20T13:37:17.353407+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:37:17.353407+0000","last_undegraded":"2024-03-20T13:37:17.353407+0000","last_fullsized":"2024-03-20T13:37:17.353407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:29:03.754269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344058+0000","last_change":"2024-03-20T13:36:40.857714+0000","last_active":"2024-03-20T13:37:17.344058+0000","last_peered":"2024-03-20T13:37:17.344058+0000","last_clean":"2024-03-20T13:37:17.344058+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:37:17.344058+0000","last_undegraded":"2024-03-20T13:37:17.344058+0000","last_fullsized":"2024-03-20T13:37:17.344058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:24:44.271212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.331094+0000","last_change":"2024-03-20T13:36:42.873431+0000","last_active":"2024-03-20T13:38:05.331094+0000","last_peered":"2024-03-20T13:38:05.331094+0000","last_clean":"2024-03-20T13:38:05.331094+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:05.331094+0000","last_undegraded":"2024-03-20T13:38:05.331094+0000","last_fullsized":"2024-03-20T13:38:05.331094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:08:30.363113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":54,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349777+0000","last_change":"2024-03-20T13:36:44.866647+0000","last_active":"2024-03-20T13:37:17.349777+0000","last_peered":"2024-03-20T13:37:17.349777+0000","last_clean":"2024-03-20T13:37:17.349777+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:37:17.349777+0000","last_undegraded":"2024-03-20T13:37:17.349777+0000","last_fullsized":"2024-03-20T13:37:17.349777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:19.236268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.105778+0000","last_change":"2024-03-20T13:36:46.889608+0000","last_active":"2024-03-20T13:38:05.105778+0000","last_peered":"2024-03-20T13:38:05.105778+0000","last_clean":"2024-03-20T13:38:05.105778+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:05.105778+0000","last_undegraded":"2024-03-20T13:38:05.105778+0000","last_fullsized":"2024-03-20T13:38:05.105778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:14.771685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345198+0000","last_change":"2024-03-20T13:36:38.831983+0000","last_active":"2024-03-20T13:37:17.345198+0000","last_peered":"2024-03-20T13:37:17.345198+0000","last_clean":"2024-03-20T13:37:17.345198+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:37:17.345198+0000","last_undegraded":"2024-03-20T13:37:17.345198+0000","last_fullsized":"2024-03-20T13:37:17.345198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:57:18.786192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353826+0000","last_change":"2024-03-20T13:36:36.839624+0000","last_active":"2024-03-20T13:37:17.353826+0000","last_peered":"2024-03-20T13:37:17.353826+0000","last_clean":"2024-03-20T13:37:17.353826+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:37:17.353826+0000","last_undegraded":"2024-03-20T13:37:17.353826+0000","last_fullsized":"2024-03-20T13:37:17.353826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:14:30.338597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336329+0000","last_change":"2024-03-20T13:36:40.856999+0000","last_active":"2024-03-20T13:37:17.336329+0000","last_peered":"2024-03-20T13:37:17.336329+0000","last_clean":"2024-03-20T13:37:17.336329+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:37:17.336329+0000","last_undegraded":"2024-03-20T13:37:17.336329+0000","last_fullsized":"2024-03-20T13:37:17.336329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:58.874311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.296019+0000","last_change":"2024-03-20T13:36:42.844797+0000","last_active":"2024-03-20T13:38:05.296019+0000","last_peered":"2024-03-20T13:38:05.296019+0000","last_clean":"2024-03-20T13:38:05.296019+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:05.296019+0000","last_undegraded":"2024-03-20T13:38:05.296019+0000","last_fullsized":"2024-03-20T13:38:05.296019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:15:52.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356072+0000","last_change":"2024-03-20T13:36:44.888691+0000","last_active":"2024-03-20T13:37:17.356072+0000","last_peered":"2024-03-20T13:37:17.356072+0000","last_clean":"2024-03-20T13:37:17.356072+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:37:17.356072+0000","last_undegraded":"2024-03-20T13:37:17.356072+0000","last_fullsized":"2024-03-20T13:37:17.356072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:29.837819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.378145+0000","last_change":"2024-03-20T13:36:46.873147+0000","last_active":"2024-03-20T13:37:59.378145+0000","last_peered":"2024-03-20T13:37:59.378145+0000","last_clean":"2024-03-20T13:37:59.378145+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:37:59.378145+0000","last_undegraded":"2024-03-20T13:37:59.378145+0000","last_fullsized":"2024-03-20T13:37:59.378145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:16.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350555+0000","last_change":"2024-03-20T13:36:38.827772+0000","last_active":"2024-03-20T13:37:17.350555+0000","last_peered":"2024-03-20T13:37:17.350555+0000","last_clean":"2024-03-20T13:37:17.350555+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:37:17.350555+0000","last_undegraded":"2024-03-20T13:37:17.350555+0000","last_fullsized":"2024-03-20T13:37:17.350555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354432+0000","last_change":"2024-03-20T13:36:36.826408+0000","last_active":"2024-03-20T13:37:17.354432+0000","last_peered":"2024-03-20T13:37:17.354432+0000","last_clean":"2024-03-20T13:37:17.354432+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:37:17.354432+0000","last_undegraded":"2024-03-20T13:37:17.354432+0000","last_fullsized":"2024-03-20T13:37:17.354432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:21.851320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338772+0000","last_change":"2024-03-20T13:36:40.846177+0000","last_active":"2024-03-20T13:37:17.338772+0000","last_peered":"2024-03-20T13:37:17.338772+0000","last_clean":"2024-03-20T13:37:17.338772+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:37:17.338772+0000","last_undegraded":"2024-03-20T13:37:17.338772+0000","last_fullsized":"2024-03-20T13:37:17.338772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:09.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.334061+0000","last_change":"2024-03-20T13:36:42.841973+0000","last_active":"2024-03-20T13:38:05.334061+0000","last_peered":"2024-03-20T13:38:05.334061+0000","last_clean":"2024-03-20T13:38:05.334061+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:05.334061+0000","last_undegraded":"2024-03-20T13:38:05.334061+0000","last_fullsized":"2024-03-20T13:38:05.334061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'240","reported_seq":284,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.276315+0000","last_change":"2024-03-20T13:36:44.881852+0000","last_active":"2024-03-20T13:38:11.276315+0000","last_peered":"2024-03-20T13:38:11.276315+0000","last_clean":"2024-03-20T13:38:11.276315+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:11.276315+0000","last_undegraded":"2024-03-20T13:38:11.276315+0000","last_fullsized":"2024-03-20T13:38:11.276315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:56.157507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351002+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:37:17.351002+0000","last_peered":"2024-03-20T13:37:17.351002+0000","last_clean":"2024-03-20T13:37:17.351002+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:37:17.351002+0000","last_undegraded":"2024-03-20T13:37:17.351002+0000","last_fullsized":"2024-03-20T13:37:17.351002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:18.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361689+0000","last_change":"2024-03-20T13:36:38.840955+0000","last_active":"2024-03-20T13:38:05.361689+0000","last_peered":"2024-03-20T13:38:05.361689+0000","last_clean":"2024-03-20T13:38:05.361689+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:05.361689+0000","last_undegraded":"2024-03-20T13:38:05.361689+0000","last_fullsized":"2024-03-20T13:38:05.361689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:33.249228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350421+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:37:17.350421+0000","last_peered":"2024-03-20T13:37:17.350421+0000","last_clean":"2024-03-20T13:37:17.350421+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:37:17.350421+0000","last_undegraded":"2024-03-20T13:37:17.350421+0000","last_fullsized":"2024-03-20T13:37:17.350421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343195+0000","last_change":"2024-03-20T13:36:40.845768+0000","last_active":"2024-03-20T13:37:17.343195+0000","last_peered":"2024-03-20T13:37:17.343195+0000","last_clean":"2024-03-20T13:37:17.343195+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:37:17.343195+0000","last_undegraded":"2024-03-20T13:37:17.343195+0000","last_fullsized":"2024-03-20T13:37:17.343195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:33:29.320718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'50","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.961328+0000","last_change":"2024-03-20T13:36:42.869009+0000","last_active":"2024-03-20T13:38:10.961328+0000","last_peered":"2024-03-20T13:38:10.961328+0000","last_clean":"2024-03-20T13:38:10.961328+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:10.961328+0000","last_undegraded":"2024-03-20T13:38:10.961328+0000","last_fullsized":"2024-03-20T13:38:10.961328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:14.441521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335490+0000","last_change":"2024-03-20T13:36:44.867134+0000","last_active":"2024-03-20T13:37:17.335490+0000","last_peered":"2024-03-20T13:37:17.335490+0000","last_clean":"2024-03-20T13:37:17.335490+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:37:17.335490+0000","last_undegraded":"2024-03-20T13:37:17.335490+0000","last_fullsized":"2024-03-20T13:37:17.335490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:26.218996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:46.886740+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:16.012802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361855+0000","last_change":"2024-03-20T13:36:38.832987+0000","last_active":"2024-03-20T13:38:05.361855+0000","last_peered":"2024-03-20T13:38:05.361855+0000","last_clean":"2024-03-20T13:38:05.361855+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:38:05.361855+0000","last_undegraded":"2024-03-20T13:38:05.361855+0000","last_fullsized":"2024-03-20T13:38:05.361855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:53:17.091959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.064409+0000","last_change":"2024-03-20T13:36:36.846257+0000","last_active":"2024-03-20T13:37:22.064409+0000","last_peered":"2024-03-20T13:37:22.064409+0000","last_clean":"2024-03-20T13:37:22.064409+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:37:22.064409+0000","last_undegraded":"2024-03-20T13:37:22.064409+0000","last_fullsized":"2024-03-20T13:37:22.064409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343865+0000","last_change":"2024-03-20T13:36:40.839225+0000","last_active":"2024-03-20T13:37:17.343865+0000","last_peered":"2024-03-20T13:37:17.343865+0000","last_clean":"2024-03-20T13:37:17.343865+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:37:17.343865+0000","last_undegraded":"2024-03-20T13:37:17.343865+0000","last_fullsized":"2024-03-20T13:37:17.343865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:25.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.304039+0000","last_change":"2024-03-20T13:36:42.876207+0000","last_active":"2024-03-20T13:38:05.304039+0000","last_peered":"2024-03-20T13:38:05.304039+0000","last_clean":"2024-03-20T13:38:05.304039+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:05.304039+0000","last_undegraded":"2024-03-20T13:38:05.304039+0000","last_fullsized":"2024-03-20T13:38:05.304039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:23.373578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360601+0000","last_change":"2024-03-20T13:36:44.899145+0000","last_active":"2024-03-20T13:37:17.360601+0000","last_peered":"2024-03-20T13:37:17.360601+0000","last_clean":"2024-03-20T13:37:17.360601+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:37:17.360601+0000","last_undegraded":"2024-03-20T13:37:17.360601+0000","last_fullsized":"2024-03-20T13:37:17.360601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338015+0000","last_change":"2024-03-20T13:36:46.875764+0000","last_active":"2024-03-20T13:37:17.338015+0000","last_peered":"2024-03-20T13:37:17.338015+0000","last_clean":"2024-03-20T13:37:17.338015+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:37:17.338015+0000","last_undegraded":"2024-03-20T13:37:17.338015+0000","last_fullsized":"2024-03-20T13:37:17.338015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:43.408023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356084+0000","last_change":"2024-03-20T13:36:38.831920+0000","last_active":"2024-03-20T13:37:17.356084+0000","last_peered":"2024-03-20T13:37:17.356084+0000","last_clean":"2024-03-20T13:37:17.356084+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:37:17.356084+0000","last_undegraded":"2024-03-20T13:37:17.356084+0000","last_fullsized":"2024-03-20T13:37:17.356084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.081235+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:37:22.081235+0000","last_peered":"2024-03-20T13:37:22.081235+0000","last_clean":"2024-03-20T13:37:22.081235+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:37:22.081235+0000","last_undegraded":"2024-03-20T13:37:22.081235+0000","last_fullsized":"2024-03-20T13:37:22.081235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350463+0000","last_change":"2024-03-20T13:36:40.847551+0000","last_active":"2024-03-20T13:37:17.350463+0000","last_peered":"2024-03-20T13:37:17.350463+0000","last_clean":"2024-03-20T13:37:17.350463+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:37:17.350463+0000","last_undegraded":"2024-03-20T13:37:17.350463+0000","last_fullsized":"2024-03-20T13:37:17.350463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:03:22.247918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.345847+0000","last_change":"2024-03-20T13:36:42.845589+0000","last_active":"2024-03-20T13:38:05.345847+0000","last_peered":"2024-03-20T13:38:05.345847+0000","last_clean":"2024-03-20T13:38:05.345847+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:05.345847+0000","last_undegraded":"2024-03-20T13:38:05.345847+0000","last_fullsized":"2024-03-20T13:38:05.345847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:56.555692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'240","reported_seq":321,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.270399+0000","last_change":"2024-03-20T13:36:44.879458+0000","last_active":"2024-03-20T13:38:11.270399+0000","last_peered":"2024-03-20T13:38:11.270399+0000","last_clean":"2024-03-20T13:38:11.270399+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:11.270399+0000","last_undegraded":"2024-03-20T13:38:11.270399+0000","last_fullsized":"2024-03-20T13:38:11.270399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:14.860829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.376315+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:05.376315+0000","last_peered":"2024-03-20T13:38:05.376315+0000","last_clean":"2024-03-20T13:38:05.376315+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:05.376315+0000","last_undegraded":"2024-03-20T13:38:05.376315+0000","last_fullsized":"2024-03-20T13:38:05.376315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:30.005016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345914+0000","last_change":"2024-03-20T13:36:38.825748+0000","last_active":"2024-03-20T13:37:17.345914+0000","last_peered":"2024-03-20T13:37:17.345914+0000","last_clean":"2024-03-20T13:37:17.345914+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:37:17.345914+0000","last_undegraded":"2024-03-20T13:37:17.345914+0000","last_fullsized":"2024-03-20T13:37:17.345914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:17.486304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.565297+0000","last_change":"2024-03-20T13:36:36.846954+0000","last_active":"2024-03-20T13:38:04.565297+0000","last_peered":"2024-03-20T13:38:04.565297+0000","last_clean":"2024-03-20T13:38:04.565297+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:38:04.565297+0000","last_undegraded":"2024-03-20T13:38:04.565297+0000","last_fullsized":"2024-03-20T13:38:04.565297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":359,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.187801+0000","last_change":"2024-03-20T13:36:40.855511+0000","last_active":"2024-03-20T13:38:12.187801+0000","last_peered":"2024-03-20T13:38:12.187801+0000","last_clean":"2024-03-20T13:38:12.187801+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:12.187801+0000","last_undegraded":"2024-03-20T13:38:12.187801+0000","last_fullsized":"2024-03-20T13:38:12.187801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:36:09.090540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348292+0000","last_change":"2024-03-20T13:36:42.844667+0000","last_active":"2024-03-20T13:37:17.348292+0000","last_peered":"2024-03-20T13:37:17.348292+0000","last_clean":"2024-03-20T13:37:17.348292+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:37:17.348292+0000","last_undegraded":"2024-03-20T13:37:17.348292+0000","last_fullsized":"2024-03-20T13:37:17.348292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:57.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'240","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.273196+0000","last_change":"2024-03-20T13:36:44.878660+0000","last_active":"2024-03-20T13:38:11.273196+0000","last_peered":"2024-03-20T13:38:11.273196+0000","last_clean":"2024-03-20T13:38:11.273196+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:38:11.273196+0000","last_undegraded":"2024-03-20T13:38:11.273196+0000","last_fullsized":"2024-03-20T13:38:11.273196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:17.394132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335236+0000","last_change":"2024-03-20T13:36:46.894365+0000","last_active":"2024-03-20T13:37:17.335236+0000","last_peered":"2024-03-20T13:37:17.335236+0000","last_clean":"2024-03-20T13:37:17.335236+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:37:17.335236+0000","last_undegraded":"2024-03-20T13:37:17.335236+0000","last_fullsized":"2024-03-20T13:37:17.335236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:16:31.162761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362064+0000","last_change":"2024-03-20T13:36:38.827417+0000","last_active":"2024-03-20T13:38:05.362064+0000","last_peered":"2024-03-20T13:38:05.362064+0000","last_clean":"2024-03-20T13:38:05.362064+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:05.362064+0000","last_undegraded":"2024-03-20T13:38:05.362064+0000","last_fullsized":"2024-03-20T13:38:05.362064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:01.821428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340325+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:37:17.340325+0000","last_peered":"2024-03-20T13:37:17.340325+0000","last_clean":"2024-03-20T13:37:17.340325+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:37:17.340325+0000","last_undegraded":"2024-03-20T13:37:17.340325+0000","last_fullsized":"2024-03-20T13:37:17.340325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:34.568110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362408+0000","last_change":"2024-03-20T13:36:40.850087+0000","last_active":"2024-03-20T13:37:17.362408+0000","last_peered":"2024-03-20T13:37:17.362408+0000","last_clean":"2024-03-20T13:37:17.362408+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:37:17.362408+0000","last_undegraded":"2024-03-20T13:37:17.362408+0000","last_fullsized":"2024-03-20T13:37:17.362408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.325183+0000","last_change":"2024-03-20T13:36:42.876289+0000","last_active":"2024-03-20T13:38:05.325183+0000","last_peered":"2024-03-20T13:38:05.325183+0000","last_clean":"2024-03-20T13:38:05.325183+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:05.325183+0000","last_undegraded":"2024-03-20T13:38:05.325183+0000","last_fullsized":"2024-03-20T13:38:05.325183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:11.362564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356204+0000","last_change":"2024-03-20T13:36:44.871091+0000","last_active":"2024-03-20T13:37:17.356204+0000","last_peered":"2024-03-20T13:37:17.356204+0000","last_clean":"2024-03-20T13:37:17.356204+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:37:17.356204+0000","last_undegraded":"2024-03-20T13:37:17.356204+0000","last_fullsized":"2024-03-20T13:37:17.356204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:17.175441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347541+0000","last_change":"2024-03-20T13:36:46.872197+0000","last_active":"2024-03-20T13:37:17.347541+0000","last_peered":"2024-03-20T13:37:17.347541+0000","last_clean":"2024-03-20T13:37:17.347541+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:37:17.347541+0000","last_undegraded":"2024-03-20T13:37:17.347541+0000","last_fullsized":"2024-03-20T13:37:17.347541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:03:54.127026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354510+0000","last_change":"2024-03-20T13:36:38.845564+0000","last_active":"2024-03-20T13:37:17.354510+0000","last_peered":"2024-03-20T13:37:17.354510+0000","last_clean":"2024-03-20T13:37:17.354510+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:37:17.354510+0000","last_undegraded":"2024-03-20T13:37:17.354510+0000","last_fullsized":"2024-03-20T13:37:17.354510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":201,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341737+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:37:17.341737+0000","last_peered":"2024-03-20T13:37:17.341737+0000","last_clean":"2024-03-20T13:37:17.341737+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:37:17.341737+0000","last_undegraded":"2024-03-20T13:37:17.341737+0000","last_fullsized":"2024-03-20T13:37:17.341737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:11.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350038+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:37:17.350038+0000","last_peered":"2024-03-20T13:37:17.350038+0000","last_clean":"2024-03-20T13:37:17.350038+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:37:17.350038+0000","last_undegraded":"2024-03-20T13:37:17.350038+0000","last_fullsized":"2024-03-20T13:37:17.350038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:20.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356573+0000","last_change":"2024-03-20T13:36:36.849187+0000","last_active":"2024-03-20T13:37:17.356573+0000","last_peered":"2024-03-20T13:37:17.356573+0000","last_clean":"2024-03-20T13:37:17.356573+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:37:17.356573+0000","last_undegraded":"2024-03-20T13:37:17.356573+0000","last_fullsized":"2024-03-20T13:37:17.356573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350872+0000","last_change":"2024-03-20T13:36:40.848822+0000","last_active":"2024-03-20T13:37:17.350872+0000","last_peered":"2024-03-20T13:37:17.350872+0000","last_clean":"2024-03-20T13:37:17.350872+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:37:17.350872+0000","last_undegraded":"2024-03-20T13:37:17.350872+0000","last_fullsized":"2024-03-20T13:37:17.350872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:47.518308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'70","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.995929+0000","last_change":"2024-03-20T13:36:42.846779+0000","last_active":"2024-03-20T13:38:10.995929+0000","last_peered":"2024-03-20T13:38:10.995929+0000","last_clean":"2024-03-20T13:38:10.995929+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:10.995929+0000","last_undegraded":"2024-03-20T13:38:10.995929+0000","last_fullsized":"2024-03-20T13:38:10.995929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:25.956347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360479+0000","last_change":"2024-03-20T13:36:44.899269+0000","last_active":"2024-03-20T13:37:17.360479+0000","last_peered":"2024-03-20T13:37:17.360479+0000","last_clean":"2024-03-20T13:37:17.360479+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:37:17.360479+0000","last_undegraded":"2024-03-20T13:37:17.360479+0000","last_fullsized":"2024-03-20T13:37:17.360479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'51","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.055469+0000","last_change":"2024-03-20T13:36:46.893348+0000","last_active":"2024-03-20T13:38:11.055469+0000","last_peered":"2024-03-20T13:38:11.055469+0000","last_clean":"2024-03-20T13:38:11.055469+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:38:11.055469+0000","last_undegraded":"2024-03-20T13:38:11.055469+0000","last_fullsized":"2024-03-20T13:38:11.055469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:20.181051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.803949+0000","last_change":"2024-03-20T13:36:38.835115+0000","last_active":"2024-03-20T13:37:22.803949+0000","last_peered":"2024-03-20T13:37:22.803949+0000","last_clean":"2024-03-20T13:37:22.803949+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:37:22.803949+0000","last_undegraded":"2024-03-20T13:37:22.803949+0000","last_fullsized":"2024-03-20T13:37:22.803949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348446+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:37:17.348446+0000","last_peered":"2024-03-20T13:37:17.348446+0000","last_clean":"2024-03-20T13:37:17.348446+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:37:17.348446+0000","last_undegraded":"2024-03-20T13:37:17.348446+0000","last_fullsized":"2024-03-20T13:37:17.348446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:03.493778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344968+0000","last_change":"2024-03-20T13:36:36.833258+0000","last_active":"2024-03-20T13:37:17.344968+0000","last_peered":"2024-03-20T13:37:17.344968+0000","last_clean":"2024-03-20T13:37:17.344968+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:37:17.344968+0000","last_undegraded":"2024-03-20T13:37:17.344968+0000","last_fullsized":"2024-03-20T13:37:17.344968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:55.537677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356009+0000","last_change":"2024-03-20T13:36:40.850671+0000","last_active":"2024-03-20T13:37:17.356009+0000","last_peered":"2024-03-20T13:37:17.356009+0000","last_clean":"2024-03-20T13:37:17.356009+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:37:17.356009+0000","last_undegraded":"2024-03-20T13:37:17.356009+0000","last_fullsized":"2024-03-20T13:37:17.356009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:49:00.124639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'239","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.263813+0000","last_change":"2024-03-20T13:36:42.863211+0000","last_active":"2024-03-20T13:38:11.263813+0000","last_peered":"2024-03-20T13:38:11.263813+0000","last_clean":"2024-03-20T13:38:11.263813+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:11.263813+0000","last_undegraded":"2024-03-20T13:38:11.263813+0000","last_fullsized":"2024-03-20T13:38:11.263813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:58.451631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351365+0000","last_change":"2024-03-20T13:36:44.897832+0000","last_active":"2024-03-20T13:37:17.351365+0000","last_peered":"2024-03-20T13:37:17.351365+0000","last_clean":"2024-03-20T13:37:17.351365+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:37:17.351365+0000","last_undegraded":"2024-03-20T13:37:17.351365+0000","last_fullsized":"2024-03-20T13:37:17.351365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:52:08.639163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.523020+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:37:59.523020+0000","last_peered":"2024-03-20T13:37:59.523020+0000","last_clean":"2024-03-20T13:37:59.523020+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:37:59.523020+0000","last_undegraded":"2024-03-20T13:37:59.523020+0000","last_fullsized":"2024-03-20T13:37:59.523020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:46.638563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362220+0000","last_change":"2024-03-20T13:36:38.832205+0000","last_active":"2024-03-20T13:38:05.362220+0000","last_peered":"2024-03-20T13:38:05.362220+0000","last_clean":"2024-03-20T13:38:05.362220+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:38:05.362220+0000","last_undegraded":"2024-03-20T13:38:05.362220+0000","last_fullsized":"2024-03-20T13:38:05.362220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:00.408558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334481+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:37:17.334481+0000","last_peered":"2024-03-20T13:37:17.334481+0000","last_clean":"2024-03-20T13:37:17.334481+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.334481+0000","last_undegraded":"2024-03-20T13:37:17.334481+0000","last_fullsized":"2024-03-20T13:37:17.334481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342328+0000","last_change":"2024-03-20T13:36:36.836293+0000","last_active":"2024-03-20T13:37:17.342328+0000","last_peered":"2024-03-20T13:37:17.342328+0000","last_clean":"2024-03-20T13:37:17.342328+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:37:17.342328+0000","last_undegraded":"2024-03-20T13:37:17.342328+0000","last_fullsized":"2024-03-20T13:37:17.342328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:33.995435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349061+0000","last_change":"2024-03-20T13:36:40.842771+0000","last_active":"2024-03-20T13:37:17.349061+0000","last_peered":"2024-03-20T13:37:17.349061+0000","last_clean":"2024-03-20T13:37:17.349061+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:37:17.349061+0000","last_undegraded":"2024-03-20T13:37:17.349061+0000","last_fullsized":"2024-03-20T13:37:17.349061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:42:22.678474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.996348+0000","last_change":"2024-03-20T13:36:42.842816+0000","last_active":"2024-03-20T13:38:10.996348+0000","last_peered":"2024-03-20T13:38:10.996348+0000","last_clean":"2024-03-20T13:38:10.996348+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:10.996348+0000","last_undegraded":"2024-03-20T13:38:10.996348+0000","last_fullsized":"2024-03-20T13:38:10.996348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:03.696208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352701+0000","last_change":"2024-03-20T13:36:44.872161+0000","last_active":"2024-03-20T13:37:17.352701+0000","last_peered":"2024-03-20T13:37:17.352701+0000","last_clean":"2024-03-20T13:37:17.352701+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:37:17.352701+0000","last_undegraded":"2024-03-20T13:37:17.352701+0000","last_fullsized":"2024-03-20T13:37:17.352701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:39.436728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347395+0000","last_change":"2024-03-20T13:36:46.874361+0000","last_active":"2024-03-20T13:37:17.347395+0000","last_peered":"2024-03-20T13:37:17.347395+0000","last_clean":"2024-03-20T13:37:17.347395+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:37:17.347395+0000","last_undegraded":"2024-03-20T13:37:17.347395+0000","last_fullsized":"2024-03-20T13:37:17.347395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048631+0000","last_change":"2024-03-20T13:36:38.839568+0000","last_active":"2024-03-20T13:38:11.048631+0000","last_peered":"2024-03-20T13:38:11.048631+0000","last_clean":"2024-03-20T13:38:11.048631+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:11.048631+0000","last_undegraded":"2024-03-20T13:38:11.048631+0000","last_fullsized":"2024-03-20T13:38:11.048631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:16.107824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348452+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:37:17.348452+0000","last_peered":"2024-03-20T13:37:17.348452+0000","last_clean":"2024-03-20T13:37:17.348452+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:37:17.348452+0000","last_undegraded":"2024-03-20T13:37:17.348452+0000","last_fullsized":"2024-03-20T13:37:17.348452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:49:35.289474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350154+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:37:17.350154+0000","last_peered":"2024-03-20T13:37:17.350154+0000","last_clean":"2024-03-20T13:37:17.350154+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:37:17.350154+0000","last_undegraded":"2024-03-20T13:37:17.350154+0000","last_fullsized":"2024-03-20T13:37:17.350154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353282+0000","last_change":"2024-03-20T13:36:40.846094+0000","last_active":"2024-03-20T13:37:17.353282+0000","last_peered":"2024-03-20T13:37:17.353282+0000","last_clean":"2024-03-20T13:37:17.353282+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:37:17.353282+0000","last_undegraded":"2024-03-20T13:37:17.353282+0000","last_fullsized":"2024-03-20T13:37:17.353282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:25:10.138463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.375043+0000","last_change":"2024-03-20T13:36:42.847334+0000","last_active":"2024-03-20T13:38:05.375043+0000","last_peered":"2024-03-20T13:38:05.375043+0000","last_clean":"2024-03-20T13:38:05.375043+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:05.375043+0000","last_undegraded":"2024-03-20T13:38:05.375043+0000","last_fullsized":"2024-03-20T13:38:05.375043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361433+0000","last_change":"2024-03-20T13:36:44.900807+0000","last_active":"2024-03-20T13:37:17.361433+0000","last_peered":"2024-03-20T13:37:17.361433+0000","last_clean":"2024-03-20T13:37:17.361433+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:37:17.361433+0000","last_undegraded":"2024-03-20T13:37:17.361433+0000","last_fullsized":"2024-03-20T13:37:17.361433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341228+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:37:17.341228+0000","last_peered":"2024-03-20T13:37:17.341228+0000","last_clean":"2024-03-20T13:37:17.341228+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:37:17.341228+0000","last_undegraded":"2024-03-20T13:37:17.341228+0000","last_fullsized":"2024-03-20T13:37:17.341228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:47.541449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559479+0000","last_change":"2024-03-20T13:36:38.835114+0000","last_active":"2024-03-20T13:38:04.559479+0000","last_peered":"2024-03-20T13:38:04.559479+0000","last_clean":"2024-03-20T13:38:04.559479+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:38:04.559479+0000","last_undegraded":"2024-03-20T13:38:04.559479+0000","last_fullsized":"2024-03-20T13:38:04.559479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:02.712312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356076+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:37:17.356076+0000","last_peered":"2024-03-20T13:37:17.356076+0000","last_clean":"2024-03-20T13:37:17.356076+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:37:17.356076+0000","last_undegraded":"2024-03-20T13:37:17.356076+0000","last_fullsized":"2024-03-20T13:37:17.356076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:36:17.674002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353028+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:37:17.353028+0000","last_peered":"2024-03-20T13:37:17.353028+0000","last_clean":"2024-03-20T13:37:17.353028+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.353028+0000","last_undegraded":"2024-03-20T13:37:17.353028+0000","last_fullsized":"2024-03-20T13:37:17.353028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:01:29.010451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337078+0000","last_change":"2024-03-20T13:36:40.847185+0000","last_active":"2024-03-20T13:37:17.337078+0000","last_peered":"2024-03-20T13:37:17.337078+0000","last_clean":"2024-03-20T13:37:17.337078+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:37:17.337078+0000","last_undegraded":"2024-03-20T13:37:17.337078+0000","last_fullsized":"2024-03-20T13:37:17.337078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:07:18.240810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'56","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.978774+0000","last_change":"2024-03-20T13:36:42.851741+0000","last_active":"2024-03-20T13:38:10.978774+0000","last_peered":"2024-03-20T13:38:10.978774+0000","last_clean":"2024-03-20T13:38:10.978774+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:10.978774+0000","last_undegraded":"2024-03-20T13:38:10.978774+0000","last_fullsized":"2024-03-20T13:38:10.978774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:54:44.968029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347209+0000","last_change":"2024-03-20T13:36:44.869776+0000","last_active":"2024-03-20T13:37:17.347209+0000","last_peered":"2024-03-20T13:37:17.347209+0000","last_clean":"2024-03-20T13:37:17.347209+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:37:17.347209+0000","last_undegraded":"2024-03-20T13:37:17.347209+0000","last_fullsized":"2024-03-20T13:37:17.347209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.347425+0000","last_change":"2024-03-20T13:36:46.889089+0000","last_active":"2024-03-20T13:38:05.347425+0000","last_peered":"2024-03-20T13:38:05.347425+0000","last_clean":"2024-03-20T13:38:05.347425+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:05.347425+0000","last_undegraded":"2024-03-20T13:38:05.347425+0000","last_fullsized":"2024-03-20T13:38:05.347425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:44.885863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.805147+0000","last_change":"2024-03-20T13:36:38.827949+0000","last_active":"2024-03-20T13:37:22.805147+0000","last_peered":"2024-03-20T13:37:22.805147+0000","last_clean":"2024-03-20T13:37:22.805147+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:37:22.805147+0000","last_undegraded":"2024-03-20T13:37:22.805147+0000","last_fullsized":"2024-03-20T13:37:22.805147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:06.009730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353286+0000","last_change":"2024-03-20T13:36:36.830990+0000","last_active":"2024-03-20T13:37:17.353286+0000","last_peered":"2024-03-20T13:37:17.353286+0000","last_clean":"2024-03-20T13:37:17.353286+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:37:17.353286+0000","last_undegraded":"2024-03-20T13:37:17.353286+0000","last_fullsized":"2024-03-20T13:37:17.353286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:34.861573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354027+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:37:17.354027+0000","last_peered":"2024-03-20T13:37:17.354027+0000","last_clean":"2024-03-20T13:37:17.354027+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:37:17.354027+0000","last_undegraded":"2024-03-20T13:37:17.354027+0000","last_fullsized":"2024-03-20T13:37:17.354027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:05.095676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348014+0000","last_change":"2024-03-20T13:36:40.850909+0000","last_active":"2024-03-20T13:37:17.348014+0000","last_peered":"2024-03-20T13:37:17.348014+0000","last_clean":"2024-03-20T13:37:17.348014+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:37:17.348014+0000","last_undegraded":"2024-03-20T13:37:17.348014+0000","last_fullsized":"2024-03-20T13:37:17.348014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341928+0000","last_change":"2024-03-20T13:36:42.864332+0000","last_active":"2024-03-20T13:37:17.341928+0000","last_peered":"2024-03-20T13:37:17.341928+0000","last_clean":"2024-03-20T13:37:17.341928+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:37:17.341928+0000","last_undegraded":"2024-03-20T13:37:17.341928+0000","last_fullsized":"2024-03-20T13:37:17.341928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:16.666345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'240","reported_seq":318,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.267232+0000","last_change":"2024-03-20T13:36:44.872646+0000","last_active":"2024-03-20T13:38:11.267232+0000","last_peered":"2024-03-20T13:38:11.267232+0000","last_clean":"2024-03-20T13:38:11.267232+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:11.267232+0000","last_undegraded":"2024-03-20T13:38:11.267232+0000","last_fullsized":"2024-03-20T13:38:11.267232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:04.548860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358653+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:37:17.358653+0000","last_peered":"2024-03-20T13:37:17.358653+0000","last_clean":"2024-03-20T13:37:17.358653+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:37:17.358653+0000","last_undegraded":"2024-03-20T13:37:17.358653+0000","last_fullsized":"2024-03-20T13:37:17.358653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.098925+0000","last_change":"2024-03-20T13:36:38.813661+0000","last_active":"2024-03-20T13:37:22.098925+0000","last_peered":"2024-03-20T13:37:22.098925+0000","last_clean":"2024-03-20T13:37:22.098925+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:37:22.098925+0000","last_undegraded":"2024-03-20T13:37:22.098925+0000","last_fullsized":"2024-03-20T13:37:22.098925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362921+0000","last_change":"2024-03-20T13:36:36.847617+0000","last_active":"2024-03-20T13:37:17.362921+0000","last_peered":"2024-03-20T13:37:17.362921+0000","last_clean":"2024-03-20T13:37:17.362921+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:37:17.362921+0000","last_undegraded":"2024-03-20T13:37:17.362921+0000","last_fullsized":"2024-03-20T13:37:17.362921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360074+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:37:17.360074+0000","last_peered":"2024-03-20T13:37:17.360074+0000","last_clean":"2024-03-20T13:37:17.360074+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:37:17.360074+0000","last_undegraded":"2024-03-20T13:37:17.360074+0000","last_fullsized":"2024-03-20T13:37:17.360074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:06.931743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349095+0000","last_change":"2024-03-20T13:36:40.857874+0000","last_active":"2024-03-20T13:37:17.349095+0000","last_peered":"2024-03-20T13:37:17.349095+0000","last_clean":"2024-03-20T13:37:17.349095+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:37:17.349095+0000","last_undegraded":"2024-03-20T13:37:17.349095+0000","last_fullsized":"2024-03-20T13:37:17.349095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:18:26.064828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358074+0000","last_change":"2024-03-20T13:36:42.855371+0000","last_active":"2024-03-20T13:37:17.358074+0000","last_peered":"2024-03-20T13:37:17.358074+0000","last_clean":"2024-03-20T13:37:17.358074+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:37:17.358074+0000","last_undegraded":"2024-03-20T13:37:17.358074+0000","last_fullsized":"2024-03-20T13:37:17.358074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:58:21.419980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'240","reported_seq":316,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.273749+0000","last_change":"2024-03-20T13:36:44.894325+0000","last_active":"2024-03-20T13:38:11.273749+0000","last_peered":"2024-03-20T13:38:11.273749+0000","last_clean":"2024-03-20T13:38:11.273749+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:11.273749+0000","last_undegraded":"2024-03-20T13:38:11.273749+0000","last_fullsized":"2024-03-20T13:38:11.273749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:59.125889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.777950+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:37:21.777950+0000","last_peered":"2024-03-20T13:37:21.777950+0000","last_clean":"2024-03-20T13:37:21.777950+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:37:21.777950+0000","last_undegraded":"2024-03-20T13:37:21.777950+0000","last_fullsized":"2024-03-20T13:37:21.777950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:41.446025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099051+0000","last_change":"2024-03-20T13:36:38.825848+0000","last_active":"2024-03-20T13:37:22.099051+0000","last_peered":"2024-03-20T13:37:22.099051+0000","last_clean":"2024-03-20T13:37:22.099051+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:37:22.099051+0000","last_undegraded":"2024-03-20T13:37:22.099051+0000","last_fullsized":"2024-03-20T13:37:22.099051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:41.028184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358700+0000","last_change":"2024-03-20T13:36:36.831337+0000","last_active":"2024-03-20T13:37:17.358700+0000","last_peered":"2024-03-20T13:37:17.358700+0000","last_clean":"2024-03-20T13:37:17.358700+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:37:17.358700+0000","last_undegraded":"2024-03-20T13:37:17.358700+0000","last_fullsized":"2024-03-20T13:37:17.358700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:05.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353981+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:37:17.353981+0000","last_peered":"2024-03-20T13:37:17.353981+0000","last_clean":"2024-03-20T13:37:17.353981+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:37:17.353981+0000","last_undegraded":"2024-03-20T13:37:17.353981+0000","last_fullsized":"2024-03-20T13:37:17.353981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:22.659362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.366089+0000","last_change":"2024-03-20T13:37:17.366089+0000","last_active":"2024-03-20T13:37:17.366089+0000","last_peered":"2024-03-20T13:37:17.366089+0000","last_clean":"2024-03-20T13:37:17.366089+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:37:17.366089+0000","last_undegraded":"2024-03-20T13:37:17.366089+0000","last_fullsized":"2024-03-20T13:37:17.366089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:48.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'77","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.974362+0000","last_change":"2024-03-20T13:36:42.842883+0000","last_active":"2024-03-20T13:38:10.974362+0000","last_peered":"2024-03-20T13:38:10.974362+0000","last_clean":"2024-03-20T13:38:10.974362+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:10.974362+0000","last_undegraded":"2024-03-20T13:38:10.974362+0000","last_fullsized":"2024-03-20T13:38:10.974362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:47.727785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357474+0000","last_change":"2024-03-20T13:36:44.894727+0000","last_active":"2024-03-20T13:37:17.357474+0000","last_peered":"2024-03-20T13:37:17.357474+0000","last_clean":"2024-03-20T13:37:17.357474+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:37:17.357474+0000","last_undegraded":"2024-03-20T13:37:17.357474+0000","last_fullsized":"2024-03-20T13:37:17.357474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:11.857697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339944+0000","last_change":"2024-03-20T13:36:46.888822+0000","last_active":"2024-03-20T13:37:17.339944+0000","last_peered":"2024-03-20T13:37:17.339944+0000","last_clean":"2024-03-20T13:37:17.339944+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:37:17.339944+0000","last_undegraded":"2024-03-20T13:37:17.339944+0000","last_fullsized":"2024-03-20T13:37:17.339944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:28:05.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345713+0000","last_change":"2024-03-20T13:36:46.889735+0000","last_active":"2024-03-20T13:37:17.345713+0000","last_peered":"2024-03-20T13:37:17.345713+0000","last_clean":"2024-03-20T13:37:17.345713+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:37:17.345713+0000","last_undegraded":"2024-03-20T13:37:17.345713+0000","last_fullsized":"2024-03-20T13:37:17.345713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:26.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038995+0000","last_change":"2024-03-20T13:36:38.826974+0000","last_active":"2024-03-20T13:38:11.038995+0000","last_peered":"2024-03-20T13:38:11.038995+0000","last_clean":"2024-03-20T13:38:11.038995+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:11.038995+0000","last_undegraded":"2024-03-20T13:38:11.038995+0000","last_fullsized":"2024-03-20T13:38:11.038995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:47.853154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346955+0000","last_change":"2024-03-20T13:36:40.845473+0000","last_active":"2024-03-20T13:37:17.346955+0000","last_peered":"2024-03-20T13:37:17.346955+0000","last_clean":"2024-03-20T13:37:17.346955+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:37:17.346955+0000","last_undegraded":"2024-03-20T13:37:17.346955+0000","last_fullsized":"2024-03-20T13:37:17.346955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:45:53.190145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.331149+0000","last_change":"2024-03-20T13:36:42.865392+0000","last_active":"2024-03-20T13:38:05.331149+0000","last_peered":"2024-03-20T13:38:05.331149+0000","last_clean":"2024-03-20T13:38:05.331149+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:05.331149+0000","last_undegraded":"2024-03-20T13:38:05.331149+0000","last_fullsized":"2024-03-20T13:38:05.331149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:23.969005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338712+0000","last_change":"2024-03-20T13:36:44.884122+0000","last_active":"2024-03-20T13:37:17.338712+0000","last_peered":"2024-03-20T13:37:17.338712+0000","last_clean":"2024-03-20T13:37:17.338712+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:37:17.338712+0000","last_undegraded":"2024-03-20T13:37:17.338712+0000","last_fullsized":"2024-03-20T13:37:17.338712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:16:30.331163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361092+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:37:17.361092+0000","last_peered":"2024-03-20T13:37:17.361092+0000","last_clean":"2024-03-20T13:37:17.361092+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:37:17.361092+0000","last_undegraded":"2024-03-20T13:37:17.361092+0000","last_fullsized":"2024-03-20T13:37:17.361092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099295+0000","last_change":"2024-03-20T13:36:38.835372+0000","last_active":"2024-03-20T13:37:22.099295+0000","last_peered":"2024-03-20T13:37:22.099295+0000","last_clean":"2024-03-20T13:37:22.099295+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:37:22.099295+0000","last_undegraded":"2024-03-20T13:37:22.099295+0000","last_fullsized":"2024-03-20T13:37:22.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:34.776234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340380+0000","last_change":"2024-03-20T13:36:36.812213+0000","last_active":"2024-03-20T13:37:17.340380+0000","last_peered":"2024-03-20T13:37:17.340380+0000","last_clean":"2024-03-20T13:37:17.340380+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:37:17.340380+0000","last_undegraded":"2024-03-20T13:37:17.340380+0000","last_fullsized":"2024-03-20T13:37:17.340380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:43.391446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348705+0000","last_change":"2024-03-20T13:36:40.849295+0000","last_active":"2024-03-20T13:37:17.348705+0000","last_peered":"2024-03-20T13:37:17.348705+0000","last_clean":"2024-03-20T13:37:17.348705+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:37:17.348705+0000","last_undegraded":"2024-03-20T13:37:17.348705+0000","last_fullsized":"2024-03-20T13:37:17.348705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:20.801941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:57.995056+0000","last_change":"2024-03-20T13:36:42.861263+0000","last_active":"2024-03-20T13:37:57.995056+0000","last_peered":"2024-03-20T13:37:57.995056+0000","last_clean":"2024-03-20T13:37:57.995056+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:37:57.995056+0000","last_undegraded":"2024-03-20T13:37:57.995056+0000","last_fullsized":"2024-03-20T13:37:57.995056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:19.148076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335656+0000","last_change":"2024-03-20T13:36:44.868223+0000","last_active":"2024-03-20T13:37:17.335656+0000","last_peered":"2024-03-20T13:37:17.335656+0000","last_clean":"2024-03-20T13:37:17.335656+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:37:17.335656+0000","last_undegraded":"2024-03-20T13:37:17.335656+0000","last_fullsized":"2024-03-20T13:37:17.335656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:27.229079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.348498+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:05.348498+0000","last_peered":"2024-03-20T13:38:05.348498+0000","last_clean":"2024-03-20T13:38:05.348498+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:05.348498+0000","last_undegraded":"2024-03-20T13:38:05.348498+0000","last_fullsized":"2024-03-20T13:38:05.348498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:11:03.011925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347543+0000","last_change":"2024-03-20T13:36:38.830562+0000","last_active":"2024-03-20T13:37:17.347543+0000","last_peered":"2024-03-20T13:37:17.347543+0000","last_clean":"2024-03-20T13:37:17.347543+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:37:17.347543+0000","last_undegraded":"2024-03-20T13:37:17.347543+0000","last_fullsized":"2024-03-20T13:37:17.347543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354095+0000","last_change":"2024-03-20T13:36:36.836705+0000","last_active":"2024-03-20T13:37:17.354095+0000","last_peered":"2024-03-20T13:37:17.354095+0000","last_clean":"2024-03-20T13:37:17.354095+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:37:17.354095+0000","last_undegraded":"2024-03-20T13:37:17.354095+0000","last_fullsized":"2024-03-20T13:37:17.354095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346933+0000","last_change":"2024-03-20T13:36:40.855508+0000","last_active":"2024-03-20T13:37:17.346933+0000","last_peered":"2024-03-20T13:37:17.346933+0000","last_clean":"2024-03-20T13:37:17.346933+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:37:17.346933+0000","last_undegraded":"2024-03-20T13:37:17.346933+0000","last_fullsized":"2024-03-20T13:37:17.346933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'34","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.731549+0000","last_change":"2024-03-20T13:36:42.868367+0000","last_active":"2024-03-20T13:38:10.731549+0000","last_peered":"2024-03-20T13:38:10.731549+0000","last_clean":"2024-03-20T13:38:10.731549+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:10.731549+0000","last_undegraded":"2024-03-20T13:38:10.731549+0000","last_fullsized":"2024-03-20T13:38:10.731549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:24.991506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345357+0000","last_change":"2024-03-20T13:36:44.888584+0000","last_active":"2024-03-20T13:37:17.345357+0000","last_peered":"2024-03-20T13:37:17.345357+0000","last_clean":"2024-03-20T13:37:17.345357+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:37:17.345357+0000","last_undegraded":"2024-03-20T13:37:17.345357+0000","last_fullsized":"2024-03-20T13:37:17.345357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:50.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349560+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:37:17.349560+0000","last_peered":"2024-03-20T13:37:17.349560+0000","last_clean":"2024-03-20T13:37:17.349560+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:37:17.349560+0000","last_undegraded":"2024-03-20T13:37:17.349560+0000","last_fullsized":"2024-03-20T13:37:17.349560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370915+0000","last_change":"2024-03-20T13:36:38.834173+0000","last_active":"2024-03-20T13:38:05.370915+0000","last_peered":"2024-03-20T13:38:05.370915+0000","last_clean":"2024-03-20T13:38:05.370915+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:05.370915+0000","last_undegraded":"2024-03-20T13:38:05.370915+0000","last_fullsized":"2024-03-20T13:38:05.370915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:44.080119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353785+0000","last_change":"2024-03-20T13:36:36.829532+0000","last_active":"2024-03-20T13:37:17.353785+0000","last_peered":"2024-03-20T13:37:17.353785+0000","last_clean":"2024-03-20T13:37:17.353785+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:37:17.353785+0000","last_undegraded":"2024-03-20T13:37:17.353785+0000","last_fullsized":"2024-03-20T13:37:17.353785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:30:12.679787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339023+0000","last_change":"2024-03-20T13:36:40.852289+0000","last_active":"2024-03-20T13:37:17.339023+0000","last_peered":"2024-03-20T13:37:17.339023+0000","last_clean":"2024-03-20T13:37:17.339023+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:37:17.339023+0000","last_undegraded":"2024-03-20T13:37:17.339023+0000","last_fullsized":"2024-03-20T13:37:17.339023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:08.730342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.306851+0000","last_change":"2024-03-20T13:36:42.860451+0000","last_active":"2024-03-20T13:38:05.306851+0000","last_peered":"2024-03-20T13:38:05.306851+0000","last_clean":"2024-03-20T13:38:05.306851+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:05.306851+0000","last_undegraded":"2024-03-20T13:38:05.306851+0000","last_fullsized":"2024-03-20T13:38:05.306851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336298+0000","last_change":"2024-03-20T13:36:44.862966+0000","last_active":"2024-03-20T13:37:17.336298+0000","last_peered":"2024-03-20T13:37:17.336298+0000","last_clean":"2024-03-20T13:37:17.336298+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:37:17.336298+0000","last_undegraded":"2024-03-20T13:37:17.336298+0000","last_fullsized":"2024-03-20T13:37:17.336298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:59.751229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103956+0000","last_change":"2024-03-20T13:36:38.832438+0000","last_active":"2024-03-20T13:37:22.103956+0000","last_peered":"2024-03-20T13:37:22.103956+0000","last_clean":"2024-03-20T13:37:22.103956+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:37:22.103956+0000","last_undegraded":"2024-03-20T13:37:22.103956+0000","last_fullsized":"2024-03-20T13:37:22.103956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:40.231347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339417+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:37:17.339417+0000","last_peered":"2024-03-20T13:37:17.339417+0000","last_clean":"2024-03-20T13:37:17.339417+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:37:17.339417+0000","last_undegraded":"2024-03-20T13:37:17.339417+0000","last_fullsized":"2024-03-20T13:37:17.339417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:42.936647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353909+0000","last_change":"2024-03-20T13:36:40.854924+0000","last_active":"2024-03-20T13:37:17.353909+0000","last_peered":"2024-03-20T13:37:17.353909+0000","last_clean":"2024-03-20T13:37:17.353909+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:37:17.353909+0000","last_undegraded":"2024-03-20T13:37:17.353909+0000","last_fullsized":"2024-03-20T13:37:17.353909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:58:14.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.965535+0000","last_change":"2024-03-20T13:37:17.384644+0000","last_active":"2024-03-20T13:38:10.965535+0000","last_peered":"2024-03-20T13:38:10.965535+0000","last_clean":"2024-03-20T13:38:10.965535+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:10.965535+0000","last_undegraded":"2024-03-20T13:38:10.965535+0000","last_fullsized":"2024-03-20T13:38:10.965535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:24.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337105+0000","last_change":"2024-03-20T13:36:44.873958+0000","last_active":"2024-03-20T13:37:17.337105+0000","last_peered":"2024-03-20T13:37:17.337105+0000","last_clean":"2024-03-20T13:37:17.337105+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:37:17.337105+0000","last_undegraded":"2024-03-20T13:37:17.337105+0000","last_fullsized":"2024-03-20T13:37:17.337105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:20.295832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.704046+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:04.704046+0000","last_peered":"2024-03-20T13:38:04.704046+0000","last_clean":"2024-03-20T13:38:04.704046+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:04.704046+0000","last_undegraded":"2024-03-20T13:38:04.704046+0000","last_fullsized":"2024-03-20T13:38:04.704046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:33.949395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559430+0000","last_change":"2024-03-20T13:36:38.834011+0000","last_active":"2024-03-20T13:38:04.559430+0000","last_peered":"2024-03-20T13:38:04.559430+0000","last_clean":"2024-03-20T13:38:04.559430+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:38:04.559430+0000","last_undegraded":"2024-03-20T13:38:04.559430+0000","last_fullsized":"2024-03-20T13:38:04.559430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:02.478170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342800+0000","last_change":"2024-03-20T13:36:36.833334+0000","last_active":"2024-03-20T13:37:17.342800+0000","last_peered":"2024-03-20T13:37:17.342800+0000","last_clean":"2024-03-20T13:37:17.342800+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:37:17.342800+0000","last_undegraded":"2024-03-20T13:37:17.342800+0000","last_fullsized":"2024-03-20T13:37:17.342800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:40.299686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353658+0000","last_change":"2024-03-20T13:36:40.840832+0000","last_active":"2024-03-20T13:37:17.353658+0000","last_peered":"2024-03-20T13:37:17.353658+0000","last_clean":"2024-03-20T13:37:17.353658+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:37:17.353658+0000","last_undegraded":"2024-03-20T13:37:17.353658+0000","last_fullsized":"2024-03-20T13:37:17.353658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:18:58.479248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.309071+0000","last_change":"2024-03-20T13:36:42.860856+0000","last_active":"2024-03-20T13:38:05.309071+0000","last_peered":"2024-03-20T13:38:05.309071+0000","last_clean":"2024-03-20T13:38:05.309071+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:05.309071+0000","last_undegraded":"2024-03-20T13:38:05.309071+0000","last_fullsized":"2024-03-20T13:38:05.309071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:44:34.562790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350102+0000","last_change":"2024-03-20T13:36:44.880578+0000","last_active":"2024-03-20T13:37:17.350102+0000","last_peered":"2024-03-20T13:37:17.350102+0000","last_clean":"2024-03-20T13:37:17.350102+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:37:17.350102+0000","last_undegraded":"2024-03-20T13:37:17.350102+0000","last_fullsized":"2024-03-20T13:37:17.350102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:33:34.967987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347355+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:37:17.347355+0000","last_peered":"2024-03-20T13:37:17.347355+0000","last_clean":"2024-03-20T13:37:17.347355+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:37:17.347355+0000","last_undegraded":"2024-03-20T13:37:17.347355+0000","last_fullsized":"2024-03-20T13:37:17.347355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358358+0000","last_change":"2024-03-20T13:36:38.839355+0000","last_active":"2024-03-20T13:37:17.358358+0000","last_peered":"2024-03-20T13:37:17.358358+0000","last_clean":"2024-03-20T13:37:17.358358+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:37:17.358358+0000","last_undegraded":"2024-03-20T13:37:17.358358+0000","last_fullsized":"2024-03-20T13:37:17.358358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349222+0000","last_change":"2024-03-20T13:36:36.835178+0000","last_active":"2024-03-20T13:37:17.349222+0000","last_peered":"2024-03-20T13:37:17.349222+0000","last_clean":"2024-03-20T13:37:17.349222+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:37:17.349222+0000","last_undegraded":"2024-03-20T13:37:17.349222+0000","last_fullsized":"2024-03-20T13:37:17.349222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354014+0000","last_change":"2024-03-20T13:36:40.859670+0000","last_active":"2024-03-20T13:37:17.354014+0000","last_peered":"2024-03-20T13:37:17.354014+0000","last_clean":"2024-03-20T13:37:17.354014+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:37:17.354014+0000","last_undegraded":"2024-03-20T13:37:17.354014+0000","last_fullsized":"2024-03-20T13:37:17.354014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:03.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.337993+0000","last_change":"2024-03-20T13:36:42.853208+0000","last_active":"2024-03-20T13:38:05.337993+0000","last_peered":"2024-03-20T13:38:05.337993+0000","last_clean":"2024-03-20T13:38:05.337993+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:05.337993+0000","last_undegraded":"2024-03-20T13:38:05.337993+0000","last_fullsized":"2024-03-20T13:38:05.337993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353489+0000","last_change":"2024-03-20T13:36:44.881033+0000","last_active":"2024-03-20T13:37:17.353489+0000","last_peered":"2024-03-20T13:37:17.353489+0000","last_clean":"2024-03-20T13:37:17.353489+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:37:17.353489+0000","last_undegraded":"2024-03-20T13:37:17.353489+0000","last_fullsized":"2024-03-20T13:37:17.353489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:51:03.967670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346808+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:37:17.346808+0000","last_peered":"2024-03-20T13:37:17.346808+0000","last_clean":"2024-03-20T13:37:17.346808+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:37:17.346808+0000","last_undegraded":"2024-03-20T13:37:17.346808+0000","last_fullsized":"2024-03-20T13:37:17.346808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340185+0000","last_change":"2024-03-20T13:36:38.841841+0000","last_active":"2024-03-20T13:37:17.340185+0000","last_peered":"2024-03-20T13:37:17.340185+0000","last_clean":"2024-03-20T13:37:17.340185+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:37:17.340185+0000","last_undegraded":"2024-03-20T13:37:17.340185+0000","last_fullsized":"2024-03-20T13:37:17.340185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:32.797279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355510+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:37:17.355510+0000","last_peered":"2024-03-20T13:37:17.355510+0000","last_clean":"2024-03-20T13:37:17.355510+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:37:17.355510+0000","last_undegraded":"2024-03-20T13:37:17.355510+0000","last_fullsized":"2024-03-20T13:37:17.355510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:33:21.986721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351081+0000","last_change":"2024-03-20T13:36:40.847481+0000","last_active":"2024-03-20T13:37:17.351081+0000","last_peered":"2024-03-20T13:37:17.351081+0000","last_clean":"2024-03-20T13:37:17.351081+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:37:17.351081+0000","last_undegraded":"2024-03-20T13:37:17.351081+0000","last_fullsized":"2024-03-20T13:37:17.351081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:49.265948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358102+0000","last_change":"2024-03-20T13:36:42.846652+0000","last_active":"2024-03-20T13:37:17.358102+0000","last_peered":"2024-03-20T13:37:17.358102+0000","last_clean":"2024-03-20T13:37:17.358102+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:37:17.358102+0000","last_undegraded":"2024-03-20T13:37:17.358102+0000","last_fullsized":"2024-03-20T13:37:17.358102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'240","reported_seq":304,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.266733+0000","last_change":"2024-03-20T13:36:44.870739+0000","last_active":"2024-03-20T13:38:11.266733+0000","last_peered":"2024-03-20T13:38:11.266733+0000","last_clean":"2024-03-20T13:38:11.266733+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:11.266733+0000","last_undegraded":"2024-03-20T13:38:11.266733+0000","last_fullsized":"2024-03-20T13:38:11.266733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:00:28.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346663+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:37:17.346663+0000","last_peered":"2024-03-20T13:37:17.346663+0000","last_clean":"2024-03-20T13:37:17.346663+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:37:17.346663+0000","last_undegraded":"2024-03-20T13:37:17.346663+0000","last_fullsized":"2024-03-20T13:37:17.346663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.774657+0000","last_change":"2024-03-20T13:36:38.838732+0000","last_active":"2024-03-20T13:37:21.774657+0000","last_peered":"2024-03-20T13:37:21.774657+0000","last_clean":"2024-03-20T13:37:21.774657+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:37:21.774657+0000","last_undegraded":"2024-03-20T13:37:21.774657+0000","last_fullsized":"2024-03-20T13:37:21.774657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:57.039567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352407+0000","last_change":"2024-03-20T13:36:36.847653+0000","last_active":"2024-03-20T13:37:17.352407+0000","last_peered":"2024-03-20T13:37:17.352407+0000","last_clean":"2024-03-20T13:37:17.352407+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:37:17.352407+0000","last_undegraded":"2024-03-20T13:37:17.352407+0000","last_fullsized":"2024-03-20T13:37:17.352407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:01:47.804240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":192,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.062892+0000","last_change":"2024-03-20T13:36:40.851669+0000","last_active":"2024-03-20T13:38:12.062892+0000","last_peered":"2024-03-20T13:38:12.062892+0000","last_clean":"2024-03-20T13:38:12.062892+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:12.062892+0000","last_undegraded":"2024-03-20T13:38:12.062892+0000","last_fullsized":"2024-03-20T13:38:12.062892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:16.049885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.294210+0000","last_change":"2024-03-20T13:36:42.876652+0000","last_active":"2024-03-20T13:38:05.294210+0000","last_peered":"2024-03-20T13:38:05.294210+0000","last_clean":"2024-03-20T13:38:05.294210+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:05.294210+0000","last_undegraded":"2024-03-20T13:38:05.294210+0000","last_fullsized":"2024-03-20T13:38:05.294210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338477+0000","last_change":"2024-03-20T13:36:44.880706+0000","last_active":"2024-03-20T13:37:17.338477+0000","last_peered":"2024-03-20T13:37:17.338477+0000","last_clean":"2024-03-20T13:37:17.338477+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:37:17.338477+0000","last_undegraded":"2024-03-20T13:37:17.338477+0000","last_fullsized":"2024-03-20T13:37:17.338477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:51.535549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354658+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:37:17.354658+0000","last_peered":"2024-03-20T13:37:17.354658+0000","last_clean":"2024-03-20T13:37:17.354658+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:37:17.354658+0000","last_undegraded":"2024-03-20T13:37:17.354658+0000","last_fullsized":"2024-03-20T13:37:17.354658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350635+0000","last_change":"2024-03-20T13:36:38.827830+0000","last_active":"2024-03-20T13:37:17.350635+0000","last_peered":"2024-03-20T13:37:17.350635+0000","last_clean":"2024-03-20T13:37:17.350635+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:37:17.350635+0000","last_undegraded":"2024-03-20T13:37:17.350635+0000","last_fullsized":"2024-03-20T13:37:17.350635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353488+0000","last_change":"2024-03-20T13:36:36.837596+0000","last_active":"2024-03-20T13:37:17.353488+0000","last_peered":"2024-03-20T13:37:17.353488+0000","last_clean":"2024-03-20T13:37:17.353488+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:37:17.353488+0000","last_undegraded":"2024-03-20T13:37:17.353488+0000","last_fullsized":"2024-03-20T13:37:17.353488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":199,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.188469+0000","last_change":"2024-03-20T13:36:40.851969+0000","last_active":"2024-03-20T13:38:12.188469+0000","last_peered":"2024-03-20T13:38:12.188469+0000","last_clean":"2024-03-20T13:38:12.188469+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:12.188469+0000","last_undegraded":"2024-03-20T13:38:12.188469+0000","last_fullsized":"2024-03-20T13:38:12.188469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:05.906039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.294273+0000","last_change":"2024-03-20T13:36:42.863180+0000","last_active":"2024-03-20T13:38:05.294273+0000","last_peered":"2024-03-20T13:38:05.294273+0000","last_clean":"2024-03-20T13:38:05.294273+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:05.294273+0000","last_undegraded":"2024-03-20T13:38:05.294273+0000","last_fullsized":"2024-03-20T13:38:05.294273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:45:02.764876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347146+0000","last_change":"2024-03-20T13:36:44.869579+0000","last_active":"2024-03-20T13:37:17.347146+0000","last_peered":"2024-03-20T13:37:17.347146+0000","last_clean":"2024-03-20T13:37:17.347146+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:37:17.347146+0000","last_undegraded":"2024-03-20T13:37:17.347146+0000","last_fullsized":"2024-03-20T13:37:17.347146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.022745+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:11.022745+0000","last_peered":"2024-03-20T13:38:11.022745+0000","last_clean":"2024-03-20T13:38:11.022745+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:11.022745+0000","last_undegraded":"2024-03-20T13:38:11.022745+0000","last_fullsized":"2024-03-20T13:38:11.022745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560346+0000","last_change":"2024-03-20T13:36:38.826048+0000","last_active":"2024-03-20T13:38:04.560346+0000","last_peered":"2024-03-20T13:38:04.560346+0000","last_clean":"2024-03-20T13:38:04.560346+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:38:04.560346+0000","last_undegraded":"2024-03-20T13:38:04.560346+0000","last_fullsized":"2024-03-20T13:38:04.560346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:34:12.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362384+0000","last_change":"2024-03-20T13:36:36.848516+0000","last_active":"2024-03-20T13:37:17.362384+0000","last_peered":"2024-03-20T13:37:17.362384+0000","last_clean":"2024-03-20T13:37:17.362384+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:37:17.362384+0000","last_undegraded":"2024-03-20T13:37:17.362384+0000","last_fullsized":"2024-03-20T13:37:17.362384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343154+0000","last_change":"2024-03-20T13:36:40.851382+0000","last_active":"2024-03-20T13:37:17.343154+0000","last_peered":"2024-03-20T13:37:17.343154+0000","last_clean":"2024-03-20T13:37:17.343154+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:37:17.343154+0000","last_undegraded":"2024-03-20T13:37:17.343154+0000","last_fullsized":"2024-03-20T13:37:17.343154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:56.202294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'24","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.334890+0000","last_change":"2024-03-20T13:36:42.845176+0000","last_active":"2024-03-20T13:38:05.334890+0000","last_peered":"2024-03-20T13:38:05.334890+0000","last_clean":"2024-03-20T13:38:05.334890+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:05.334890+0000","last_undegraded":"2024-03-20T13:38:05.334890+0000","last_fullsized":"2024-03-20T13:38:05.334890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:22.548562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348416+0000","last_change":"2024-03-20T13:36:44.871360+0000","last_active":"2024-03-20T13:37:17.348416+0000","last_peered":"2024-03-20T13:37:17.348416+0000","last_clean":"2024-03-20T13:37:17.348416+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:37:17.348416+0000","last_undegraded":"2024-03-20T13:37:17.348416+0000","last_fullsized":"2024-03-20T13:37:17.348416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.055574+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:37:22.055574+0000","last_peered":"2024-03-20T13:37:22.055574+0000","last_clean":"2024-03-20T13:37:22.055574+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:37:22.055574+0000","last_undegraded":"2024-03-20T13:37:22.055574+0000","last_fullsized":"2024-03-20T13:37:22.055574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103962+0000","last_change":"2024-03-20T13:36:38.844162+0000","last_active":"2024-03-20T13:37:22.103962+0000","last_peered":"2024-03-20T13:37:22.103962+0000","last_clean":"2024-03-20T13:37:22.103962+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:37:22.103962+0000","last_undegraded":"2024-03-20T13:37:22.103962+0000","last_fullsized":"2024-03-20T13:37:22.103962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354264+0000","last_change":"2024-03-20T13:36:36.832558+0000","last_active":"2024-03-20T13:37:17.354264+0000","last_peered":"2024-03-20T13:37:17.354264+0000","last_clean":"2024-03-20T13:37:17.354264+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:37:17.354264+0000","last_undegraded":"2024-03-20T13:37:17.354264+0000","last_fullsized":"2024-03-20T13:37:17.354264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:27.481357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342345+0000","last_change":"2024-03-20T13:36:40.857715+0000","last_active":"2024-03-20T13:37:17.342345+0000","last_peered":"2024-03-20T13:37:17.342345+0000","last_clean":"2024-03-20T13:37:17.342345+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:37:17.342345+0000","last_undegraded":"2024-03-20T13:37:17.342345+0000","last_fullsized":"2024-03-20T13:37:17.342345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:54.489899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'29","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.012261+0000","last_change":"2024-03-20T13:36:42.860634+0000","last_active":"2024-03-20T13:38:11.012261+0000","last_peered":"2024-03-20T13:38:11.012261+0000","last_clean":"2024-03-20T13:38:11.012261+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:11.012261+0000","last_undegraded":"2024-03-20T13:38:11.012261+0000","last_fullsized":"2024-03-20T13:38:11.012261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336050+0000","last_change":"2024-03-20T13:36:44.875311+0000","last_active":"2024-03-20T13:37:17.336050+0000","last_peered":"2024-03-20T13:37:17.336050+0000","last_clean":"2024-03-20T13:37:17.336050+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:37:17.336050+0000","last_undegraded":"2024-03-20T13:37:17.336050+0000","last_fullsized":"2024-03-20T13:37:17.336050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:40.597951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354486+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:37:17.354486+0000","last_peered":"2024-03-20T13:37:17.354486+0000","last_clean":"2024-03-20T13:37:17.354486+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:37:17.354486+0000","last_undegraded":"2024-03-20T13:37:17.354486+0000","last_fullsized":"2024-03-20T13:37:17.354486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362094+0000","last_change":"2024-03-20T13:36:38.834433+0000","last_active":"2024-03-20T13:38:05.362094+0000","last_peered":"2024-03-20T13:38:05.362094+0000","last_clean":"2024-03-20T13:38:05.362094+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:38:05.362094+0000","last_undegraded":"2024-03-20T13:38:05.362094+0000","last_fullsized":"2024-03-20T13:38:05.362094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:57.952498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334809+0000","last_change":"2024-03-20T13:36:36.812837+0000","last_active":"2024-03-20T13:37:17.334809+0000","last_peered":"2024-03-20T13:37:17.334809+0000","last_clean":"2024-03-20T13:37:17.334809+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:37:17.334809+0000","last_undegraded":"2024-03-20T13:37:17.334809+0000","last_fullsized":"2024-03-20T13:37:17.334809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:34.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.333133+0000","last_change":"2024-03-20T13:36:38.839230+0000","last_active":"2024-03-20T13:37:21.333133+0000","last_peered":"2024-03-20T13:37:21.333133+0000","last_clean":"2024-03-20T13:37:21.333133+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:37:21.333133+0000","last_undegraded":"2024-03-20T13:37:21.333133+0000","last_fullsized":"2024-03-20T13:37:21.333133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:30.816812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334989+0000","last_change":"2024-03-20T13:36:36.814746+0000","last_active":"2024-03-20T13:37:17.334989+0000","last_peered":"2024-03-20T13:37:17.334989+0000","last_clean":"2024-03-20T13:37:17.334989+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:37:17.334989+0000","last_undegraded":"2024-03-20T13:37:17.334989+0000","last_fullsized":"2024-03-20T13:37:17.334989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:55.744070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353374+0000","last_change":"2024-03-20T13:36:38.837487+0000","last_active":"2024-03-20T13:37:17.353374+0000","last_peered":"2024-03-20T13:37:17.353374+0000","last_clean":"2024-03-20T13:37:17.353374+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:37:17.353374+0000","last_undegraded":"2024-03-20T13:37:17.353374+0000","last_fullsized":"2024-03-20T13:37:17.353374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:02:07.258709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356320+0000","last_change":"2024-03-20T13:36:36.851159+0000","last_active":"2024-03-20T13:37:17.356320+0000","last_peered":"2024-03-20T13:37:17.356320+0000","last_clean":"2024-03-20T13:37:17.356320+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:37:17.356320+0000","last_undegraded":"2024-03-20T13:37:17.356320+0000","last_fullsized":"2024-03-20T13:37:17.356320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:19:31.572008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352794+0000","last_change":"2024-03-20T13:36:38.839750+0000","last_active":"2024-03-20T13:37:17.352794+0000","last_peered":"2024-03-20T13:37:17.352794+0000","last_clean":"2024-03-20T13:37:17.352794+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:37:17.352794+0000","last_undegraded":"2024-03-20T13:37:17.352794+0000","last_fullsized":"2024-03-20T13:37:17.352794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:04:09.779028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.353796+0000","last_change":"2024-03-20T13:36:36.811977+0000","last_active":"2024-03-20T13:38:05.353796+0000","last_peered":"2024-03-20T13:38:05.353796+0000","last_clean":"2024-03-20T13:38:05.353796+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:05.353796+0000","last_undegraded":"2024-03-20T13:38:05.353796+0000","last_fullsized":"2024-03-20T13:38:05.353796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:32:12.757319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559426+0000","last_change":"2024-03-20T13:37:17.364712+0000","last_active":"2024-03-20T13:38:04.559426+0000","last_peered":"2024-03-20T13:38:04.559426+0000","last_clean":"2024-03-20T13:38:04.559426+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:38:04.559426+0000","last_undegraded":"2024-03-20T13:38:04.559426+0000","last_fullsized":"2024-03-20T13:38:04.559426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:19.939344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348779+0000","last_change":"2024-03-20T13:36:36.846100+0000","last_active":"2024-03-20T13:37:17.348779+0000","last_peered":"2024-03-20T13:37:17.348779+0000","last_clean":"2024-03-20T13:37:17.348779+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:37:17.348779+0000","last_undegraded":"2024-03-20T13:37:17.348779+0000","last_fullsized":"2024-03-20T13:37:17.348779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348556+0000","last_change":"2024-03-20T13:36:38.837474+0000","last_active":"2024-03-20T13:37:17.348556+0000","last_peered":"2024-03-20T13:37:17.348556+0000","last_clean":"2024-03-20T13:37:17.348556+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:37:17.348556+0000","last_undegraded":"2024-03-20T13:37:17.348556+0000","last_fullsized":"2024-03-20T13:37:17.348556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:44.912843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350563+0000","last_change":"2024-03-20T13:36:36.831139+0000","last_active":"2024-03-20T13:37:17.350563+0000","last_peered":"2024-03-20T13:37:17.350563+0000","last_clean":"2024-03-20T13:37:17.350563+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:37:17.350563+0000","last_undegraded":"2024-03-20T13:37:17.350563+0000","last_fullsized":"2024-03-20T13:37:17.350563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:37.352809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038682+0000","last_change":"2024-03-20T13:36:38.836423+0000","last_active":"2024-03-20T13:38:11.038682+0000","last_peered":"2024-03-20T13:38:11.038682+0000","last_clean":"2024-03-20T13:38:11.038682+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:11.038682+0000","last_undegraded":"2024-03-20T13:38:11.038682+0000","last_fullsized":"2024-03-20T13:38:11.038682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345654+0000","last_change":"2024-03-20T13:36:36.818776+0000","last_active":"2024-03-20T13:37:17.345654+0000","last_peered":"2024-03-20T13:37:17.345654+0000","last_clean":"2024-03-20T13:37:17.345654+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:37:17.345654+0000","last_undegraded":"2024-03-20T13:37:17.345654+0000","last_fullsized":"2024-03-20T13:37:17.345654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:47.923230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349498+0000","last_change":"2024-03-20T13:36:38.831672+0000","last_active":"2024-03-20T13:37:17.349498+0000","last_peered":"2024-03-20T13:37:17.349498+0000","last_clean":"2024-03-20T13:37:17.349498+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:37:17.349498+0000","last_undegraded":"2024-03-20T13:37:17.349498+0000","last_fullsized":"2024-03-20T13:37:17.349498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360818+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:37:17.360818+0000","last_peered":"2024-03-20T13:37:17.360818+0000","last_clean":"2024-03-20T13:37:17.360818+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:37:17.360818+0000","last_undegraded":"2024-03-20T13:37:17.360818+0000","last_fullsized":"2024-03-20T13:37:17.360818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038256+0000","last_change":"2024-03-20T13:36:38.839448+0000","last_active":"2024-03-20T13:38:11.038256+0000","last_peered":"2024-03-20T13:38:11.038256+0000","last_clean":"2024-03-20T13:38:11.038256+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:11.038256+0000","last_undegraded":"2024-03-20T13:38:11.038256+0000","last_fullsized":"2024-03-20T13:38:11.038256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:44:49.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339930+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:37:17.339930+0000","last_peered":"2024-03-20T13:37:17.339930+0000","last_clean":"2024-03-20T13:37:17.339930+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:37:17.339930+0000","last_undegraded":"2024-03-20T13:37:17.339930+0000","last_fullsized":"2024-03-20T13:37:17.339930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361835+0000","last_change":"2024-03-20T13:36:38.828492+0000","last_active":"2024-03-20T13:37:17.361835+0000","last_peered":"2024-03-20T13:37:17.361835+0000","last_clean":"2024-03-20T13:37:17.361835+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:37:17.361835+0000","last_undegraded":"2024-03-20T13:37:17.361835+0000","last_fullsized":"2024-03-20T13:37:17.361835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341186+0000","last_change":"2024-03-20T13:36:36.848972+0000","last_active":"2024-03-20T13:37:17.341186+0000","last_peered":"2024-03-20T13:37:17.341186+0000","last_clean":"2024-03-20T13:37:17.341186+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:37:17.341186+0000","last_undegraded":"2024-03-20T13:37:17.341186+0000","last_fullsized":"2024-03-20T13:37:17.341186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:57.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559674+0000","last_change":"2024-03-20T13:36:38.830672+0000","last_active":"2024-03-20T13:38:04.559674+0000","last_peered":"2024-03-20T13:38:04.559674+0000","last_clean":"2024-03-20T13:38:04.559674+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:04.559674+0000","last_undegraded":"2024-03-20T13:38:04.559674+0000","last_fullsized":"2024-03-20T13:38:04.559674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.951500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.094321+0000","last_change":"2024-03-20T13:36:36.830049+0000","last_active":"2024-03-20T13:37:22.094321+0000","last_peered":"2024-03-20T13:37:22.094321+0000","last_clean":"2024-03-20T13:37:22.094321+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:37:22.094321+0000","last_undegraded":"2024-03-20T13:37:22.094321+0000","last_fullsized":"2024-03-20T13:37:22.094321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.370623+0000","last_change":"2024-03-20T13:37:17.369630+0000","last_active":"2024-03-20T13:37:17.370623+0000","last_peered":"2024-03-20T13:37:17.370623+0000","last_clean":"2024-03-20T13:37:17.370623+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:37:17.370623+0000","last_undegraded":"2024-03-20T13:37:17.370623+0000","last_fullsized":"2024-03-20T13:37:17.370623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:10.411859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348081+0000","last_change":"2024-03-20T13:36:36.831557+0000","last_active":"2024-03-20T13:37:17.348081+0000","last_peered":"2024-03-20T13:37:17.348081+0000","last_clean":"2024-03-20T13:37:17.348081+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:37:17.348081+0000","last_undegraded":"2024-03-20T13:37:17.348081+0000","last_fullsized":"2024-03-20T13:37:17.348081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:10:52.993902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560621+0000","last_change":"2024-03-20T13:36:38.829272+0000","last_active":"2024-03-20T13:38:04.560621+0000","last_peered":"2024-03-20T13:38:04.560621+0000","last_clean":"2024-03-20T13:38:04.560621+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:38:04.560621+0000","last_undegraded":"2024-03-20T13:38:04.560621+0000","last_fullsized":"2024-03-20T13:38:04.560621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349002+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:37:17.349002+0000","last_peered":"2024-03-20T13:37:17.349002+0000","last_clean":"2024-03-20T13:37:17.349002+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:37:17.349002+0000","last_undegraded":"2024-03-20T13:37:17.349002+0000","last_fullsized":"2024-03-20T13:37:17.349002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.775462+0000","last_change":"2024-03-20T13:37:17.354371+0000","last_active":"2024-03-20T13:37:21.775462+0000","last_peered":"2024-03-20T13:37:21.775462+0000","last_clean":"2024-03-20T13:37:21.775462+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:37:21.775462+0000","last_undegraded":"2024-03-20T13:37:21.775462+0000","last_fullsized":"2024-03-20T13:37:21.775462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:51.168656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351746+0000","last_change":"2024-03-20T13:36:36.848902+0000","last_active":"2024-03-20T13:37:17.351746+0000","last_peered":"2024-03-20T13:37:17.351746+0000","last_clean":"2024-03-20T13:37:17.351746+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:37:17.351746+0000","last_undegraded":"2024-03-20T13:37:17.351746+0000","last_fullsized":"2024-03-20T13:37:17.351746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347273+0000","last_change":"2024-03-20T13:36:38.836588+0000","last_active":"2024-03-20T13:37:17.347273+0000","last_peered":"2024-03-20T13:37:17.347273+0000","last_clean":"2024-03-20T13:37:17.347273+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:37:17.347273+0000","last_undegraded":"2024-03-20T13:37:17.347273+0000","last_fullsized":"2024-03-20T13:37:17.347273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346147+0000","last_change":"2024-03-20T13:36:36.818507+0000","last_active":"2024-03-20T13:37:17.346147+0000","last_peered":"2024-03-20T13:37:17.346147+0000","last_clean":"2024-03-20T13:37:17.346147+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:37:17.346147+0000","last_undegraded":"2024-03-20T13:37:17.346147+0000","last_fullsized":"2024-03-20T13:37:17.346147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:42:17.676549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103624+0000","last_change":"2024-03-20T13:36:38.828728+0000","last_active":"2024-03-20T13:37:22.103624+0000","last_peered":"2024-03-20T13:37:22.103624+0000","last_clean":"2024-03-20T13:37:22.103624+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:37:22.103624+0000","last_undegraded":"2024-03-20T13:37:22.103624+0000","last_fullsized":"2024-03-20T13:37:22.103624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:34.549840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.311031+0000","last_change":"2024-03-20T13:36:36.846419+0000","last_active":"2024-03-20T13:37:21.311031+0000","last_peered":"2024-03-20T13:37:21.311031+0000","last_clean":"2024-03-20T13:37:21.311031+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:37:21.311031+0000","last_undegraded":"2024-03-20T13:37:21.311031+0000","last_fullsized":"2024-03-20T13:37:21.311031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347654+0000","last_change":"2024-03-20T13:36:36.834343+0000","last_active":"2024-03-20T13:37:17.347654+0000","last_peered":"2024-03-20T13:37:17.347654+0000","last_clean":"2024-03-20T13:37:17.347654+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:37:17.347654+0000","last_undegraded":"2024-03-20T13:37:17.347654+0000","last_fullsized":"2024-03-20T13:37:17.347654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099296+0000","last_change":"2024-03-20T13:36:38.830650+0000","last_active":"2024-03-20T13:37:22.099296+0000","last_peered":"2024-03-20T13:37:22.099296+0000","last_clean":"2024-03-20T13:37:22.099296+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:37:22.099296+0000","last_undegraded":"2024-03-20T13:37:22.099296+0000","last_fullsized":"2024-03-20T13:37:22.099296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:47.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343075+0000","last_change":"2024-03-20T13:36:36.833552+0000","last_active":"2024-03-20T13:37:17.343075+0000","last_peered":"2024-03-20T13:37:17.343075+0000","last_clean":"2024-03-20T13:37:17.343075+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:37:17.343075+0000","last_undegraded":"2024-03-20T13:37:17.343075+0000","last_fullsized":"2024-03-20T13:37:17.343075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:36.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099152+0000","last_change":"2024-03-20T13:36:38.827748+0000","last_active":"2024-03-20T13:37:22.099152+0000","last_peered":"2024-03-20T13:37:22.099152+0000","last_clean":"2024-03-20T13:37:22.099152+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:37:22.099152+0000","last_undegraded":"2024-03-20T13:37:22.099152+0000","last_fullsized":"2024-03-20T13:37:22.099152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:07.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672987,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.47199999999999998}]}]},{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.73399999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672986,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.54400000000000004}]},{"osd":3,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68899999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.627}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:38:19.951 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-20T13:38:19.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:38:20.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab589f0640 1 Processor -- start 2024-03-20T13:38:20.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab589f0640 1 -- start start 2024-03-20T13:38:20.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab589f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab5412b000 0x7fab5412b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:20.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab589f0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab54072390 con 0x7fab5406c3f0 2024-03-20T13:38:20.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab589f0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5409c1e0 con 0x7fab5412b000 2024-03-20T13:38:20.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab5259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab5412b000 0x7fab5412b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:20.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab51d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fab5406c3f0 0x7fab541210b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60112/0 (socket says 172.21.15.89:60112) 2024-03-20T13:38:20.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab51d9b640 1 -- 172.21.15.89:0/1175636942 learned_addr learned my addr 172.21.15.89:0/1175636942 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:20.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab5259c640 1 -- 172.21.15.89:0/1175636942 >> v1:172.21.15.89:6789/0 conn(0x7fab5406c3f0 legacy=0x7fab541210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.106+0000 7fab5259c640 1 -- 172.21.15.89:0/1175636942 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5406d030 con 0x7fab5412b000 2024-03-20T13:38:20.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.110+0000 7fab5259c640 1 --2- 172.21.15.89:0/1175636942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5412b000 0x7fab5412b3e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fab48009740 tx=0x7fab4801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b258efd0106f8641 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:20.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.110+0000 7fab5159a640 1 -- 172.21.15.89:0/1175636942 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab480ab530 con 0x7fab5412b000 2024-03-20T13:38:20.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.110+0000 7fab5159a640 1 -- 172.21.15.89:0/1175636942 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab480a7050 con 0x7fab5412b000 2024-03-20T13:38:20.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.110+0000 7fab5159a640 1 -- 172.21.15.89:0/1175636942 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab480ab7e0 con 0x7fab5412b000 2024-03-20T13:38:20.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/1175636942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5412b000 msgr2=0x7fab5412b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 --2- 172.21.15.89:0/1175636942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5412b000 0x7fab5412b3e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fab48009740 tx=0x7fab4801c370 comp rx=0 tx=0).stop 2024-03-20T13:38:20.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/1175636942 shutdown_connections 2024-03-20T13:38:20.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 --2- 172.21.15.89:0/1175636942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5412b000 0x7fab5412b3e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/1175636942 >> 172.21.15.89:0/1175636942 conn(0x7fab5409a2f0 msgr2=0x7fab5409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:20.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/1175636942 shutdown_connections 2024-03-20T13:38:20.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/1175636942 wait complete. 2024-03-20T13:38:20.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 Processor -- start 2024-03-20T13:38:20.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- start start 2024-03-20T13:38:20.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 0x7fab5412f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:20.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5406d760 con 0x7fab5406c3f0 2024-03-20T13:38:20.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab5259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 0x7fab5412f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:20.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab5259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 0x7fab5412f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34992/0 (socket says 172.21.15.89:34992) 2024-03-20T13:38:20.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab5259c640 1 -- 172.21.15.89:0/3840216951 learned_addr learned my addr 172.21.15.89:0/3840216951 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:20.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab5259c640 1 -- 172.21.15.89:0/3840216951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48009420 con 0x7fab5406c3f0 2024-03-20T13:38:20.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab5259c640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 0x7fab5412f290 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fab480ae040 tx=0x7fab4801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:20.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab480b7580 con 0x7fab5406c3f0 2024-03-20T13:38:20.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab480b76e0 con 0x7fab5406c3f0 2024-03-20T13:38:20.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab480b79c0 con 0x7fab5406c3f0 2024-03-20T13:38:20.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5406efd0 con 0x7fab5406c3f0 2024-03-20T13:38:20.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5406d930 con 0x7fab5406c3f0 2024-03-20T13:38:20.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fab480b7b20 con 0x7fab5406c3f0 2024-03-20T13:38:20.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab54098740 con 0x7fab5406c3f0 2024-03-20T13:38:20.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab42ffd640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab34035a10 0x7fab34037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:20.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.114+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fab480e3450 con 0x7fab5406c3f0 2024-03-20T13:38:20.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.118+0000 7fab51d9b640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab34035a10 0x7fab34037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:20.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.118+0000 7fab51d9b640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab34035a10 0x7fab34037ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab44001610 tx=0x7fab44007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:20.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.122+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab480c7990 con 0x7fab5406c3f0 2024-03-20T13:38:20.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.274+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab5406eaf0 con 0x7fab34035a10 2024-03-20T13:38:20.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.318+0000 7fab42ffd640 1 -- 172.21.15.89:0/3840216951 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673721 (secure 0 0 0) 0x7fab5406eaf0 con 0x7fab34035a10 2024-03-20T13:38:20.330 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:38:20.338 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:38:20.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab34035a10 msgr2=0x7fab34037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab34035a10 0x7fab34037ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab44001610 tx=0x7fab44007ad0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 msgr2=0x7fab5412f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 0x7fab5412f290 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fab480ae040 tx=0x7fab4801abb0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 shutdown_connections 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fab34035a10 0x7fab34037ed0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 --2- 172.21.15.89:0/3840216951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5406c3f0 0x7fab5412f290 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 >> 172.21.15.89:0/3840216951 conn(0x7fab5409a2f0 msgr2=0x7fab541297d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:20.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 shutdown_connections 2024-03-20T13:38:20.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.326+0000 7fab589f0640 1 -- 172.21.15.89:0/3840216951 wait complete. 2024-03-20T13:38:20.345 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-03-20T13:38:18.285166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3794,"num_read_kb":3437,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-19,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":348,"num_read_kb":331,"num_write":116,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006249"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353220+0000","last_change":"2024-03-20T13:36:36.834585+0000","last_active":"2024-03-20T13:37:17.353220+0000","last_peered":"2024-03-20T13:37:17.353220+0000","last_clean":"2024-03-20T13:37:17.353220+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:37:17.353220+0000","last_undegraded":"2024-03-20T13:37:17.353220+0000","last_fullsized":"2024-03-20T13:37:17.353220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:42.695830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348328+0000","last_change":"2024-03-20T13:36:38.833359+0000","last_active":"2024-03-20T13:37:17.348328+0000","last_peered":"2024-03-20T13:37:17.348328+0000","last_clean":"2024-03-20T13:37:17.348328+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:37:17.348328+0000","last_undegraded":"2024-03-20T13:37:17.348328+0000","last_fullsized":"2024-03-20T13:37:17.348328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359019+0000","last_change":"2024-03-20T13:36:36.849152+0000","last_active":"2024-03-20T13:37:17.359019+0000","last_peered":"2024-03-20T13:37:17.359019+0000","last_clean":"2024-03-20T13:37:17.359019+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:37:17.359019+0000","last_undegraded":"2024-03-20T13:37:17.359019+0000","last_fullsized":"2024-03-20T13:37:17.359019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:26.137179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038312+0000","last_change":"2024-03-20T13:36:38.817960+0000","last_active":"2024-03-20T13:38:11.038312+0000","last_peered":"2024-03-20T13:38:11.038312+0000","last_clean":"2024-03-20T13:38:11.038312+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:38:11.038312+0000","last_undegraded":"2024-03-20T13:38:11.038312+0000","last_fullsized":"2024-03-20T13:38:11.038312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:21:08.799966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351979+0000","last_change":"2024-03-20T13:36:36.848291+0000","last_active":"2024-03-20T13:37:17.351979+0000","last_peered":"2024-03-20T13:37:17.351979+0000","last_clean":"2024-03-20T13:37:17.351979+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:37:17.351979+0000","last_undegraded":"2024-03-20T13:37:17.351979+0000","last_fullsized":"2024-03-20T13:37:17.351979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559658+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:04.559658+0000","last_peered":"2024-03-20T13:38:04.559658+0000","last_clean":"2024-03-20T13:38:04.559658+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:04.559658+0000","last_undegraded":"2024-03-20T13:38:04.559658+0000","last_fullsized":"2024-03-20T13:38:04.559658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:50.112294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338808+0000","last_change":"2024-03-20T13:36:36.813481+0000","last_active":"2024-03-20T13:37:17.338808+0000","last_peered":"2024-03-20T13:37:17.338808+0000","last_clean":"2024-03-20T13:37:17.338808+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:37:17.338808+0000","last_undegraded":"2024-03-20T13:37:17.338808+0000","last_fullsized":"2024-03-20T13:37:17.338808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:54.373470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.335849+0000","last_change":"2024-03-20T13:36:38.821653+0000","last_active":"2024-03-20T13:37:21.335849+0000","last_peered":"2024-03-20T13:37:21.335849+0000","last_clean":"2024-03-20T13:37:21.335849+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:37:21.335849+0000","last_undegraded":"2024-03-20T13:37:21.335849+0000","last_fullsized":"2024-03-20T13:37:21.335849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.030141+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:11.030141+0000","last_peered":"2024-03-20T13:38:11.030141+0000","last_clean":"2024-03-20T13:38:11.030141+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:11.030141+0000","last_undegraded":"2024-03-20T13:38:11.030141+0000","last_fullsized":"2024-03-20T13:38:11.030141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361558+0000","last_change":"2024-03-20T13:36:38.841957+0000","last_active":"2024-03-20T13:38:05.361558+0000","last_peered":"2024-03-20T13:38:05.361558+0000","last_clean":"2024-03-20T13:38:05.361558+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:05.361558+0000","last_undegraded":"2024-03-20T13:38:05.361558+0000","last_fullsized":"2024-03-20T13:38:05.361558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:10.770393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349494+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:37:17.349494+0000","last_peered":"2024-03-20T13:37:17.349494+0000","last_clean":"2024-03-20T13:37:17.349494+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:37:17.349494+0000","last_undegraded":"2024-03-20T13:37:17.349494+0000","last_fullsized":"2024-03-20T13:37:17.349494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.779828+0000","last_change":"2024-03-20T13:36:38.846021+0000","last_active":"2024-03-20T13:37:21.779828+0000","last_peered":"2024-03-20T13:37:21.779828+0000","last_clean":"2024-03-20T13:37:21.779828+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:37:21.779828+0000","last_undegraded":"2024-03-20T13:37:21.779828+0000","last_fullsized":"2024-03-20T13:37:21.779828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342434+0000","last_change":"2024-03-20T13:36:36.844496+0000","last_active":"2024-03-20T13:37:17.342434+0000","last_peered":"2024-03-20T13:37:17.342434+0000","last_clean":"2024-03-20T13:37:17.342434+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:37:17.342434+0000","last_undegraded":"2024-03-20T13:37:17.342434+0000","last_fullsized":"2024-03-20T13:37:17.342434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356403+0000","last_change":"2024-03-20T13:36:38.843718+0000","last_active":"2024-03-20T13:37:17.356403+0000","last_peered":"2024-03-20T13:37:17.356403+0000","last_clean":"2024-03-20T13:37:17.356403+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:37:17.356403+0000","last_undegraded":"2024-03-20T13:37:17.356403+0000","last_fullsized":"2024-03-20T13:37:17.356403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:16.103447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.529939+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:37:20.529939+0000","last_peered":"2024-03-20T13:37:20.529939+0000","last_clean":"2024-03-20T13:37:20.529939+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:37:20.529939+0000","last_undegraded":"2024-03-20T13:37:20.529939+0000","last_fullsized":"2024-03-20T13:37:20.529939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:29.131356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048710+0000","last_change":"2024-03-20T13:36:38.830884+0000","last_active":"2024-03-20T13:38:11.048710+0000","last_peered":"2024-03-20T13:38:11.048710+0000","last_clean":"2024-03-20T13:38:11.048710+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:11.048710+0000","last_undegraded":"2024-03-20T13:38:11.048710+0000","last_fullsized":"2024-03-20T13:38:11.048710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:06.433353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348004+0000","last_change":"2024-03-20T13:36:38.833138+0000","last_active":"2024-03-20T13:37:17.348004+0000","last_peered":"2024-03-20T13:37:17.348004+0000","last_clean":"2024-03-20T13:37:17.348004+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:37:17.348004+0000","last_undegraded":"2024-03-20T13:37:17.348004+0000","last_fullsized":"2024-03-20T13:37:17.348004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.070212+0000","last_change":"2024-03-20T13:36:36.832461+0000","last_active":"2024-03-20T13:37:22.070212+0000","last_peered":"2024-03-20T13:37:22.070212+0000","last_clean":"2024-03-20T13:37:22.070212+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:37:22.070212+0000","last_undegraded":"2024-03-20T13:37:22.070212+0000","last_fullsized":"2024-03-20T13:37:22.070212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:29:37.186470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.039239+0000","last_change":"2024-03-20T13:36:38.843593+0000","last_active":"2024-03-20T13:38:11.039239+0000","last_peered":"2024-03-20T13:38:11.039239+0000","last_clean":"2024-03-20T13:38:11.039239+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:11.039239+0000","last_undegraded":"2024-03-20T13:38:11.039239+0000","last_fullsized":"2024-03-20T13:38:11.039239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347887+0000","last_change":"2024-03-20T13:36:36.818443+0000","last_active":"2024-03-20T13:37:17.347887+0000","last_peered":"2024-03-20T13:37:17.347887+0000","last_clean":"2024-03-20T13:37:17.347887+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:37:17.347887+0000","last_undegraded":"2024-03-20T13:37:17.347887+0000","last_fullsized":"2024-03-20T13:37:17.347887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:58:23.109004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362815+0000","last_change":"2024-03-20T13:36:38.831759+0000","last_active":"2024-03-20T13:38:05.362815+0000","last_peered":"2024-03-20T13:38:05.362815+0000","last_clean":"2024-03-20T13:38:05.362815+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:05.362815+0000","last_undegraded":"2024-03-20T13:38:05.362815+0000","last_fullsized":"2024-03-20T13:38:05.362815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:21.180969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353762+0000","last_change":"2024-03-20T13:36:36.840606+0000","last_active":"2024-03-20T13:37:17.353762+0000","last_peered":"2024-03-20T13:37:17.353762+0000","last_clean":"2024-03-20T13:37:17.353762+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:37:17.353762+0000","last_undegraded":"2024-03-20T13:37:17.353762+0000","last_fullsized":"2024-03-20T13:37:17.353762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038457+0000","last_change":"2024-03-20T13:36:38.828329+0000","last_active":"2024-03-20T13:38:11.038457+0000","last_peered":"2024-03-20T13:38:11.038457+0000","last_clean":"2024-03-20T13:38:11.038457+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:11.038457+0000","last_undegraded":"2024-03-20T13:38:11.038457+0000","last_fullsized":"2024-03-20T13:38:11.038457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:12.734298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.088045+0000","last_change":"2024-03-20T13:36:36.826166+0000","last_active":"2024-03-20T13:37:22.088045+0000","last_peered":"2024-03-20T13:37:22.088045+0000","last_clean":"2024-03-20T13:37:22.088045+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:37:22.088045+0000","last_undegraded":"2024-03-20T13:37:22.088045+0000","last_fullsized":"2024-03-20T13:37:22.088045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.337413+0000","last_change":"2024-03-20T13:36:38.825590+0000","last_active":"2024-03-20T13:37:21.337413+0000","last_peered":"2024-03-20T13:37:21.337413+0000","last_clean":"2024-03-20T13:37:21.337413+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:37:21.337413+0000","last_undegraded":"2024-03-20T13:37:21.337413+0000","last_fullsized":"2024-03-20T13:37:21.337413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:35.374667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355672+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:37:17.355672+0000","last_peered":"2024-03-20T13:37:17.355672+0000","last_clean":"2024-03-20T13:37:17.355672+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:37:17.355672+0000","last_undegraded":"2024-03-20T13:37:17.355672+0000","last_fullsized":"2024-03-20T13:37:17.355672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:27.631307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.336262+0000","last_change":"2024-03-20T13:36:38.836549+0000","last_active":"2024-03-20T13:37:21.336262+0000","last_peered":"2024-03-20T13:37:21.336262+0000","last_clean":"2024-03-20T13:37:21.336262+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:37:21.336262+0000","last_undegraded":"2024-03-20T13:37:21.336262+0000","last_fullsized":"2024-03-20T13:37:21.336262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:33.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356996+0000","last_change":"2024-03-20T13:36:36.848317+0000","last_active":"2024-03-20T13:37:17.356996+0000","last_peered":"2024-03-20T13:37:17.356996+0000","last_clean":"2024-03-20T13:37:17.356996+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:37:17.356996+0000","last_undegraded":"2024-03-20T13:37:17.356996+0000","last_fullsized":"2024-03-20T13:37:17.356996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.021474+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:11.021474+0000","last_peered":"2024-03-20T13:38:11.021474+0000","last_clean":"2024-03-20T13:38:11.021474+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:11.021474+0000","last_undegraded":"2024-03-20T13:38:11.021474+0000","last_fullsized":"2024-03-20T13:38:11.021474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:59:50.691433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361696+0000","last_change":"2024-03-20T13:36:38.833120+0000","last_active":"2024-03-20T13:38:05.361696+0000","last_peered":"2024-03-20T13:38:05.361696+0000","last_clean":"2024-03-20T13:38:05.361696+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:05.361696+0000","last_undegraded":"2024-03-20T13:38:05.361696+0000","last_fullsized":"2024-03-20T13:38:05.361696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350014+0000","last_change":"2024-03-20T13:36:36.847955+0000","last_active":"2024-03-20T13:37:17.350014+0000","last_peered":"2024-03-20T13:37:17.350014+0000","last_clean":"2024-03-20T13:37:17.350014+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:37:17.350014+0000","last_undegraded":"2024-03-20T13:37:17.350014+0000","last_fullsized":"2024-03-20T13:37:17.350014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358800+0000","last_change":"2024-03-20T13:36:40.850195+0000","last_active":"2024-03-20T13:37:17.358800+0000","last_peered":"2024-03-20T13:37:17.358800+0000","last_clean":"2024-03-20T13:37:17.358800+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:37:17.358800+0000","last_undegraded":"2024-03-20T13:37:17.358800+0000","last_fullsized":"2024-03-20T13:37:17.358800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.321997+0000","last_change":"2024-03-20T13:36:42.847305+0000","last_active":"2024-03-20T13:38:05.321997+0000","last_peered":"2024-03-20T13:38:05.321997+0000","last_clean":"2024-03-20T13:38:05.321997+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:05.321997+0000","last_undegraded":"2024-03-20T13:38:05.321997+0000","last_fullsized":"2024-03-20T13:38:05.321997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351069+0000","last_change":"2024-03-20T13:36:44.870120+0000","last_active":"2024-03-20T13:37:17.351069+0000","last_peered":"2024-03-20T13:37:17.351069+0000","last_clean":"2024-03-20T13:37:17.351069+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:37:17.351069+0000","last_undegraded":"2024-03-20T13:37:17.351069+0000","last_fullsized":"2024-03-20T13:37:17.351069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:00.348882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.510685+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:37:59.510685+0000","last_peered":"2024-03-20T13:37:59.510685+0000","last_clean":"2024-03-20T13:37:59.510685+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:37:59.510685+0000","last_undegraded":"2024-03-20T13:37:59.510685+0000","last_fullsized":"2024-03-20T13:37:59.510685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099067+0000","last_change":"2024-03-20T13:36:38.822857+0000","last_active":"2024-03-20T13:37:22.099067+0000","last_peered":"2024-03-20T13:37:22.099067+0000","last_clean":"2024-03-20T13:37:22.099067+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:37:22.099067+0000","last_undegraded":"2024-03-20T13:37:22.099067+0000","last_fullsized":"2024-03-20T13:37:22.099067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337639+0000","last_change":"2024-03-20T13:36:36.815979+0000","last_active":"2024-03-20T13:37:17.337639+0000","last_peered":"2024-03-20T13:37:17.337639+0000","last_clean":"2024-03-20T13:37:17.337639+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:37:17.337639+0000","last_undegraded":"2024-03-20T13:37:17.337639+0000","last_fullsized":"2024-03-20T13:37:17.337639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:15:50.640696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351375+0000","last_change":"2024-03-20T13:36:40.852967+0000","last_active":"2024-03-20T13:37:17.351375+0000","last_peered":"2024-03-20T13:37:17.351375+0000","last_clean":"2024-03-20T13:37:17.351375+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:37:17.351375+0000","last_undegraded":"2024-03-20T13:37:17.351375+0000","last_fullsized":"2024-03-20T13:37:17.351375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:13:55.770914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358636+0000","last_change":"2024-03-20T13:36:42.851506+0000","last_active":"2024-03-20T13:37:17.358636+0000","last_peered":"2024-03-20T13:37:17.358636+0000","last_clean":"2024-03-20T13:37:17.358636+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:37:17.358636+0000","last_undegraded":"2024-03-20T13:37:17.358636+0000","last_fullsized":"2024-03-20T13:37:17.358636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:47:54.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352979+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:37:17.352979+0000","last_peered":"2024-03-20T13:37:17.352979+0000","last_clean":"2024-03-20T13:37:17.352979+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:37:17.352979+0000","last_undegraded":"2024-03-20T13:37:17.352979+0000","last_fullsized":"2024-03-20T13:37:17.352979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:55:33.559340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355634+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:37:17.355634+0000","last_peered":"2024-03-20T13:37:17.355634+0000","last_clean":"2024-03-20T13:37:17.355634+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:37:17.355634+0000","last_undegraded":"2024-03-20T13:37:17.355634+0000","last_fullsized":"2024-03-20T13:37:17.355634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:19.393599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038369+0000","last_change":"2024-03-20T13:37:17.351202+0000","last_active":"2024-03-20T13:38:11.038369+0000","last_peered":"2024-03-20T13:38:11.038369+0000","last_clean":"2024-03-20T13:38:11.038369+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:38:11.038369+0000","last_undegraded":"2024-03-20T13:38:11.038369+0000","last_fullsized":"2024-03-20T13:38:11.038369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:50.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347515+0000","last_change":"2024-03-20T13:36:36.825659+0000","last_active":"2024-03-20T13:37:17.347515+0000","last_peered":"2024-03-20T13:37:17.347515+0000","last_clean":"2024-03-20T13:37:17.347515+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:37:17.347515+0000","last_undegraded":"2024-03-20T13:37:17.347515+0000","last_fullsized":"2024-03-20T13:37:17.347515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359882+0000","last_change":"2024-03-20T13:36:40.850731+0000","last_active":"2024-03-20T13:37:17.359882+0000","last_peered":"2024-03-20T13:37:17.359882+0000","last_clean":"2024-03-20T13:37:17.359882+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:37:17.359882+0000","last_undegraded":"2024-03-20T13:37:17.359882+0000","last_fullsized":"2024-03-20T13:37:17.359882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:23:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338522+0000","last_change":"2024-03-20T13:36:42.855730+0000","last_active":"2024-03-20T13:37:17.338522+0000","last_peered":"2024-03-20T13:37:17.338522+0000","last_clean":"2024-03-20T13:37:17.338522+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:37:17.338522+0000","last_undegraded":"2024-03-20T13:37:17.338522+0000","last_fullsized":"2024-03-20T13:37:17.338522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:03:28.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'240","reported_seq":305,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.269990+0000","last_change":"2024-03-20T13:36:44.878389+0000","last_active":"2024-03-20T13:38:11.269990+0000","last_peered":"2024-03-20T13:38:11.269990+0000","last_clean":"2024-03-20T13:38:11.269990+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:38:11.269990+0000","last_undegraded":"2024-03-20T13:38:11.269990+0000","last_fullsized":"2024-03-20T13:38:11.269990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:53.957445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335764+0000","last_change":"2024-03-20T13:36:46.888952+0000","last_active":"2024-03-20T13:37:17.335764+0000","last_peered":"2024-03-20T13:37:17.335764+0000","last_clean":"2024-03-20T13:37:17.335764+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:37:17.335764+0000","last_undegraded":"2024-03-20T13:37:17.335764+0000","last_fullsized":"2024-03-20T13:37:17.335764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:04:07.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.804073+0000","last_change":"2024-03-20T13:36:38.835366+0000","last_active":"2024-03-20T13:37:22.804073+0000","last_peered":"2024-03-20T13:37:22.804073+0000","last_clean":"2024-03-20T13:37:22.804073+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:37:22.804073+0000","last_undegraded":"2024-03-20T13:37:22.804073+0000","last_fullsized":"2024-03-20T13:37:22.804073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347002+0000","last_change":"2024-03-20T13:36:36.838074+0000","last_active":"2024-03-20T13:37:17.347002+0000","last_peered":"2024-03-20T13:37:17.347002+0000","last_clean":"2024-03-20T13:37:17.347002+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:37:17.347002+0000","last_undegraded":"2024-03-20T13:37:17.347002+0000","last_fullsized":"2024-03-20T13:37:17.347002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356582+0000","last_change":"2024-03-20T13:36:40.859660+0000","last_active":"2024-03-20T13:37:17.356582+0000","last_peered":"2024-03-20T13:37:17.356582+0000","last_clean":"2024-03-20T13:37:17.356582+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:37:17.356582+0000","last_undegraded":"2024-03-20T13:37:17.356582+0000","last_fullsized":"2024-03-20T13:37:17.356582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:53.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.314066+0000","last_change":"2024-03-20T13:36:42.860645+0000","last_active":"2024-03-20T13:38:05.314066+0000","last_peered":"2024-03-20T13:38:05.314066+0000","last_clean":"2024-03-20T13:38:05.314066+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:05.314066+0000","last_undegraded":"2024-03-20T13:38:05.314066+0000","last_fullsized":"2024-03-20T13:38:05.314066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:31:48.342447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'240","reported_seq":319,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.275024+0000","last_change":"2024-03-20T13:36:44.897812+0000","last_active":"2024-03-20T13:38:11.275024+0000","last_peered":"2024-03-20T13:38:11.275024+0000","last_clean":"2024-03-20T13:38:11.275024+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:11.275024+0000","last_undegraded":"2024-03-20T13:38:11.275024+0000","last_fullsized":"2024-03-20T13:38:11.275024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:31.390443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357541+0000","last_change":"2024-03-20T13:37:17.356166+0000","last_active":"2024-03-20T13:37:17.357541+0000","last_peered":"2024-03-20T13:37:17.357541+0000","last_clean":"2024-03-20T13:37:17.357541+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:37:17.357541+0000","last_undegraded":"2024-03-20T13:37:17.357541+0000","last_fullsized":"2024-03-20T13:37:17.357541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:05.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353407+0000","last_change":"2024-03-20T13:36:36.834443+0000","last_active":"2024-03-20T13:37:17.353407+0000","last_peered":"2024-03-20T13:37:17.353407+0000","last_clean":"2024-03-20T13:37:17.353407+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:37:17.353407+0000","last_undegraded":"2024-03-20T13:37:17.353407+0000","last_fullsized":"2024-03-20T13:37:17.353407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:29:03.754269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344058+0000","last_change":"2024-03-20T13:36:40.857714+0000","last_active":"2024-03-20T13:37:17.344058+0000","last_peered":"2024-03-20T13:37:17.344058+0000","last_clean":"2024-03-20T13:37:17.344058+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:37:17.344058+0000","last_undegraded":"2024-03-20T13:37:17.344058+0000","last_fullsized":"2024-03-20T13:37:17.344058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:24:44.271212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.331094+0000","last_change":"2024-03-20T13:36:42.873431+0000","last_active":"2024-03-20T13:38:05.331094+0000","last_peered":"2024-03-20T13:38:05.331094+0000","last_clean":"2024-03-20T13:38:05.331094+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:05.331094+0000","last_undegraded":"2024-03-20T13:38:05.331094+0000","last_fullsized":"2024-03-20T13:38:05.331094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:08:30.363113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":54,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349777+0000","last_change":"2024-03-20T13:36:44.866647+0000","last_active":"2024-03-20T13:37:17.349777+0000","last_peered":"2024-03-20T13:37:17.349777+0000","last_clean":"2024-03-20T13:37:17.349777+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:37:17.349777+0000","last_undegraded":"2024-03-20T13:37:17.349777+0000","last_fullsized":"2024-03-20T13:37:17.349777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:19.236268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.105778+0000","last_change":"2024-03-20T13:36:46.889608+0000","last_active":"2024-03-20T13:38:05.105778+0000","last_peered":"2024-03-20T13:38:05.105778+0000","last_clean":"2024-03-20T13:38:05.105778+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:05.105778+0000","last_undegraded":"2024-03-20T13:38:05.105778+0000","last_fullsized":"2024-03-20T13:38:05.105778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:14.771685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345198+0000","last_change":"2024-03-20T13:36:38.831983+0000","last_active":"2024-03-20T13:37:17.345198+0000","last_peered":"2024-03-20T13:37:17.345198+0000","last_clean":"2024-03-20T13:37:17.345198+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:37:17.345198+0000","last_undegraded":"2024-03-20T13:37:17.345198+0000","last_fullsized":"2024-03-20T13:37:17.345198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:57:18.786192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353826+0000","last_change":"2024-03-20T13:36:36.839624+0000","last_active":"2024-03-20T13:37:17.353826+0000","last_peered":"2024-03-20T13:37:17.353826+0000","last_clean":"2024-03-20T13:37:17.353826+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:37:17.353826+0000","last_undegraded":"2024-03-20T13:37:17.353826+0000","last_fullsized":"2024-03-20T13:37:17.353826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:14:30.338597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336329+0000","last_change":"2024-03-20T13:36:40.856999+0000","last_active":"2024-03-20T13:37:17.336329+0000","last_peered":"2024-03-20T13:37:17.336329+0000","last_clean":"2024-03-20T13:37:17.336329+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:37:17.336329+0000","last_undegraded":"2024-03-20T13:37:17.336329+0000","last_fullsized":"2024-03-20T13:37:17.336329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:58.874311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.296019+0000","last_change":"2024-03-20T13:36:42.844797+0000","last_active":"2024-03-20T13:38:05.296019+0000","last_peered":"2024-03-20T13:38:05.296019+0000","last_clean":"2024-03-20T13:38:05.296019+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:05.296019+0000","last_undegraded":"2024-03-20T13:38:05.296019+0000","last_fullsized":"2024-03-20T13:38:05.296019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:15:52.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356072+0000","last_change":"2024-03-20T13:36:44.888691+0000","last_active":"2024-03-20T13:37:17.356072+0000","last_peered":"2024-03-20T13:37:17.356072+0000","last_clean":"2024-03-20T13:37:17.356072+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:37:17.356072+0000","last_undegraded":"2024-03-20T13:37:17.356072+0000","last_fullsized":"2024-03-20T13:37:17.356072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:29.837819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.378145+0000","last_change":"2024-03-20T13:36:46.873147+0000","last_active":"2024-03-20T13:37:59.378145+0000","last_peered":"2024-03-20T13:37:59.378145+0000","last_clean":"2024-03-20T13:37:59.378145+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:37:59.378145+0000","last_undegraded":"2024-03-20T13:37:59.378145+0000","last_fullsized":"2024-03-20T13:37:59.378145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:16.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350555+0000","last_change":"2024-03-20T13:36:38.827772+0000","last_active":"2024-03-20T13:37:17.350555+0000","last_peered":"2024-03-20T13:37:17.350555+0000","last_clean":"2024-03-20T13:37:17.350555+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:37:17.350555+0000","last_undegraded":"2024-03-20T13:37:17.350555+0000","last_fullsized":"2024-03-20T13:37:17.350555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354432+0000","last_change":"2024-03-20T13:36:36.826408+0000","last_active":"2024-03-20T13:37:17.354432+0000","last_peered":"2024-03-20T13:37:17.354432+0000","last_clean":"2024-03-20T13:37:17.354432+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:37:17.354432+0000","last_undegraded":"2024-03-20T13:37:17.354432+0000","last_fullsized":"2024-03-20T13:37:17.354432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:21.851320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338772+0000","last_change":"2024-03-20T13:36:40.846177+0000","last_active":"2024-03-20T13:37:17.338772+0000","last_peered":"2024-03-20T13:37:17.338772+0000","last_clean":"2024-03-20T13:37:17.338772+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:37:17.338772+0000","last_undegraded":"2024-03-20T13:37:17.338772+0000","last_fullsized":"2024-03-20T13:37:17.338772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:09.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.334061+0000","last_change":"2024-03-20T13:36:42.841973+0000","last_active":"2024-03-20T13:38:05.334061+0000","last_peered":"2024-03-20T13:38:05.334061+0000","last_clean":"2024-03-20T13:38:05.334061+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:05.334061+0000","last_undegraded":"2024-03-20T13:38:05.334061+0000","last_fullsized":"2024-03-20T13:38:05.334061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'240","reported_seq":284,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.276315+0000","last_change":"2024-03-20T13:36:44.881852+0000","last_active":"2024-03-20T13:38:11.276315+0000","last_peered":"2024-03-20T13:38:11.276315+0000","last_clean":"2024-03-20T13:38:11.276315+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:11.276315+0000","last_undegraded":"2024-03-20T13:38:11.276315+0000","last_fullsized":"2024-03-20T13:38:11.276315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:56.157507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351002+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:37:17.351002+0000","last_peered":"2024-03-20T13:37:17.351002+0000","last_clean":"2024-03-20T13:37:17.351002+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:37:17.351002+0000","last_undegraded":"2024-03-20T13:37:17.351002+0000","last_fullsized":"2024-03-20T13:37:17.351002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:18.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361689+0000","last_change":"2024-03-20T13:36:38.840955+0000","last_active":"2024-03-20T13:38:05.361689+0000","last_peered":"2024-03-20T13:38:05.361689+0000","last_clean":"2024-03-20T13:38:05.361689+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:05.361689+0000","last_undegraded":"2024-03-20T13:38:05.361689+0000","last_fullsized":"2024-03-20T13:38:05.361689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:33.249228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350421+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:37:17.350421+0000","last_peered":"2024-03-20T13:37:17.350421+0000","last_clean":"2024-03-20T13:37:17.350421+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:37:17.350421+0000","last_undegraded":"2024-03-20T13:37:17.350421+0000","last_fullsized":"2024-03-20T13:37:17.350421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343195+0000","last_change":"2024-03-20T13:36:40.845768+0000","last_active":"2024-03-20T13:37:17.343195+0000","last_peered":"2024-03-20T13:37:17.343195+0000","last_clean":"2024-03-20T13:37:17.343195+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:37:17.343195+0000","last_undegraded":"2024-03-20T13:37:17.343195+0000","last_fullsized":"2024-03-20T13:37:17.343195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:33:29.320718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'50","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.961328+0000","last_change":"2024-03-20T13:36:42.869009+0000","last_active":"2024-03-20T13:38:10.961328+0000","last_peered":"2024-03-20T13:38:10.961328+0000","last_clean":"2024-03-20T13:38:10.961328+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:10.961328+0000","last_undegraded":"2024-03-20T13:38:10.961328+0000","last_fullsized":"2024-03-20T13:38:10.961328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:14.441521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335490+0000","last_change":"2024-03-20T13:36:44.867134+0000","last_active":"2024-03-20T13:37:17.335490+0000","last_peered":"2024-03-20T13:37:17.335490+0000","last_clean":"2024-03-20T13:37:17.335490+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:37:17.335490+0000","last_undegraded":"2024-03-20T13:37:17.335490+0000","last_fullsized":"2024-03-20T13:37:17.335490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:26.218996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:46.886740+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:16.012802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361855+0000","last_change":"2024-03-20T13:36:38.832987+0000","last_active":"2024-03-20T13:38:05.361855+0000","last_peered":"2024-03-20T13:38:05.361855+0000","last_clean":"2024-03-20T13:38:05.361855+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:38:05.361855+0000","last_undegraded":"2024-03-20T13:38:05.361855+0000","last_fullsized":"2024-03-20T13:38:05.361855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:53:17.091959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.064409+0000","last_change":"2024-03-20T13:36:36.846257+0000","last_active":"2024-03-20T13:37:22.064409+0000","last_peered":"2024-03-20T13:37:22.064409+0000","last_clean":"2024-03-20T13:37:22.064409+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:37:22.064409+0000","last_undegraded":"2024-03-20T13:37:22.064409+0000","last_fullsized":"2024-03-20T13:37:22.064409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343865+0000","last_change":"2024-03-20T13:36:40.839225+0000","last_active":"2024-03-20T13:37:17.343865+0000","last_peered":"2024-03-20T13:37:17.343865+0000","last_clean":"2024-03-20T13:37:17.343865+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:37:17.343865+0000","last_undegraded":"2024-03-20T13:37:17.343865+0000","last_fullsized":"2024-03-20T13:37:17.343865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:25.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.304039+0000","last_change":"2024-03-20T13:36:42.876207+0000","last_active":"2024-03-20T13:38:05.304039+0000","last_peered":"2024-03-20T13:38:05.304039+0000","last_clean":"2024-03-20T13:38:05.304039+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:05.304039+0000","last_undegraded":"2024-03-20T13:38:05.304039+0000","last_fullsized":"2024-03-20T13:38:05.304039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:23.373578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360601+0000","last_change":"2024-03-20T13:36:44.899145+0000","last_active":"2024-03-20T13:37:17.360601+0000","last_peered":"2024-03-20T13:37:17.360601+0000","last_clean":"2024-03-20T13:37:17.360601+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:37:17.360601+0000","last_undegraded":"2024-03-20T13:37:17.360601+0000","last_fullsized":"2024-03-20T13:37:17.360601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338015+0000","last_change":"2024-03-20T13:36:46.875764+0000","last_active":"2024-03-20T13:37:17.338015+0000","last_peered":"2024-03-20T13:37:17.338015+0000","last_clean":"2024-03-20T13:37:17.338015+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:37:17.338015+0000","last_undegraded":"2024-03-20T13:37:17.338015+0000","last_fullsized":"2024-03-20T13:37:17.338015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:43.408023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356084+0000","last_change":"2024-03-20T13:36:38.831920+0000","last_active":"2024-03-20T13:37:17.356084+0000","last_peered":"2024-03-20T13:37:17.356084+0000","last_clean":"2024-03-20T13:37:17.356084+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:37:17.356084+0000","last_undegraded":"2024-03-20T13:37:17.356084+0000","last_fullsized":"2024-03-20T13:37:17.356084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.081235+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:37:22.081235+0000","last_peered":"2024-03-20T13:37:22.081235+0000","last_clean":"2024-03-20T13:37:22.081235+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:37:22.081235+0000","last_undegraded":"2024-03-20T13:37:22.081235+0000","last_fullsized":"2024-03-20T13:37:22.081235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350463+0000","last_change":"2024-03-20T13:36:40.847551+0000","last_active":"2024-03-20T13:37:17.350463+0000","last_peered":"2024-03-20T13:37:17.350463+0000","last_clean":"2024-03-20T13:37:17.350463+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:37:17.350463+0000","last_undegraded":"2024-03-20T13:37:17.350463+0000","last_fullsized":"2024-03-20T13:37:17.350463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:03:22.247918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.345847+0000","last_change":"2024-03-20T13:36:42.845589+0000","last_active":"2024-03-20T13:38:05.345847+0000","last_peered":"2024-03-20T13:38:05.345847+0000","last_clean":"2024-03-20T13:38:05.345847+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:05.345847+0000","last_undegraded":"2024-03-20T13:38:05.345847+0000","last_fullsized":"2024-03-20T13:38:05.345847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:56.555692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'240","reported_seq":321,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.270399+0000","last_change":"2024-03-20T13:36:44.879458+0000","last_active":"2024-03-20T13:38:11.270399+0000","last_peered":"2024-03-20T13:38:11.270399+0000","last_clean":"2024-03-20T13:38:11.270399+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:11.270399+0000","last_undegraded":"2024-03-20T13:38:11.270399+0000","last_fullsized":"2024-03-20T13:38:11.270399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:14.860829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.376315+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:05.376315+0000","last_peered":"2024-03-20T13:38:05.376315+0000","last_clean":"2024-03-20T13:38:05.376315+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:05.376315+0000","last_undegraded":"2024-03-20T13:38:05.376315+0000","last_fullsized":"2024-03-20T13:38:05.376315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:30.005016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345914+0000","last_change":"2024-03-20T13:36:38.825748+0000","last_active":"2024-03-20T13:37:17.345914+0000","last_peered":"2024-03-20T13:37:17.345914+0000","last_clean":"2024-03-20T13:37:17.345914+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:37:17.345914+0000","last_undegraded":"2024-03-20T13:37:17.345914+0000","last_fullsized":"2024-03-20T13:37:17.345914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:17.486304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.565297+0000","last_change":"2024-03-20T13:36:36.846954+0000","last_active":"2024-03-20T13:38:04.565297+0000","last_peered":"2024-03-20T13:38:04.565297+0000","last_clean":"2024-03-20T13:38:04.565297+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:38:04.565297+0000","last_undegraded":"2024-03-20T13:38:04.565297+0000","last_fullsized":"2024-03-20T13:38:04.565297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":359,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.187801+0000","last_change":"2024-03-20T13:36:40.855511+0000","last_active":"2024-03-20T13:38:12.187801+0000","last_peered":"2024-03-20T13:38:12.187801+0000","last_clean":"2024-03-20T13:38:12.187801+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:12.187801+0000","last_undegraded":"2024-03-20T13:38:12.187801+0000","last_fullsized":"2024-03-20T13:38:12.187801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:36:09.090540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348292+0000","last_change":"2024-03-20T13:36:42.844667+0000","last_active":"2024-03-20T13:37:17.348292+0000","last_peered":"2024-03-20T13:37:17.348292+0000","last_clean":"2024-03-20T13:37:17.348292+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:37:17.348292+0000","last_undegraded":"2024-03-20T13:37:17.348292+0000","last_fullsized":"2024-03-20T13:37:17.348292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:57.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'240","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.273196+0000","last_change":"2024-03-20T13:36:44.878660+0000","last_active":"2024-03-20T13:38:11.273196+0000","last_peered":"2024-03-20T13:38:11.273196+0000","last_clean":"2024-03-20T13:38:11.273196+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:38:11.273196+0000","last_undegraded":"2024-03-20T13:38:11.273196+0000","last_fullsized":"2024-03-20T13:38:11.273196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:17.394132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335236+0000","last_change":"2024-03-20T13:36:46.894365+0000","last_active":"2024-03-20T13:37:17.335236+0000","last_peered":"2024-03-20T13:37:17.335236+0000","last_clean":"2024-03-20T13:37:17.335236+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:37:17.335236+0000","last_undegraded":"2024-03-20T13:37:17.335236+0000","last_fullsized":"2024-03-20T13:37:17.335236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:16:31.162761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362064+0000","last_change":"2024-03-20T13:36:38.827417+0000","last_active":"2024-03-20T13:38:05.362064+0000","last_peered":"2024-03-20T13:38:05.362064+0000","last_clean":"2024-03-20T13:38:05.362064+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:05.362064+0000","last_undegraded":"2024-03-20T13:38:05.362064+0000","last_fullsized":"2024-03-20T13:38:05.362064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:01.821428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340325+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:37:17.340325+0000","last_peered":"2024-03-20T13:37:17.340325+0000","last_clean":"2024-03-20T13:37:17.340325+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:37:17.340325+0000","last_undegraded":"2024-03-20T13:37:17.340325+0000","last_fullsized":"2024-03-20T13:37:17.340325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:34.568110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362408+0000","last_change":"2024-03-20T13:36:40.850087+0000","last_active":"2024-03-20T13:37:17.362408+0000","last_peered":"2024-03-20T13:37:17.362408+0000","last_clean":"2024-03-20T13:37:17.362408+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:37:17.362408+0000","last_undegraded":"2024-03-20T13:37:17.362408+0000","last_fullsized":"2024-03-20T13:37:17.362408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.325183+0000","last_change":"2024-03-20T13:36:42.876289+0000","last_active":"2024-03-20T13:38:05.325183+0000","last_peered":"2024-03-20T13:38:05.325183+0000","last_clean":"2024-03-20T13:38:05.325183+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:05.325183+0000","last_undegraded":"2024-03-20T13:38:05.325183+0000","last_fullsized":"2024-03-20T13:38:05.325183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:11.362564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356204+0000","last_change":"2024-03-20T13:36:44.871091+0000","last_active":"2024-03-20T13:37:17.356204+0000","last_peered":"2024-03-20T13:37:17.356204+0000","last_clean":"2024-03-20T13:37:17.356204+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:37:17.356204+0000","last_undegraded":"2024-03-20T13:37:17.356204+0000","last_fullsized":"2024-03-20T13:37:17.356204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:17.175441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347541+0000","last_change":"2024-03-20T13:36:46.872197+0000","last_active":"2024-03-20T13:37:17.347541+0000","last_peered":"2024-03-20T13:37:17.347541+0000","last_clean":"2024-03-20T13:37:17.347541+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:37:17.347541+0000","last_undegraded":"2024-03-20T13:37:17.347541+0000","last_fullsized":"2024-03-20T13:37:17.347541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:03:54.127026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354510+0000","last_change":"2024-03-20T13:36:38.845564+0000","last_active":"2024-03-20T13:37:17.354510+0000","last_peered":"2024-03-20T13:37:17.354510+0000","last_clean":"2024-03-20T13:37:17.354510+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:37:17.354510+0000","last_undegraded":"2024-03-20T13:37:17.354510+0000","last_fullsized":"2024-03-20T13:37:17.354510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":201,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341737+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:37:17.341737+0000","last_peered":"2024-03-20T13:37:17.341737+0000","last_clean":"2024-03-20T13:37:17.341737+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:37:17.341737+0000","last_undegraded":"2024-03-20T13:37:17.341737+0000","last_fullsized":"2024-03-20T13:37:17.341737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:11.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350038+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:37:17.350038+0000","last_peered":"2024-03-20T13:37:17.350038+0000","last_clean":"2024-03-20T13:37:17.350038+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:37:17.350038+0000","last_undegraded":"2024-03-20T13:37:17.350038+0000","last_fullsized":"2024-03-20T13:37:17.350038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:20.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356573+0000","last_change":"2024-03-20T13:36:36.849187+0000","last_active":"2024-03-20T13:37:17.356573+0000","last_peered":"2024-03-20T13:37:17.356573+0000","last_clean":"2024-03-20T13:37:17.356573+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:37:17.356573+0000","last_undegraded":"2024-03-20T13:37:17.356573+0000","last_fullsized":"2024-03-20T13:37:17.356573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350872+0000","last_change":"2024-03-20T13:36:40.848822+0000","last_active":"2024-03-20T13:37:17.350872+0000","last_peered":"2024-03-20T13:37:17.350872+0000","last_clean":"2024-03-20T13:37:17.350872+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:37:17.350872+0000","last_undegraded":"2024-03-20T13:37:17.350872+0000","last_fullsized":"2024-03-20T13:37:17.350872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:47.518308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'70","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.995929+0000","last_change":"2024-03-20T13:36:42.846779+0000","last_active":"2024-03-20T13:38:10.995929+0000","last_peered":"2024-03-20T13:38:10.995929+0000","last_clean":"2024-03-20T13:38:10.995929+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:10.995929+0000","last_undegraded":"2024-03-20T13:38:10.995929+0000","last_fullsized":"2024-03-20T13:38:10.995929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:25.956347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360479+0000","last_change":"2024-03-20T13:36:44.899269+0000","last_active":"2024-03-20T13:37:17.360479+0000","last_peered":"2024-03-20T13:37:17.360479+0000","last_clean":"2024-03-20T13:37:17.360479+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:37:17.360479+0000","last_undegraded":"2024-03-20T13:37:17.360479+0000","last_fullsized":"2024-03-20T13:37:17.360479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'51","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.055469+0000","last_change":"2024-03-20T13:36:46.893348+0000","last_active":"2024-03-20T13:38:11.055469+0000","last_peered":"2024-03-20T13:38:11.055469+0000","last_clean":"2024-03-20T13:38:11.055469+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:38:11.055469+0000","last_undegraded":"2024-03-20T13:38:11.055469+0000","last_fullsized":"2024-03-20T13:38:11.055469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:20.181051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.803949+0000","last_change":"2024-03-20T13:36:38.835115+0000","last_active":"2024-03-20T13:37:22.803949+0000","last_peered":"2024-03-20T13:37:22.803949+0000","last_clean":"2024-03-20T13:37:22.803949+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:37:22.803949+0000","last_undegraded":"2024-03-20T13:37:22.803949+0000","last_fullsized":"2024-03-20T13:37:22.803949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348446+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:37:17.348446+0000","last_peered":"2024-03-20T13:37:17.348446+0000","last_clean":"2024-03-20T13:37:17.348446+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:37:17.348446+0000","last_undegraded":"2024-03-20T13:37:17.348446+0000","last_fullsized":"2024-03-20T13:37:17.348446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:03.493778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344968+0000","last_change":"2024-03-20T13:36:36.833258+0000","last_active":"2024-03-20T13:37:17.344968+0000","last_peered":"2024-03-20T13:37:17.344968+0000","last_clean":"2024-03-20T13:37:17.344968+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:37:17.344968+0000","last_undegraded":"2024-03-20T13:37:17.344968+0000","last_fullsized":"2024-03-20T13:37:17.344968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:55.537677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356009+0000","last_change":"2024-03-20T13:36:40.850671+0000","last_active":"2024-03-20T13:37:17.356009+0000","last_peered":"2024-03-20T13:37:17.356009+0000","last_clean":"2024-03-20T13:37:17.356009+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:37:17.356009+0000","last_undegraded":"2024-03-20T13:37:17.356009+0000","last_fullsized":"2024-03-20T13:37:17.356009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:49:00.124639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'239","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.263813+0000","last_change":"2024-03-20T13:36:42.863211+0000","last_active":"2024-03-20T13:38:11.263813+0000","last_peered":"2024-03-20T13:38:11.263813+0000","last_clean":"2024-03-20T13:38:11.263813+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:11.263813+0000","last_undegraded":"2024-03-20T13:38:11.263813+0000","last_fullsized":"2024-03-20T13:38:11.263813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:58.451631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351365+0000","last_change":"2024-03-20T13:36:44.897832+0000","last_active":"2024-03-20T13:37:17.351365+0000","last_peered":"2024-03-20T13:37:17.351365+0000","last_clean":"2024-03-20T13:37:17.351365+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:37:17.351365+0000","last_undegraded":"2024-03-20T13:37:17.351365+0000","last_fullsized":"2024-03-20T13:37:17.351365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:52:08.639163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.523020+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:37:59.523020+0000","last_peered":"2024-03-20T13:37:59.523020+0000","last_clean":"2024-03-20T13:37:59.523020+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:37:59.523020+0000","last_undegraded":"2024-03-20T13:37:59.523020+0000","last_fullsized":"2024-03-20T13:37:59.523020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:46.638563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362220+0000","last_change":"2024-03-20T13:36:38.832205+0000","last_active":"2024-03-20T13:38:05.362220+0000","last_peered":"2024-03-20T13:38:05.362220+0000","last_clean":"2024-03-20T13:38:05.362220+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:38:05.362220+0000","last_undegraded":"2024-03-20T13:38:05.362220+0000","last_fullsized":"2024-03-20T13:38:05.362220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:00.408558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334481+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:37:17.334481+0000","last_peered":"2024-03-20T13:37:17.334481+0000","last_clean":"2024-03-20T13:37:17.334481+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.334481+0000","last_undegraded":"2024-03-20T13:37:17.334481+0000","last_fullsized":"2024-03-20T13:37:17.334481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342328+0000","last_change":"2024-03-20T13:36:36.836293+0000","last_active":"2024-03-20T13:37:17.342328+0000","last_peered":"2024-03-20T13:37:17.342328+0000","last_clean":"2024-03-20T13:37:17.342328+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:37:17.342328+0000","last_undegraded":"2024-03-20T13:37:17.342328+0000","last_fullsized":"2024-03-20T13:37:17.342328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:33.995435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349061+0000","last_change":"2024-03-20T13:36:40.842771+0000","last_active":"2024-03-20T13:37:17.349061+0000","last_peered":"2024-03-20T13:37:17.349061+0000","last_clean":"2024-03-20T13:37:17.349061+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:37:17.349061+0000","last_undegraded":"2024-03-20T13:37:17.349061+0000","last_fullsized":"2024-03-20T13:37:17.349061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:42:22.678474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.996348+0000","last_change":"2024-03-20T13:36:42.842816+0000","last_active":"2024-03-20T13:38:10.996348+0000","last_peered":"2024-03-20T13:38:10.996348+0000","last_clean":"2024-03-20T13:38:10.996348+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:10.996348+0000","last_undegraded":"2024-03-20T13:38:10.996348+0000","last_fullsized":"2024-03-20T13:38:10.996348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:03.696208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352701+0000","last_change":"2024-03-20T13:36:44.872161+0000","last_active":"2024-03-20T13:37:17.352701+0000","last_peered":"2024-03-20T13:37:17.352701+0000","last_clean":"2024-03-20T13:37:17.352701+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:37:17.352701+0000","last_undegraded":"2024-03-20T13:37:17.352701+0000","last_fullsized":"2024-03-20T13:37:17.352701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:39.436728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347395+0000","last_change":"2024-03-20T13:36:46.874361+0000","last_active":"2024-03-20T13:37:17.347395+0000","last_peered":"2024-03-20T13:37:17.347395+0000","last_clean":"2024-03-20T13:37:17.347395+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:37:17.347395+0000","last_undegraded":"2024-03-20T13:37:17.347395+0000","last_fullsized":"2024-03-20T13:37:17.347395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048631+0000","last_change":"2024-03-20T13:36:38.839568+0000","last_active":"2024-03-20T13:38:11.048631+0000","last_peered":"2024-03-20T13:38:11.048631+0000","last_clean":"2024-03-20T13:38:11.048631+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:11.048631+0000","last_undegraded":"2024-03-20T13:38:11.048631+0000","last_fullsized":"2024-03-20T13:38:11.048631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:16.107824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348452+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:37:17.348452+0000","last_peered":"2024-03-20T13:37:17.348452+0000","last_clean":"2024-03-20T13:37:17.348452+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:37:17.348452+0000","last_undegraded":"2024-03-20T13:37:17.348452+0000","last_fullsized":"2024-03-20T13:37:17.348452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:49:35.289474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350154+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:37:17.350154+0000","last_peered":"2024-03-20T13:37:17.350154+0000","last_clean":"2024-03-20T13:37:17.350154+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:37:17.350154+0000","last_undegraded":"2024-03-20T13:37:17.350154+0000","last_fullsized":"2024-03-20T13:37:17.350154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353282+0000","last_change":"2024-03-20T13:36:40.846094+0000","last_active":"2024-03-20T13:37:17.353282+0000","last_peered":"2024-03-20T13:37:17.353282+0000","last_clean":"2024-03-20T13:37:17.353282+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:37:17.353282+0000","last_undegraded":"2024-03-20T13:37:17.353282+0000","last_fullsized":"2024-03-20T13:37:17.353282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:25:10.138463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.375043+0000","last_change":"2024-03-20T13:36:42.847334+0000","last_active":"2024-03-20T13:38:05.375043+0000","last_peered":"2024-03-20T13:38:05.375043+0000","last_clean":"2024-03-20T13:38:05.375043+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:05.375043+0000","last_undegraded":"2024-03-20T13:38:05.375043+0000","last_fullsized":"2024-03-20T13:38:05.375043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361433+0000","last_change":"2024-03-20T13:36:44.900807+0000","last_active":"2024-03-20T13:37:17.361433+0000","last_peered":"2024-03-20T13:37:17.361433+0000","last_clean":"2024-03-20T13:37:17.361433+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:37:17.361433+0000","last_undegraded":"2024-03-20T13:37:17.361433+0000","last_fullsized":"2024-03-20T13:37:17.361433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341228+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:37:17.341228+0000","last_peered":"2024-03-20T13:37:17.341228+0000","last_clean":"2024-03-20T13:37:17.341228+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:37:17.341228+0000","last_undegraded":"2024-03-20T13:37:17.341228+0000","last_fullsized":"2024-03-20T13:37:17.341228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:47.541449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559479+0000","last_change":"2024-03-20T13:36:38.835114+0000","last_active":"2024-03-20T13:38:04.559479+0000","last_peered":"2024-03-20T13:38:04.559479+0000","last_clean":"2024-03-20T13:38:04.559479+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:38:04.559479+0000","last_undegraded":"2024-03-20T13:38:04.559479+0000","last_fullsized":"2024-03-20T13:38:04.559479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:02.712312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356076+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:37:17.356076+0000","last_peered":"2024-03-20T13:37:17.356076+0000","last_clean":"2024-03-20T13:37:17.356076+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:37:17.356076+0000","last_undegraded":"2024-03-20T13:37:17.356076+0000","last_fullsized":"2024-03-20T13:37:17.356076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:36:17.674002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353028+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:37:17.353028+0000","last_peered":"2024-03-20T13:37:17.353028+0000","last_clean":"2024-03-20T13:37:17.353028+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.353028+0000","last_undegraded":"2024-03-20T13:37:17.353028+0000","last_fullsized":"2024-03-20T13:37:17.353028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:01:29.010451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337078+0000","last_change":"2024-03-20T13:36:40.847185+0000","last_active":"2024-03-20T13:37:17.337078+0000","last_peered":"2024-03-20T13:37:17.337078+0000","last_clean":"2024-03-20T13:37:17.337078+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:37:17.337078+0000","last_undegraded":"2024-03-20T13:37:17.337078+0000","last_fullsized":"2024-03-20T13:37:17.337078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:07:18.240810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'56","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.978774+0000","last_change":"2024-03-20T13:36:42.851741+0000","last_active":"2024-03-20T13:38:10.978774+0000","last_peered":"2024-03-20T13:38:10.978774+0000","last_clean":"2024-03-20T13:38:10.978774+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:10.978774+0000","last_undegraded":"2024-03-20T13:38:10.978774+0000","last_fullsized":"2024-03-20T13:38:10.978774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:54:44.968029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347209+0000","last_change":"2024-03-20T13:36:44.869776+0000","last_active":"2024-03-20T13:37:17.347209+0000","last_peered":"2024-03-20T13:37:17.347209+0000","last_clean":"2024-03-20T13:37:17.347209+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:37:17.347209+0000","last_undegraded":"2024-03-20T13:37:17.347209+0000","last_fullsized":"2024-03-20T13:37:17.347209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.347425+0000","last_change":"2024-03-20T13:36:46.889089+0000","last_active":"2024-03-20T13:38:05.347425+0000","last_peered":"2024-03-20T13:38:05.347425+0000","last_clean":"2024-03-20T13:38:05.347425+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:05.347425+0000","last_undegraded":"2024-03-20T13:38:05.347425+0000","last_fullsized":"2024-03-20T13:38:05.347425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:44.885863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.805147+0000","last_change":"2024-03-20T13:36:38.827949+0000","last_active":"2024-03-20T13:37:22.805147+0000","last_peered":"2024-03-20T13:37:22.805147+0000","last_clean":"2024-03-20T13:37:22.805147+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:37:22.805147+0000","last_undegraded":"2024-03-20T13:37:22.805147+0000","last_fullsized":"2024-03-20T13:37:22.805147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:06.009730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353286+0000","last_change":"2024-03-20T13:36:36.830990+0000","last_active":"2024-03-20T13:37:17.353286+0000","last_peered":"2024-03-20T13:37:17.353286+0000","last_clean":"2024-03-20T13:37:17.353286+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:37:17.353286+0000","last_undegraded":"2024-03-20T13:37:17.353286+0000","last_fullsized":"2024-03-20T13:37:17.353286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:34.861573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354027+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:37:17.354027+0000","last_peered":"2024-03-20T13:37:17.354027+0000","last_clean":"2024-03-20T13:37:17.354027+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:37:17.354027+0000","last_undegraded":"2024-03-20T13:37:17.354027+0000","last_fullsized":"2024-03-20T13:37:17.354027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:05.095676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348014+0000","last_change":"2024-03-20T13:36:40.850909+0000","last_active":"2024-03-20T13:37:17.348014+0000","last_peered":"2024-03-20T13:37:17.348014+0000","last_clean":"2024-03-20T13:37:17.348014+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:37:17.348014+0000","last_undegraded":"2024-03-20T13:37:17.348014+0000","last_fullsized":"2024-03-20T13:37:17.348014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341928+0000","last_change":"2024-03-20T13:36:42.864332+0000","last_active":"2024-03-20T13:37:17.341928+0000","last_peered":"2024-03-20T13:37:17.341928+0000","last_clean":"2024-03-20T13:37:17.341928+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:37:17.341928+0000","last_undegraded":"2024-03-20T13:37:17.341928+0000","last_fullsized":"2024-03-20T13:37:17.341928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:16.666345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'240","reported_seq":318,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.267232+0000","last_change":"2024-03-20T13:36:44.872646+0000","last_active":"2024-03-20T13:38:11.267232+0000","last_peered":"2024-03-20T13:38:11.267232+0000","last_clean":"2024-03-20T13:38:11.267232+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:11.267232+0000","last_undegraded":"2024-03-20T13:38:11.267232+0000","last_fullsized":"2024-03-20T13:38:11.267232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:04.548860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358653+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:37:17.358653+0000","last_peered":"2024-03-20T13:37:17.358653+0000","last_clean":"2024-03-20T13:37:17.358653+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:37:17.358653+0000","last_undegraded":"2024-03-20T13:37:17.358653+0000","last_fullsized":"2024-03-20T13:37:17.358653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.098925+0000","last_change":"2024-03-20T13:36:38.813661+0000","last_active":"2024-03-20T13:37:22.098925+0000","last_peered":"2024-03-20T13:37:22.098925+0000","last_clean":"2024-03-20T13:37:22.098925+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:37:22.098925+0000","last_undegraded":"2024-03-20T13:37:22.098925+0000","last_fullsized":"2024-03-20T13:37:22.098925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362921+0000","last_change":"2024-03-20T13:36:36.847617+0000","last_active":"2024-03-20T13:37:17.362921+0000","last_peered":"2024-03-20T13:37:17.362921+0000","last_clean":"2024-03-20T13:37:17.362921+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:37:17.362921+0000","last_undegraded":"2024-03-20T13:37:17.362921+0000","last_fullsized":"2024-03-20T13:37:17.362921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360074+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:37:17.360074+0000","last_peered":"2024-03-20T13:37:17.360074+0000","last_clean":"2024-03-20T13:37:17.360074+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:37:17.360074+0000","last_undegraded":"2024-03-20T13:37:17.360074+0000","last_fullsized":"2024-03-20T13:37:17.360074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:06.931743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349095+0000","last_change":"2024-03-20T13:36:40.857874+0000","last_active":"2024-03-20T13:37:17.349095+0000","last_peered":"2024-03-20T13:37:17.349095+0000","last_clean":"2024-03-20T13:37:17.349095+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:37:17.349095+0000","last_undegraded":"2024-03-20T13:37:17.349095+0000","last_fullsized":"2024-03-20T13:37:17.349095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:18:26.064828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358074+0000","last_change":"2024-03-20T13:36:42.855371+0000","last_active":"2024-03-20T13:37:17.358074+0000","last_peered":"2024-03-20T13:37:17.358074+0000","last_clean":"2024-03-20T13:37:17.358074+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:37:17.358074+0000","last_undegraded":"2024-03-20T13:37:17.358074+0000","last_fullsized":"2024-03-20T13:37:17.358074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:58:21.419980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'240","reported_seq":316,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.273749+0000","last_change":"2024-03-20T13:36:44.894325+0000","last_active":"2024-03-20T13:38:11.273749+0000","last_peered":"2024-03-20T13:38:11.273749+0000","last_clean":"2024-03-20T13:38:11.273749+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:11.273749+0000","last_undegraded":"2024-03-20T13:38:11.273749+0000","last_fullsized":"2024-03-20T13:38:11.273749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:59.125889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.777950+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:37:21.777950+0000","last_peered":"2024-03-20T13:37:21.777950+0000","last_clean":"2024-03-20T13:37:21.777950+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:37:21.777950+0000","last_undegraded":"2024-03-20T13:37:21.777950+0000","last_fullsized":"2024-03-20T13:37:21.777950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:41.446025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099051+0000","last_change":"2024-03-20T13:36:38.825848+0000","last_active":"2024-03-20T13:37:22.099051+0000","last_peered":"2024-03-20T13:37:22.099051+0000","last_clean":"2024-03-20T13:37:22.099051+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:37:22.099051+0000","last_undegraded":"2024-03-20T13:37:22.099051+0000","last_fullsized":"2024-03-20T13:37:22.099051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:41.028184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358700+0000","last_change":"2024-03-20T13:36:36.831337+0000","last_active":"2024-03-20T13:37:17.358700+0000","last_peered":"2024-03-20T13:37:17.358700+0000","last_clean":"2024-03-20T13:37:17.358700+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:37:17.358700+0000","last_undegraded":"2024-03-20T13:37:17.358700+0000","last_fullsized":"2024-03-20T13:37:17.358700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:05.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353981+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:37:17.353981+0000","last_peered":"2024-03-20T13:37:17.353981+0000","last_clean":"2024-03-20T13:37:17.353981+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:37:17.353981+0000","last_undegraded":"2024-03-20T13:37:17.353981+0000","last_fullsized":"2024-03-20T13:37:17.353981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:22.659362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.366089+0000","last_change":"2024-03-20T13:37:17.366089+0000","last_active":"2024-03-20T13:37:17.366089+0000","last_peered":"2024-03-20T13:37:17.366089+0000","last_clean":"2024-03-20T13:37:17.366089+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:37:17.366089+0000","last_undegraded":"2024-03-20T13:37:17.366089+0000","last_fullsized":"2024-03-20T13:37:17.366089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:48.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'77","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.974362+0000","last_change":"2024-03-20T13:36:42.842883+0000","last_active":"2024-03-20T13:38:10.974362+0000","last_peered":"2024-03-20T13:38:10.974362+0000","last_clean":"2024-03-20T13:38:10.974362+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:10.974362+0000","last_undegraded":"2024-03-20T13:38:10.974362+0000","last_fullsized":"2024-03-20T13:38:10.974362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:47.727785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357474+0000","last_change":"2024-03-20T13:36:44.894727+0000","last_active":"2024-03-20T13:37:17.357474+0000","last_peered":"2024-03-20T13:37:17.357474+0000","last_clean":"2024-03-20T13:37:17.357474+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:37:17.357474+0000","last_undegraded":"2024-03-20T13:37:17.357474+0000","last_fullsized":"2024-03-20T13:37:17.357474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:11.857697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339944+0000","last_change":"2024-03-20T13:36:46.888822+0000","last_active":"2024-03-20T13:37:17.339944+0000","last_peered":"2024-03-20T13:37:17.339944+0000","last_clean":"2024-03-20T13:37:17.339944+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:37:17.339944+0000","last_undegraded":"2024-03-20T13:37:17.339944+0000","last_fullsized":"2024-03-20T13:37:17.339944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:28:05.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345713+0000","last_change":"2024-03-20T13:36:46.889735+0000","last_active":"2024-03-20T13:37:17.345713+0000","last_peered":"2024-03-20T13:37:17.345713+0000","last_clean":"2024-03-20T13:37:17.345713+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:37:17.345713+0000","last_undegraded":"2024-03-20T13:37:17.345713+0000","last_fullsized":"2024-03-20T13:37:17.345713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:26.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038995+0000","last_change":"2024-03-20T13:36:38.826974+0000","last_active":"2024-03-20T13:38:11.038995+0000","last_peered":"2024-03-20T13:38:11.038995+0000","last_clean":"2024-03-20T13:38:11.038995+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:11.038995+0000","last_undegraded":"2024-03-20T13:38:11.038995+0000","last_fullsized":"2024-03-20T13:38:11.038995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:47.853154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346955+0000","last_change":"2024-03-20T13:36:40.845473+0000","last_active":"2024-03-20T13:37:17.346955+0000","last_peered":"2024-03-20T13:37:17.346955+0000","last_clean":"2024-03-20T13:37:17.346955+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:37:17.346955+0000","last_undegraded":"2024-03-20T13:37:17.346955+0000","last_fullsized":"2024-03-20T13:37:17.346955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:45:53.190145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.331149+0000","last_change":"2024-03-20T13:36:42.865392+0000","last_active":"2024-03-20T13:38:05.331149+0000","last_peered":"2024-03-20T13:38:05.331149+0000","last_clean":"2024-03-20T13:38:05.331149+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:05.331149+0000","last_undegraded":"2024-03-20T13:38:05.331149+0000","last_fullsized":"2024-03-20T13:38:05.331149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:23.969005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338712+0000","last_change":"2024-03-20T13:36:44.884122+0000","last_active":"2024-03-20T13:37:17.338712+0000","last_peered":"2024-03-20T13:37:17.338712+0000","last_clean":"2024-03-20T13:37:17.338712+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:37:17.338712+0000","last_undegraded":"2024-03-20T13:37:17.338712+0000","last_fullsized":"2024-03-20T13:37:17.338712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:16:30.331163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361092+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:37:17.361092+0000","last_peered":"2024-03-20T13:37:17.361092+0000","last_clean":"2024-03-20T13:37:17.361092+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:37:17.361092+0000","last_undegraded":"2024-03-20T13:37:17.361092+0000","last_fullsized":"2024-03-20T13:37:17.361092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099295+0000","last_change":"2024-03-20T13:36:38.835372+0000","last_active":"2024-03-20T13:37:22.099295+0000","last_peered":"2024-03-20T13:37:22.099295+0000","last_clean":"2024-03-20T13:37:22.099295+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:37:22.099295+0000","last_undegraded":"2024-03-20T13:37:22.099295+0000","last_fullsized":"2024-03-20T13:37:22.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:34.776234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340380+0000","last_change":"2024-03-20T13:36:36.812213+0000","last_active":"2024-03-20T13:37:17.340380+0000","last_peered":"2024-03-20T13:37:17.340380+0000","last_clean":"2024-03-20T13:37:17.340380+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:37:17.340380+0000","last_undegraded":"2024-03-20T13:37:17.340380+0000","last_fullsized":"2024-03-20T13:37:17.340380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:43.391446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348705+0000","last_change":"2024-03-20T13:36:40.849295+0000","last_active":"2024-03-20T13:37:17.348705+0000","last_peered":"2024-03-20T13:37:17.348705+0000","last_clean":"2024-03-20T13:37:17.348705+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:37:17.348705+0000","last_undegraded":"2024-03-20T13:37:17.348705+0000","last_fullsized":"2024-03-20T13:37:17.348705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:20.801941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:57.995056+0000","last_change":"2024-03-20T13:36:42.861263+0000","last_active":"2024-03-20T13:37:57.995056+0000","last_peered":"2024-03-20T13:37:57.995056+0000","last_clean":"2024-03-20T13:37:57.995056+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:37:57.995056+0000","last_undegraded":"2024-03-20T13:37:57.995056+0000","last_fullsized":"2024-03-20T13:37:57.995056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:19.148076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335656+0000","last_change":"2024-03-20T13:36:44.868223+0000","last_active":"2024-03-20T13:37:17.335656+0000","last_peered":"2024-03-20T13:37:17.335656+0000","last_clean":"2024-03-20T13:37:17.335656+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:37:17.335656+0000","last_undegraded":"2024-03-20T13:37:17.335656+0000","last_fullsized":"2024-03-20T13:37:17.335656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:27.229079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.348498+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:05.348498+0000","last_peered":"2024-03-20T13:38:05.348498+0000","last_clean":"2024-03-20T13:38:05.348498+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:05.348498+0000","last_undegraded":"2024-03-20T13:38:05.348498+0000","last_fullsized":"2024-03-20T13:38:05.348498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:11:03.011925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347543+0000","last_change":"2024-03-20T13:36:38.830562+0000","last_active":"2024-03-20T13:37:17.347543+0000","last_peered":"2024-03-20T13:37:17.347543+0000","last_clean":"2024-03-20T13:37:17.347543+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:37:17.347543+0000","last_undegraded":"2024-03-20T13:37:17.347543+0000","last_fullsized":"2024-03-20T13:37:17.347543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354095+0000","last_change":"2024-03-20T13:36:36.836705+0000","last_active":"2024-03-20T13:37:17.354095+0000","last_peered":"2024-03-20T13:37:17.354095+0000","last_clean":"2024-03-20T13:37:17.354095+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:37:17.354095+0000","last_undegraded":"2024-03-20T13:37:17.354095+0000","last_fullsized":"2024-03-20T13:37:17.354095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346933+0000","last_change":"2024-03-20T13:36:40.855508+0000","last_active":"2024-03-20T13:37:17.346933+0000","last_peered":"2024-03-20T13:37:17.346933+0000","last_clean":"2024-03-20T13:37:17.346933+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:37:17.346933+0000","last_undegraded":"2024-03-20T13:37:17.346933+0000","last_fullsized":"2024-03-20T13:37:17.346933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'34","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.731549+0000","last_change":"2024-03-20T13:36:42.868367+0000","last_active":"2024-03-20T13:38:10.731549+0000","last_peered":"2024-03-20T13:38:10.731549+0000","last_clean":"2024-03-20T13:38:10.731549+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:10.731549+0000","last_undegraded":"2024-03-20T13:38:10.731549+0000","last_fullsized":"2024-03-20T13:38:10.731549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:24.991506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345357+0000","last_change":"2024-03-20T13:36:44.888584+0000","last_active":"2024-03-20T13:37:17.345357+0000","last_peered":"2024-03-20T13:37:17.345357+0000","last_clean":"2024-03-20T13:37:17.345357+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:37:17.345357+0000","last_undegraded":"2024-03-20T13:37:17.345357+0000","last_fullsized":"2024-03-20T13:37:17.345357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:50.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349560+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:37:17.349560+0000","last_peered":"2024-03-20T13:37:17.349560+0000","last_clean":"2024-03-20T13:37:17.349560+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:37:17.349560+0000","last_undegraded":"2024-03-20T13:37:17.349560+0000","last_fullsized":"2024-03-20T13:37:17.349560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370915+0000","last_change":"2024-03-20T13:36:38.834173+0000","last_active":"2024-03-20T13:38:05.370915+0000","last_peered":"2024-03-20T13:38:05.370915+0000","last_clean":"2024-03-20T13:38:05.370915+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:05.370915+0000","last_undegraded":"2024-03-20T13:38:05.370915+0000","last_fullsized":"2024-03-20T13:38:05.370915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:44.080119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353785+0000","last_change":"2024-03-20T13:36:36.829532+0000","last_active":"2024-03-20T13:37:17.353785+0000","last_peered":"2024-03-20T13:37:17.353785+0000","last_clean":"2024-03-20T13:37:17.353785+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:37:17.353785+0000","last_undegraded":"2024-03-20T13:37:17.353785+0000","last_fullsized":"2024-03-20T13:37:17.353785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:30:12.679787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339023+0000","last_change":"2024-03-20T13:36:40.852289+0000","last_active":"2024-03-20T13:37:17.339023+0000","last_peered":"2024-03-20T13:37:17.339023+0000","last_clean":"2024-03-20T13:37:17.339023+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:37:17.339023+0000","last_undegraded":"2024-03-20T13:37:17.339023+0000","last_fullsized":"2024-03-20T13:37:17.339023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:08.730342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.306851+0000","last_change":"2024-03-20T13:36:42.860451+0000","last_active":"2024-03-20T13:38:05.306851+0000","last_peered":"2024-03-20T13:38:05.306851+0000","last_clean":"2024-03-20T13:38:05.306851+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:05.306851+0000","last_undegraded":"2024-03-20T13:38:05.306851+0000","last_fullsized":"2024-03-20T13:38:05.306851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336298+0000","last_change":"2024-03-20T13:36:44.862966+0000","last_active":"2024-03-20T13:37:17.336298+0000","last_peered":"2024-03-20T13:37:17.336298+0000","last_clean":"2024-03-20T13:37:17.336298+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:37:17.336298+0000","last_undegraded":"2024-03-20T13:37:17.336298+0000","last_fullsized":"2024-03-20T13:37:17.336298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:59.751229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103956+0000","last_change":"2024-03-20T13:36:38.832438+0000","last_active":"2024-03-20T13:37:22.103956+0000","last_peered":"2024-03-20T13:37:22.103956+0000","last_clean":"2024-03-20T13:37:22.103956+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:37:22.103956+0000","last_undegraded":"2024-03-20T13:37:22.103956+0000","last_fullsized":"2024-03-20T13:37:22.103956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:40.231347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339417+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:37:17.339417+0000","last_peered":"2024-03-20T13:37:17.339417+0000","last_clean":"2024-03-20T13:37:17.339417+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:37:17.339417+0000","last_undegraded":"2024-03-20T13:37:17.339417+0000","last_fullsized":"2024-03-20T13:37:17.339417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:42.936647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353909+0000","last_change":"2024-03-20T13:36:40.854924+0000","last_active":"2024-03-20T13:37:17.353909+0000","last_peered":"2024-03-20T13:37:17.353909+0000","last_clean":"2024-03-20T13:37:17.353909+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:37:17.353909+0000","last_undegraded":"2024-03-20T13:37:17.353909+0000","last_fullsized":"2024-03-20T13:37:17.353909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:58:14.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.965535+0000","last_change":"2024-03-20T13:37:17.384644+0000","last_active":"2024-03-20T13:38:10.965535+0000","last_peered":"2024-03-20T13:38:10.965535+0000","last_clean":"2024-03-20T13:38:10.965535+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:10.965535+0000","last_undegraded":"2024-03-20T13:38:10.965535+0000","last_fullsized":"2024-03-20T13:38:10.965535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:24.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337105+0000","last_change":"2024-03-20T13:36:44.873958+0000","last_active":"2024-03-20T13:37:17.337105+0000","last_peered":"2024-03-20T13:37:17.337105+0000","last_clean":"2024-03-20T13:37:17.337105+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:37:17.337105+0000","last_undegraded":"2024-03-20T13:37:17.337105+0000","last_fullsized":"2024-03-20T13:37:17.337105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:20.295832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.704046+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:04.704046+0000","last_peered":"2024-03-20T13:38:04.704046+0000","last_clean":"2024-03-20T13:38:04.704046+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:04.704046+0000","last_undegraded":"2024-03-20T13:38:04.704046+0000","last_fullsized":"2024-03-20T13:38:04.704046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:33.949395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559430+0000","last_change":"2024-03-20T13:36:38.834011+0000","last_active":"2024-03-20T13:38:04.559430+0000","last_peered":"2024-03-20T13:38:04.559430+0000","last_clean":"2024-03-20T13:38:04.559430+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:38:04.559430+0000","last_undegraded":"2024-03-20T13:38:04.559430+0000","last_fullsized":"2024-03-20T13:38:04.559430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:02.478170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342800+0000","last_change":"2024-03-20T13:36:36.833334+0000","last_active":"2024-03-20T13:37:17.342800+0000","last_peered":"2024-03-20T13:37:17.342800+0000","last_clean":"2024-03-20T13:37:17.342800+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:37:17.342800+0000","last_undegraded":"2024-03-20T13:37:17.342800+0000","last_fullsized":"2024-03-20T13:37:17.342800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:40.299686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353658+0000","last_change":"2024-03-20T13:36:40.840832+0000","last_active":"2024-03-20T13:37:17.353658+0000","last_peered":"2024-03-20T13:37:17.353658+0000","last_clean":"2024-03-20T13:37:17.353658+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:37:17.353658+0000","last_undegraded":"2024-03-20T13:37:17.353658+0000","last_fullsized":"2024-03-20T13:37:17.353658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:18:58.479248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.309071+0000","last_change":"2024-03-20T13:36:42.860856+0000","last_active":"2024-03-20T13:38:05.309071+0000","last_peered":"2024-03-20T13:38:05.309071+0000","last_clean":"2024-03-20T13:38:05.309071+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:05.309071+0000","last_undegraded":"2024-03-20T13:38:05.309071+0000","last_fullsized":"2024-03-20T13:38:05.309071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:44:34.562790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350102+0000","last_change":"2024-03-20T13:36:44.880578+0000","last_active":"2024-03-20T13:37:17.350102+0000","last_peered":"2024-03-20T13:37:17.350102+0000","last_clean":"2024-03-20T13:37:17.350102+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:37:17.350102+0000","last_undegraded":"2024-03-20T13:37:17.350102+0000","last_fullsized":"2024-03-20T13:37:17.350102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:33:34.967987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347355+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:37:17.347355+0000","last_peered":"2024-03-20T13:37:17.347355+0000","last_clean":"2024-03-20T13:37:17.347355+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:37:17.347355+0000","last_undegraded":"2024-03-20T13:37:17.347355+0000","last_fullsized":"2024-03-20T13:37:17.347355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358358+0000","last_change":"2024-03-20T13:36:38.839355+0000","last_active":"2024-03-20T13:37:17.358358+0000","last_peered":"2024-03-20T13:37:17.358358+0000","last_clean":"2024-03-20T13:37:17.358358+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:37:17.358358+0000","last_undegraded":"2024-03-20T13:37:17.358358+0000","last_fullsized":"2024-03-20T13:37:17.358358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349222+0000","last_change":"2024-03-20T13:36:36.835178+0000","last_active":"2024-03-20T13:37:17.349222+0000","last_peered":"2024-03-20T13:37:17.349222+0000","last_clean":"2024-03-20T13:37:17.349222+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:37:17.349222+0000","last_undegraded":"2024-03-20T13:37:17.349222+0000","last_fullsized":"2024-03-20T13:37:17.349222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354014+0000","last_change":"2024-03-20T13:36:40.859670+0000","last_active":"2024-03-20T13:37:17.354014+0000","last_peered":"2024-03-20T13:37:17.354014+0000","last_clean":"2024-03-20T13:37:17.354014+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:37:17.354014+0000","last_undegraded":"2024-03-20T13:37:17.354014+0000","last_fullsized":"2024-03-20T13:37:17.354014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:03.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.337993+0000","last_change":"2024-03-20T13:36:42.853208+0000","last_active":"2024-03-20T13:38:05.337993+0000","last_peered":"2024-03-20T13:38:05.337993+0000","last_clean":"2024-03-20T13:38:05.337993+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:05.337993+0000","last_undegraded":"2024-03-20T13:38:05.337993+0000","last_fullsized":"2024-03-20T13:38:05.337993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353489+0000","last_change":"2024-03-20T13:36:44.881033+0000","last_active":"2024-03-20T13:37:17.353489+0000","last_peered":"2024-03-20T13:37:17.353489+0000","last_clean":"2024-03-20T13:37:17.353489+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:37:17.353489+0000","last_undegraded":"2024-03-20T13:37:17.353489+0000","last_fullsized":"2024-03-20T13:37:17.353489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:51:03.967670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346808+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:37:17.346808+0000","last_peered":"2024-03-20T13:37:17.346808+0000","last_clean":"2024-03-20T13:37:17.346808+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:37:17.346808+0000","last_undegraded":"2024-03-20T13:37:17.346808+0000","last_fullsized":"2024-03-20T13:37:17.346808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340185+0000","last_change":"2024-03-20T13:36:38.841841+0000","last_active":"2024-03-20T13:37:17.340185+0000","last_peered":"2024-03-20T13:37:17.340185+0000","last_clean":"2024-03-20T13:37:17.340185+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:37:17.340185+0000","last_undegraded":"2024-03-20T13:37:17.340185+0000","last_fullsized":"2024-03-20T13:37:17.340185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:32.797279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355510+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:37:17.355510+0000","last_peered":"2024-03-20T13:37:17.355510+0000","last_clean":"2024-03-20T13:37:17.355510+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:37:17.355510+0000","last_undegraded":"2024-03-20T13:37:17.355510+0000","last_fullsized":"2024-03-20T13:37:17.355510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:33:21.986721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351081+0000","last_change":"2024-03-20T13:36:40.847481+0000","last_active":"2024-03-20T13:37:17.351081+0000","last_peered":"2024-03-20T13:37:17.351081+0000","last_clean":"2024-03-20T13:37:17.351081+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:37:17.351081+0000","last_undegraded":"2024-03-20T13:37:17.351081+0000","last_fullsized":"2024-03-20T13:37:17.351081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:49.265948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358102+0000","last_change":"2024-03-20T13:36:42.846652+0000","last_active":"2024-03-20T13:37:17.358102+0000","last_peered":"2024-03-20T13:37:17.358102+0000","last_clean":"2024-03-20T13:37:17.358102+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:37:17.358102+0000","last_undegraded":"2024-03-20T13:37:17.358102+0000","last_fullsized":"2024-03-20T13:37:17.358102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'240","reported_seq":304,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.266733+0000","last_change":"2024-03-20T13:36:44.870739+0000","last_active":"2024-03-20T13:38:11.266733+0000","last_peered":"2024-03-20T13:38:11.266733+0000","last_clean":"2024-03-20T13:38:11.266733+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:11.266733+0000","last_undegraded":"2024-03-20T13:38:11.266733+0000","last_fullsized":"2024-03-20T13:38:11.266733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:00:28.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346663+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:37:17.346663+0000","last_peered":"2024-03-20T13:37:17.346663+0000","last_clean":"2024-03-20T13:37:17.346663+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:37:17.346663+0000","last_undegraded":"2024-03-20T13:37:17.346663+0000","last_fullsized":"2024-03-20T13:37:17.346663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.774657+0000","last_change":"2024-03-20T13:36:38.838732+0000","last_active":"2024-03-20T13:37:21.774657+0000","last_peered":"2024-03-20T13:37:21.774657+0000","last_clean":"2024-03-20T13:37:21.774657+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:37:21.774657+0000","last_undegraded":"2024-03-20T13:37:21.774657+0000","last_fullsized":"2024-03-20T13:37:21.774657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:57.039567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352407+0000","last_change":"2024-03-20T13:36:36.847653+0000","last_active":"2024-03-20T13:37:17.352407+0000","last_peered":"2024-03-20T13:37:17.352407+0000","last_clean":"2024-03-20T13:37:17.352407+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:37:17.352407+0000","last_undegraded":"2024-03-20T13:37:17.352407+0000","last_fullsized":"2024-03-20T13:37:17.352407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:01:47.804240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":192,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.062892+0000","last_change":"2024-03-20T13:36:40.851669+0000","last_active":"2024-03-20T13:38:12.062892+0000","last_peered":"2024-03-20T13:38:12.062892+0000","last_clean":"2024-03-20T13:38:12.062892+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:12.062892+0000","last_undegraded":"2024-03-20T13:38:12.062892+0000","last_fullsized":"2024-03-20T13:38:12.062892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:16.049885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'34","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.294210+0000","last_change":"2024-03-20T13:36:42.876652+0000","last_active":"2024-03-20T13:38:05.294210+0000","last_peered":"2024-03-20T13:38:05.294210+0000","last_clean":"2024-03-20T13:38:05.294210+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:05.294210+0000","last_undegraded":"2024-03-20T13:38:05.294210+0000","last_fullsized":"2024-03-20T13:38:05.294210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338477+0000","last_change":"2024-03-20T13:36:44.880706+0000","last_active":"2024-03-20T13:37:17.338477+0000","last_peered":"2024-03-20T13:37:17.338477+0000","last_clean":"2024-03-20T13:37:17.338477+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:37:17.338477+0000","last_undegraded":"2024-03-20T13:37:17.338477+0000","last_fullsized":"2024-03-20T13:37:17.338477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:51.535549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354658+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:37:17.354658+0000","last_peered":"2024-03-20T13:37:17.354658+0000","last_clean":"2024-03-20T13:37:17.354658+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:37:17.354658+0000","last_undegraded":"2024-03-20T13:37:17.354658+0000","last_fullsized":"2024-03-20T13:37:17.354658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350635+0000","last_change":"2024-03-20T13:36:38.827830+0000","last_active":"2024-03-20T13:37:17.350635+0000","last_peered":"2024-03-20T13:37:17.350635+0000","last_clean":"2024-03-20T13:37:17.350635+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:37:17.350635+0000","last_undegraded":"2024-03-20T13:37:17.350635+0000","last_fullsized":"2024-03-20T13:37:17.350635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353488+0000","last_change":"2024-03-20T13:36:36.837596+0000","last_active":"2024-03-20T13:37:17.353488+0000","last_peered":"2024-03-20T13:37:17.353488+0000","last_clean":"2024-03-20T13:37:17.353488+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:37:17.353488+0000","last_undegraded":"2024-03-20T13:37:17.353488+0000","last_fullsized":"2024-03-20T13:37:17.353488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":199,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:12.188469+0000","last_change":"2024-03-20T13:36:40.851969+0000","last_active":"2024-03-20T13:38:12.188469+0000","last_peered":"2024-03-20T13:38:12.188469+0000","last_clean":"2024-03-20T13:38:12.188469+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:12.188469+0000","last_undegraded":"2024-03-20T13:38:12.188469+0000","last_fullsized":"2024-03-20T13:38:12.188469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:05.906039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'28","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.294273+0000","last_change":"2024-03-20T13:36:42.863180+0000","last_active":"2024-03-20T13:38:05.294273+0000","last_peered":"2024-03-20T13:38:05.294273+0000","last_clean":"2024-03-20T13:38:05.294273+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:05.294273+0000","last_undegraded":"2024-03-20T13:38:05.294273+0000","last_fullsized":"2024-03-20T13:38:05.294273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:45:02.764876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347146+0000","last_change":"2024-03-20T13:36:44.869579+0000","last_active":"2024-03-20T13:37:17.347146+0000","last_peered":"2024-03-20T13:37:17.347146+0000","last_clean":"2024-03-20T13:37:17.347146+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:37:17.347146+0000","last_undegraded":"2024-03-20T13:37:17.347146+0000","last_fullsized":"2024-03-20T13:37:17.347146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.022745+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:11.022745+0000","last_peered":"2024-03-20T13:38:11.022745+0000","last_clean":"2024-03-20T13:38:11.022745+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:11.022745+0000","last_undegraded":"2024-03-20T13:38:11.022745+0000","last_fullsized":"2024-03-20T13:38:11.022745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560346+0000","last_change":"2024-03-20T13:36:38.826048+0000","last_active":"2024-03-20T13:38:04.560346+0000","last_peered":"2024-03-20T13:38:04.560346+0000","last_clean":"2024-03-20T13:38:04.560346+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:38:04.560346+0000","last_undegraded":"2024-03-20T13:38:04.560346+0000","last_fullsized":"2024-03-20T13:38:04.560346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:34:12.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362384+0000","last_change":"2024-03-20T13:36:36.848516+0000","last_active":"2024-03-20T13:37:17.362384+0000","last_peered":"2024-03-20T13:37:17.362384+0000","last_clean":"2024-03-20T13:37:17.362384+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:37:17.362384+0000","last_undegraded":"2024-03-20T13:37:17.362384+0000","last_fullsized":"2024-03-20T13:37:17.362384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343154+0000","last_change":"2024-03-20T13:36:40.851382+0000","last_active":"2024-03-20T13:37:17.343154+0000","last_peered":"2024-03-20T13:37:17.343154+0000","last_clean":"2024-03-20T13:37:17.343154+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:37:17.343154+0000","last_undegraded":"2024-03-20T13:37:17.343154+0000","last_fullsized":"2024-03-20T13:37:17.343154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:56.202294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'24","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.334890+0000","last_change":"2024-03-20T13:36:42.845176+0000","last_active":"2024-03-20T13:38:05.334890+0000","last_peered":"2024-03-20T13:38:05.334890+0000","last_clean":"2024-03-20T13:38:05.334890+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:05.334890+0000","last_undegraded":"2024-03-20T13:38:05.334890+0000","last_fullsized":"2024-03-20T13:38:05.334890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:22.548562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348416+0000","last_change":"2024-03-20T13:36:44.871360+0000","last_active":"2024-03-20T13:37:17.348416+0000","last_peered":"2024-03-20T13:37:17.348416+0000","last_clean":"2024-03-20T13:37:17.348416+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:37:17.348416+0000","last_undegraded":"2024-03-20T13:37:17.348416+0000","last_fullsized":"2024-03-20T13:37:17.348416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.055574+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:37:22.055574+0000","last_peered":"2024-03-20T13:37:22.055574+0000","last_clean":"2024-03-20T13:37:22.055574+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:37:22.055574+0000","last_undegraded":"2024-03-20T13:37:22.055574+0000","last_fullsized":"2024-03-20T13:37:22.055574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103962+0000","last_change":"2024-03-20T13:36:38.844162+0000","last_active":"2024-03-20T13:37:22.103962+0000","last_peered":"2024-03-20T13:37:22.103962+0000","last_clean":"2024-03-20T13:37:22.103962+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:37:22.103962+0000","last_undegraded":"2024-03-20T13:37:22.103962+0000","last_fullsized":"2024-03-20T13:37:22.103962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354264+0000","last_change":"2024-03-20T13:36:36.832558+0000","last_active":"2024-03-20T13:37:17.354264+0000","last_peered":"2024-03-20T13:37:17.354264+0000","last_clean":"2024-03-20T13:37:17.354264+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:37:17.354264+0000","last_undegraded":"2024-03-20T13:37:17.354264+0000","last_fullsized":"2024-03-20T13:37:17.354264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:27.481357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342345+0000","last_change":"2024-03-20T13:36:40.857715+0000","last_active":"2024-03-20T13:37:17.342345+0000","last_peered":"2024-03-20T13:37:17.342345+0000","last_clean":"2024-03-20T13:37:17.342345+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:37:17.342345+0000","last_undegraded":"2024-03-20T13:37:17.342345+0000","last_fullsized":"2024-03-20T13:37:17.342345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:54.489899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'29","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.012261+0000","last_change":"2024-03-20T13:36:42.860634+0000","last_active":"2024-03-20T13:38:11.012261+0000","last_peered":"2024-03-20T13:38:11.012261+0000","last_clean":"2024-03-20T13:38:11.012261+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:11.012261+0000","last_undegraded":"2024-03-20T13:38:11.012261+0000","last_fullsized":"2024-03-20T13:38:11.012261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336050+0000","last_change":"2024-03-20T13:36:44.875311+0000","last_active":"2024-03-20T13:37:17.336050+0000","last_peered":"2024-03-20T13:37:17.336050+0000","last_clean":"2024-03-20T13:37:17.336050+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:37:17.336050+0000","last_undegraded":"2024-03-20T13:37:17.336050+0000","last_fullsized":"2024-03-20T13:37:17.336050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:40.597951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354486+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:37:17.354486+0000","last_peered":"2024-03-20T13:37:17.354486+0000","last_clean":"2024-03-20T13:37:17.354486+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:37:17.354486+0000","last_undegraded":"2024-03-20T13:37:17.354486+0000","last_fullsized":"2024-03-20T13:37:17.354486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362094+0000","last_change":"2024-03-20T13:36:38.834433+0000","last_active":"2024-03-20T13:38:05.362094+0000","last_peered":"2024-03-20T13:38:05.362094+0000","last_clean":"2024-03-20T13:38:05.362094+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:38:05.362094+0000","last_undegraded":"2024-03-20T13:38:05.362094+0000","last_fullsized":"2024-03-20T13:38:05.362094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:57.952498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334809+0000","last_change":"2024-03-20T13:36:36.812837+0000","last_active":"2024-03-20T13:37:17.334809+0000","last_peered":"2024-03-20T13:37:17.334809+0000","last_clean":"2024-03-20T13:37:17.334809+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:37:17.334809+0000","last_undegraded":"2024-03-20T13:37:17.334809+0000","last_fullsized":"2024-03-20T13:37:17.334809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:34.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.333133+0000","last_change":"2024-03-20T13:36:38.839230+0000","last_active":"2024-03-20T13:37:21.333133+0000","last_peered":"2024-03-20T13:37:21.333133+0000","last_clean":"2024-03-20T13:37:21.333133+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:37:21.333133+0000","last_undegraded":"2024-03-20T13:37:21.333133+0000","last_fullsized":"2024-03-20T13:37:21.333133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:30.816812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334989+0000","last_change":"2024-03-20T13:36:36.814746+0000","last_active":"2024-03-20T13:37:17.334989+0000","last_peered":"2024-03-20T13:37:17.334989+0000","last_clean":"2024-03-20T13:37:17.334989+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:37:17.334989+0000","last_undegraded":"2024-03-20T13:37:17.334989+0000","last_fullsized":"2024-03-20T13:37:17.334989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:55.744070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353374+0000","last_change":"2024-03-20T13:36:38.837487+0000","last_active":"2024-03-20T13:37:17.353374+0000","last_peered":"2024-03-20T13:37:17.353374+0000","last_clean":"2024-03-20T13:37:17.353374+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:37:17.353374+0000","last_undegraded":"2024-03-20T13:37:17.353374+0000","last_fullsized":"2024-03-20T13:37:17.353374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:02:07.258709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356320+0000","last_change":"2024-03-20T13:36:36.851159+0000","last_active":"2024-03-20T13:37:17.356320+0000","last_peered":"2024-03-20T13:37:17.356320+0000","last_clean":"2024-03-20T13:37:17.356320+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:37:17.356320+0000","last_undegraded":"2024-03-20T13:37:17.356320+0000","last_fullsized":"2024-03-20T13:37:17.356320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:19:31.572008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352794+0000","last_change":"2024-03-20T13:36:38.839750+0000","last_active":"2024-03-20T13:37:17.352794+0000","last_peered":"2024-03-20T13:37:17.352794+0000","last_clean":"2024-03-20T13:37:17.352794+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:37:17.352794+0000","last_undegraded":"2024-03-20T13:37:17.352794+0000","last_fullsized":"2024-03-20T13:37:17.352794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:04:09.779028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.353796+0000","last_change":"2024-03-20T13:36:36.811977+0000","last_active":"2024-03-20T13:38:05.353796+0000","last_peered":"2024-03-20T13:38:05.353796+0000","last_clean":"2024-03-20T13:38:05.353796+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:05.353796+0000","last_undegraded":"2024-03-20T13:38:05.353796+0000","last_fullsized":"2024-03-20T13:38:05.353796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:32:12.757319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559426+0000","last_change":"2024-03-20T13:37:17.364712+0000","last_active":"2024-03-20T13:38:04.559426+0000","last_peered":"2024-03-20T13:38:04.559426+0000","last_clean":"2024-03-20T13:38:04.559426+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:38:04.559426+0000","last_undegraded":"2024-03-20T13:38:04.559426+0000","last_fullsized":"2024-03-20T13:38:04.559426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:19.939344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348779+0000","last_change":"2024-03-20T13:36:36.846100+0000","last_active":"2024-03-20T13:37:17.348779+0000","last_peered":"2024-03-20T13:37:17.348779+0000","last_clean":"2024-03-20T13:37:17.348779+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:37:17.348779+0000","last_undegraded":"2024-03-20T13:37:17.348779+0000","last_fullsized":"2024-03-20T13:37:17.348779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348556+0000","last_change":"2024-03-20T13:36:38.837474+0000","last_active":"2024-03-20T13:37:17.348556+0000","last_peered":"2024-03-20T13:37:17.348556+0000","last_clean":"2024-03-20T13:37:17.348556+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:37:17.348556+0000","last_undegraded":"2024-03-20T13:37:17.348556+0000","last_fullsized":"2024-03-20T13:37:17.348556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:44.912843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350563+0000","last_change":"2024-03-20T13:36:36.831139+0000","last_active":"2024-03-20T13:37:17.350563+0000","last_peered":"2024-03-20T13:37:17.350563+0000","last_clean":"2024-03-20T13:37:17.350563+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:37:17.350563+0000","last_undegraded":"2024-03-20T13:37:17.350563+0000","last_fullsized":"2024-03-20T13:37:17.350563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:37.352809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038682+0000","last_change":"2024-03-20T13:36:38.836423+0000","last_active":"2024-03-20T13:38:11.038682+0000","last_peered":"2024-03-20T13:38:11.038682+0000","last_clean":"2024-03-20T13:38:11.038682+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:11.038682+0000","last_undegraded":"2024-03-20T13:38:11.038682+0000","last_fullsized":"2024-03-20T13:38:11.038682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345654+0000","last_change":"2024-03-20T13:36:36.818776+0000","last_active":"2024-03-20T13:37:17.345654+0000","last_peered":"2024-03-20T13:37:17.345654+0000","last_clean":"2024-03-20T13:37:17.345654+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:37:17.345654+0000","last_undegraded":"2024-03-20T13:37:17.345654+0000","last_fullsized":"2024-03-20T13:37:17.345654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:47.923230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349498+0000","last_change":"2024-03-20T13:36:38.831672+0000","last_active":"2024-03-20T13:37:17.349498+0000","last_peered":"2024-03-20T13:37:17.349498+0000","last_clean":"2024-03-20T13:37:17.349498+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:37:17.349498+0000","last_undegraded":"2024-03-20T13:37:17.349498+0000","last_fullsized":"2024-03-20T13:37:17.349498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360818+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:37:17.360818+0000","last_peered":"2024-03-20T13:37:17.360818+0000","last_clean":"2024-03-20T13:37:17.360818+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:37:17.360818+0000","last_undegraded":"2024-03-20T13:37:17.360818+0000","last_fullsized":"2024-03-20T13:37:17.360818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038256+0000","last_change":"2024-03-20T13:36:38.839448+0000","last_active":"2024-03-20T13:38:11.038256+0000","last_peered":"2024-03-20T13:38:11.038256+0000","last_clean":"2024-03-20T13:38:11.038256+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:11.038256+0000","last_undegraded":"2024-03-20T13:38:11.038256+0000","last_fullsized":"2024-03-20T13:38:11.038256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:44:49.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339930+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:37:17.339930+0000","last_peered":"2024-03-20T13:37:17.339930+0000","last_clean":"2024-03-20T13:37:17.339930+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:37:17.339930+0000","last_undegraded":"2024-03-20T13:37:17.339930+0000","last_fullsized":"2024-03-20T13:37:17.339930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361835+0000","last_change":"2024-03-20T13:36:38.828492+0000","last_active":"2024-03-20T13:37:17.361835+0000","last_peered":"2024-03-20T13:37:17.361835+0000","last_clean":"2024-03-20T13:37:17.361835+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:37:17.361835+0000","last_undegraded":"2024-03-20T13:37:17.361835+0000","last_fullsized":"2024-03-20T13:37:17.361835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341186+0000","last_change":"2024-03-20T13:36:36.848972+0000","last_active":"2024-03-20T13:37:17.341186+0000","last_peered":"2024-03-20T13:37:17.341186+0000","last_clean":"2024-03-20T13:37:17.341186+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:37:17.341186+0000","last_undegraded":"2024-03-20T13:37:17.341186+0000","last_fullsized":"2024-03-20T13:37:17.341186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:57.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559674+0000","last_change":"2024-03-20T13:36:38.830672+0000","last_active":"2024-03-20T13:38:04.559674+0000","last_peered":"2024-03-20T13:38:04.559674+0000","last_clean":"2024-03-20T13:38:04.559674+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:04.559674+0000","last_undegraded":"2024-03-20T13:38:04.559674+0000","last_fullsized":"2024-03-20T13:38:04.559674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.951500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.094321+0000","last_change":"2024-03-20T13:36:36.830049+0000","last_active":"2024-03-20T13:37:22.094321+0000","last_peered":"2024-03-20T13:37:22.094321+0000","last_clean":"2024-03-20T13:37:22.094321+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:37:22.094321+0000","last_undegraded":"2024-03-20T13:37:22.094321+0000","last_fullsized":"2024-03-20T13:37:22.094321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.370623+0000","last_change":"2024-03-20T13:37:17.369630+0000","last_active":"2024-03-20T13:37:17.370623+0000","last_peered":"2024-03-20T13:37:17.370623+0000","last_clean":"2024-03-20T13:37:17.370623+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:37:17.370623+0000","last_undegraded":"2024-03-20T13:37:17.370623+0000","last_fullsized":"2024-03-20T13:37:17.370623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:10.411859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348081+0000","last_change":"2024-03-20T13:36:36.831557+0000","last_active":"2024-03-20T13:37:17.348081+0000","last_peered":"2024-03-20T13:37:17.348081+0000","last_clean":"2024-03-20T13:37:17.348081+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:37:17.348081+0000","last_undegraded":"2024-03-20T13:37:17.348081+0000","last_fullsized":"2024-03-20T13:37:17.348081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:10:52.993902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560621+0000","last_change":"2024-03-20T13:36:38.829272+0000","last_active":"2024-03-20T13:38:04.560621+0000","last_peered":"2024-03-20T13:38:04.560621+0000","last_clean":"2024-03-20T13:38:04.560621+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:38:04.560621+0000","last_undegraded":"2024-03-20T13:38:04.560621+0000","last_fullsized":"2024-03-20T13:38:04.560621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349002+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:37:17.349002+0000","last_peered":"2024-03-20T13:37:17.349002+0000","last_clean":"2024-03-20T13:37:17.349002+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:37:17.349002+0000","last_undegraded":"2024-03-20T13:37:17.349002+0000","last_fullsized":"2024-03-20T13:37:17.349002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.775462+0000","last_change":"2024-03-20T13:37:17.354371+0000","last_active":"2024-03-20T13:37:21.775462+0000","last_peered":"2024-03-20T13:37:21.775462+0000","last_clean":"2024-03-20T13:37:21.775462+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:37:21.775462+0000","last_undegraded":"2024-03-20T13:37:21.775462+0000","last_fullsized":"2024-03-20T13:37:21.775462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:51.168656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351746+0000","last_change":"2024-03-20T13:36:36.848902+0000","last_active":"2024-03-20T13:37:17.351746+0000","last_peered":"2024-03-20T13:37:17.351746+0000","last_clean":"2024-03-20T13:37:17.351746+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:37:17.351746+0000","last_undegraded":"2024-03-20T13:37:17.351746+0000","last_fullsized":"2024-03-20T13:37:17.351746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347273+0000","last_change":"2024-03-20T13:36:38.836588+0000","last_active":"2024-03-20T13:37:17.347273+0000","last_peered":"2024-03-20T13:37:17.347273+0000","last_clean":"2024-03-20T13:37:17.347273+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:37:17.347273+0000","last_undegraded":"2024-03-20T13:37:17.347273+0000","last_fullsized":"2024-03-20T13:37:17.347273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346147+0000","last_change":"2024-03-20T13:36:36.818507+0000","last_active":"2024-03-20T13:37:17.346147+0000","last_peered":"2024-03-20T13:37:17.346147+0000","last_clean":"2024-03-20T13:37:17.346147+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:37:17.346147+0000","last_undegraded":"2024-03-20T13:37:17.346147+0000","last_fullsized":"2024-03-20T13:37:17.346147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:42:17.676549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103624+0000","last_change":"2024-03-20T13:36:38.828728+0000","last_active":"2024-03-20T13:37:22.103624+0000","last_peered":"2024-03-20T13:37:22.103624+0000","last_clean":"2024-03-20T13:37:22.103624+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:37:22.103624+0000","last_undegraded":"2024-03-20T13:37:22.103624+0000","last_fullsized":"2024-03-20T13:37:22.103624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:34.549840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.311031+0000","last_change":"2024-03-20T13:36:36.846419+0000","last_active":"2024-03-20T13:37:21.311031+0000","last_peered":"2024-03-20T13:37:21.311031+0000","last_clean":"2024-03-20T13:37:21.311031+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:37:21.311031+0000","last_undegraded":"2024-03-20T13:37:21.311031+0000","last_fullsized":"2024-03-20T13:37:21.311031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347654+0000","last_change":"2024-03-20T13:36:36.834343+0000","last_active":"2024-03-20T13:37:17.347654+0000","last_peered":"2024-03-20T13:37:17.347654+0000","last_clean":"2024-03-20T13:37:17.347654+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:37:17.347654+0000","last_undegraded":"2024-03-20T13:37:17.347654+0000","last_fullsized":"2024-03-20T13:37:17.347654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099296+0000","last_change":"2024-03-20T13:36:38.830650+0000","last_active":"2024-03-20T13:37:22.099296+0000","last_peered":"2024-03-20T13:37:22.099296+0000","last_clean":"2024-03-20T13:37:22.099296+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:37:22.099296+0000","last_undegraded":"2024-03-20T13:37:22.099296+0000","last_fullsized":"2024-03-20T13:37:22.099296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:47.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343075+0000","last_change":"2024-03-20T13:36:36.833552+0000","last_active":"2024-03-20T13:37:17.343075+0000","last_peered":"2024-03-20T13:37:17.343075+0000","last_clean":"2024-03-20T13:37:17.343075+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:37:17.343075+0000","last_undegraded":"2024-03-20T13:37:17.343075+0000","last_fullsized":"2024-03-20T13:37:17.343075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:36.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099152+0000","last_change":"2024-03-20T13:36:38.827748+0000","last_active":"2024-03-20T13:37:22.099152+0000","last_peered":"2024-03-20T13:37:22.099152+0000","last_clean":"2024-03-20T13:37:22.099152+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:37:22.099152+0000","last_undegraded":"2024-03-20T13:37:22.099152+0000","last_fullsized":"2024-03-20T13:37:22.099152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:07.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672987,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.47199999999999998}]}]},{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.73399999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672986,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.54400000000000004}]},{"osd":3,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68899999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.627}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:38:20.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:38:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.502+0000 7efcc18eb640 1 Processor -- start 2024-03-20T13:38:20.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.502+0000 7efcc18eb640 1 -- start start 2024-03-20T13:38:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcc18eb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcbc12bea0 0x7efcbc12c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcc18eb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc099db0 con 0x7efcbc098a70 2024-03-20T13:38:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcc18eb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc09de90 con 0x7efcbc12bea0 2024-03-20T13:38:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcbaffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcbc12bea0 0x7efcbc12c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcba7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7efcbc098a70 0x7efcbc098e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60120/0 (socket says 172.21.15.89:60120) 2024-03-20T13:38:20.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcba7fc640 1 -- 172.21.15.89:0/1095854328 learned_addr learned my addr 172.21.15.89:0/1095854328 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:20.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcbaffd640 1 -- 172.21.15.89:0/1095854328 >> v1:172.21.15.89:6789/0 conn(0x7efcbc098a70 legacy=0x7efcbc098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcbaffd640 1 -- 172.21.15.89:0/1095854328 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc09da10 con 0x7efcbc12bea0 2024-03-20T13:38:20.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcbaffd640 1 --2- 172.21.15.89:0/1095854328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc12bea0 0x7efcbc12c280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efcac009740 tx=0x7efcac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a282a097d2055e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:20.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcb9ffb640 1 -- 172.21.15.89:0/1095854328 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcac0ab530 con 0x7efcbc12bea0 2024-03-20T13:38:20.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcb9ffb640 1 -- 172.21.15.89:0/1095854328 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac0a7050 con 0x7efcbc12bea0 2024-03-20T13:38:20.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcb9ffb640 1 -- 172.21.15.89:0/1095854328 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcac0ab7e0 con 0x7efcbc12bea0 2024-03-20T13:38:20.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcc18eb640 1 -- 172.21.15.89:0/1095854328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc12bea0 msgr2=0x7efcbc12c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.506+0000 7efcc18eb640 1 --2- 172.21.15.89:0/1095854328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc12bea0 0x7efcbc12c280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efcac009740 tx=0x7efcac01c370 comp rx=0 tx=0).stop 2024-03-20T13:38:20.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1095854328 shutdown_connections 2024-03-20T13:38:20.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 --2- 172.21.15.89:0/1095854328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc12bea0 0x7efcbc12c280 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1095854328 >> 172.21.15.89:0/1095854328 conn(0x7efcbc09c220 msgr2=0x7efcbc071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:20.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1095854328 shutdown_connections 2024-03-20T13:38:20.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1095854328 wait complete. 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 Processor -- start 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- start start 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 0x7efcbc11a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc11df10 con 0x7efcbc098a70 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcbaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 0x7efcbc11a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcbaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 0x7efcbc11a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35018/0 (socket says 172.21.15.89:35018) 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcbaffd640 1 -- 172.21.15.89:0/1737818954 learned_addr learned my addr 172.21.15.89:0/1737818954 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:20.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcbaffd640 1 -- 172.21.15.89:0/1737818954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac009420 con 0x7efcbc098a70 2024-03-20T13:38:20.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcbaffd640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 0x7efcbc11a6f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efcac0ae040 tx=0x7efcac019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcac0b4540 con 0x7efcbc098a70 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac0b46a0 con 0x7efcbc098a70 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcac0b4960 con 0x7efcbc098a70 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc131720 con 0x7efcbc098a70 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc11cea0 con 0x7efcbc098a70 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efcac0b2040 con 0x7efcbc098a70 2024-03-20T13:38:20.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc11e060 con 0x7efcbc098a70 2024-03-20T13:38:20.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efca3fff640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efca8035a10 0x7efca8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:20.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.510+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efcac0e2e10 con 0x7efcbc098a70 2024-03-20T13:38:20.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.514+0000 7efcba7fc640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efca8035a10 0x7efca8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:20.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.514+0000 7efcba7fc640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efca8035a10 0x7efca8037ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efcb0001610 tx=0x7efcb0007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:20.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.518+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efcac0bbc40 con 0x7efcbc098a70 2024-03-20T13:38:20.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.678+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcbc11c230 con 0x7efcbc098a70 2024-03-20T13:38:20.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efca3fff640 1 -- 172.21.15.89:0/1737818954 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20925 (secure 0 0 0) 0x7efcac0b0070 con 0x7efcbc098a70 2024-03-20T13:38:20.684 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:38:20.684 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":34,"fsid":"cda039e5-cc53-45cd-8008-4f57580e2f4e","created":"2024-03-20T13:36:11.456615+0000","modified":"2024-03-20T13:37:17.328945+0000","last_up_change":"2024-03-20T13:36:20.709715+0000","last_in_change":"2024-03-20T13:36:12.682331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:36:22.313256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-20T13:36:27.278625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-20T13:36:34.816986+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-20T13:36:37.180863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-20T13:36:38.976498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-20T13:36:41.004514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-20T13:36:42.907102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-20T13:36:45.062964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22bfa48-013d-4c01-b5c6-62643a1caa96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6801","nonce":854515999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6803","nonce":854515999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6807","nonce":854515999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":854515999},{"type":"v1","addr":"172.21.15.89:6805","nonce":854515999}]},"public_addr":"172.21.15.89:6801/854515999","cluster_addr":"172.21.15.89:6803/854515999","heartbeat_back_addr":"172.21.15.89:6807/854515999","heartbeat_front_addr":"172.21.15.89:6805/854515999","state":["exists","up"]},{"osd":1,"uuid":"56155634-7501-466c-ab30-d5b26a12a17d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6801","nonce":3706732118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6804","nonce":3706732118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6813","nonce":3706732118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":3706732118},{"type":"v1","addr":"172.21.15.123:6808","nonce":3706732118}]},"public_addr":"172.21.15.123:6801/3706732118","cluster_addr":"172.21.15.123:6804/3706732118","heartbeat_back_addr":"172.21.15.123:6813/3706732118","heartbeat_front_addr":"172.21.15.123:6808/3706732118","state":["exists","up"]},{"osd":2,"uuid":"fbae2cb8-b7b0-4ddf-b00a-e3e209a12363","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6803","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6805","nonce":1251286685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6807","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6809","nonce":1251286685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6815","nonce":1251286685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6811","nonce":1251286685},{"type":"v1","addr":"172.21.15.123:6812","nonce":1251286685}]},"public_addr":"172.21.15.123:6805/1251286685","cluster_addr":"172.21.15.123:6809/1251286685","heartbeat_back_addr":"172.21.15.123:6815/1251286685","heartbeat_front_addr":"172.21.15.123:6812/1251286685","state":["exists","up"]},{"osd":3,"uuid":"844dcdcd-c116-4e43-adcd-27f21b51945b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6817","nonce":3519650013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6819","nonce":3519650013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6823","nonce":3519650013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3519650013},{"type":"v1","addr":"172.21.15.123:6821","nonce":3519650013}]},"public_addr":"172.21.15.123:6817/3519650013","cluster_addr":"172.21.15.123:6819/3519650013","heartbeat_back_addr":"172.21.15.123:6823/3519650013","heartbeat_front_addr":"172.21.15.123:6821/3519650013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.066936+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.327428+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.161844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:36:18.172631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"5.0","mappings":[{"from":1,"to":2}]},{"pgid":"6.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:38:20.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efca8035a10 msgr2=0x7efca8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efca8035a10 0x7efca8037ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efcb0001610 tx=0x7efcb0007ad0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 msgr2=0x7efcbc11a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 0x7efcbc11a6f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efcac0ae040 tx=0x7efcac019110 comp rx=0 tx=0).stop 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 shutdown_connections 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efca8035a10 0x7efca8037ed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 --2- 172.21.15.89:0/1737818954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc098a70 0x7efcbc11a6f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 >> 172.21.15.89:0/1737818954 conn(0x7efcbc09c220 msgr2=0x7efcbc130030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 shutdown_connections 2024-03-20T13:38:20.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:20.682+0000 7efcc18eb640 1 -- 172.21.15.89:0/1737818954 wait complete. 2024-03-20T13:38:21.703 INFO:tasks.ceph:Scrubbing osd.0 2024-03-20T13:38:21.703 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:38:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a8315640 1 Processor -- start 2024-03-20T13:38:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a8315640 1 -- start start 2024-03-20T13:38:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a8315640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91a0098a70 0x7f91a0098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a8315640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a0099c90 con 0x7f91a0099390 2024-03-20T13:38:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a8315640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a009aa70 con 0x7f91a0098a70 2024-03-20T13:38:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a58b0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f91a0099390 0x7f91a012bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56680/0 (socket says 172.21.15.89:56680) 2024-03-20T13:38:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a58b0640 1 -- 172.21.15.89:0/3390607893 learned_addr learned my addr 172.21.15.89:0/3390607893 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a60b1640 1 --2- 172.21.15.89:0/3390607893 >> v2:172.21.15.89:3300/0 conn(0x7f91a0098a70 0x7f91a0098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a50af640 1 -- 172.21.15.89:0/3390607893 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371415079 0 0) 0x7f91a0099c90 con 0x7f91a0099390 2024-03-20T13:38:21.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a50af640 1 -- 172.21.15.89:0/3390607893 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f918c003530 con 0x7f91a0099390 2024-03-20T13:38:21.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a60b1640 1 -- 172.21.15.89:0/3390607893 >> v1:172.21.15.89:6789/0 conn(0x7f91a0099390 legacy=0x7f91a012bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a50af640 1 -- 172.21.15.89:0/3390607893 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 779024122 0 0) 0x7f918c003530 con 0x7f91a0099390 2024-03-20T13:38:21.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.834+0000 7f91a60b1640 1 -- 172.21.15.89:0/3390607893 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a009dfa0 con 0x7f91a0098a70 2024-03-20T13:38:21.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a60b1640 1 --2- 172.21.15.89:0/3390607893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a0098e50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9198009740 tx=0x7f919801c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0144ebd4a50a59 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a50af640 1 -- 172.21.15.89:0/3390607893 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91900015b0 con 0x7f91a0098a70 2024-03-20T13:38:21.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a50af640 1 -- 172.21.15.89:0/3390607893 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980a7050 con 0x7f91a0098a70 2024-03-20T13:38:21.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a50af640 1 -- 172.21.15.89:0/3390607893 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91980ab530 con 0x7f91a0098a70 2024-03-20T13:38:21.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/3390607893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 msgr2=0x7f91a0098e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 --2- 172.21.15.89:0/3390607893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a0098e50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9198009740 tx=0x7f919801c290 comp rx=0 tx=0).stop 2024-03-20T13:38:21.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/3390607893 shutdown_connections 2024-03-20T13:38:21.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 --2- 172.21.15.89:0/3390607893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a0098e50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/3390607893 >> 172.21.15.89:0/3390607893 conn(0x7f91a009c3f0 msgr2=0x7f91a0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:21.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/3390607893 shutdown_connections 2024-03-20T13:38:21.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/3390607893 wait complete. 2024-03-20T13:38:21.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 Processor -- start 2024-03-20T13:38:21.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- start start 2024-03-20T13:38:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a01c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a011e8a0 con 0x7f91a0098a70 2024-03-20T13:38:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a60b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a01c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a60b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a01c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42488/0 (socket says 172.21.15.89:42488) 2024-03-20T13:38:21.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a60b1640 1 -- 172.21.15.89:0/1822812543 learned_addr learned my addr 172.21.15.89:0/1822812543 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a60b1640 1 -- 172.21.15.89:0/1822812543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198009420 con 0x7f91a0098a70 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a60b1640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a01c54e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f91980ae040 tx=0x7f919801aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91980abd70 con 0x7f91a0098a70 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980b7450 con 0x7f91a0098a70 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a0131db0 con 0x7f91a0098a70 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91980b75c0 con 0x7f91a0098a70 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.838+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a011e130 con 0x7f91a0098a70 2024-03-20T13:38:21.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91a011ed50 con 0x7f91a0098a70 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f91980b7720 con 0x7f91a0098a70 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9184035a10 0x7f9184037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f91980e2fb0 con 0x7f91a0098a70 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f9184041e80 0x7f9184044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91840449f0 con 0x7f9184041e80 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91980e55b0 con 0x7f91a0098a70 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f91a68b2640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f9184041e80 0x7f9184044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f91a58b0640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9184035a10 0x7f9184037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f91a68b2640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f9184041e80 0x7f9184044320 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f91a58b0640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9184035a10 0x7f9184037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c10 tx=0x7f9190001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.842+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== osd.0 v2:172.21.15.89:6800/854515999 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f91840449f0 con 0x7f9184041e80 2024-03-20T13:38:21.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.854+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 --> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91a006ecf0 con 0x7f9184041e80 2024-03-20T13:38:21.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f9196ffd640 1 -- 172.21.15.89:0/1822812543 <== osd.0 v2:172.21.15.89:6800/854515999 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f91a006ecf0 con 0x7f9184041e80 2024-03-20T13:38:21.859 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-03-20T13:38:21.859 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:38:21.859 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-03-20T13:38:21.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f9184041e80 msgr2=0x7f9184044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f9184041e80 0x7f9184044320 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9184035a10 msgr2=0x7f9184037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9184035a10 0x7f9184037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c10 tx=0x7f9190001240 comp rx=0 tx=0).stop 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 msgr2=0x7f91a01c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a01c54e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f91980ae040 tx=0x7f919801aad0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 shutdown_connections 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:6800/854515999,v1:172.21.15.89:6801/854515999] conn(0x7f9184041e80 0x7f9184044320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f9184035a10 0x7f9184037ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 --2- 172.21.15.89:0/1822812543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0098a70 0x7f91a01c54e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 >> 172.21.15.89:0/1822812543 conn(0x7f91a009c3f0 msgr2=0x7f91a0130710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:21.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 shutdown_connections 2024-03-20T13:38:21.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.858+0000 7f91a8315640 1 -- 172.21.15.89:0/1822812543 wait complete. 2024-03-20T13:38:21.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-20T13:38:21.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f852714b640 1 Processor -- start 2024-03-20T13:38:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f852714b640 1 -- start start 2024-03-20T13:38:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f852714b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85200966f0 0x7f8520096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f852714b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852009a900 con 0x7f8520097010 2024-03-20T13:38:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f852714b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852006bea0 con 0x7f85200966f0 2024-03-20T13:38:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f8524ee7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85200966f0 0x7f8520096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f851ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8520097010 0x7f8520097ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56694/0 (socket says 172.21.15.89:56694) 2024-03-20T13:38:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f851ffff640 1 -- 172.21.15.89:0/28791826 learned_addr learned my addr 172.21.15.89:0/28791826 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f8524ee7640 1 -- 172.21.15.89:0/28791826 >> v1:172.21.15.89:6789/0 conn(0x7f8520097010 legacy=0x7f8520097ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f851f7fe640 1 -- 172.21.15.89:0/28791826 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903073101 0 0) 0x7f852009a900 con 0x7f8520097010 2024-03-20T13:38:21.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f8524ee7640 1 -- 172.21.15.89:0/28791826 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520099960 con 0x7f85200966f0 2024-03-20T13:38:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f8524ee7640 1 --2- 172.21.15.89:0/28791826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520096ad0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8514009740 tx=0x7f851401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c50f40f9c4c21eb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f851f7fe640 1 -- 172.21.15.89:0/28791826 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85140ab530 con 0x7f85200966f0 2024-03-20T13:38:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f851f7fe640 1 -- 172.21.15.89:0/28791826 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85140a7050 con 0x7f85200966f0 2024-03-20T13:38:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.986+0000 7f851f7fe640 1 -- 172.21.15.89:0/28791826 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85140ab7e0 con 0x7f85200966f0 2024-03-20T13:38:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/28791826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 msgr2=0x7f8520096ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:21.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 --2- 172.21.15.89:0/28791826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520096ad0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8514009740 tx=0x7f851401c370 comp rx=0 tx=0).stop 2024-03-20T13:38:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/28791826 shutdown_connections 2024-03-20T13:38:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 --2- 172.21.15.89:0/28791826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520096ad0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/28791826 >> 172.21.15.89:0/28791826 conn(0x7f852009e540 msgr2=0x7f852009e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/28791826 shutdown_connections 2024-03-20T13:38:21.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/28791826 wait complete. 2024-03-20T13:38:21.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 Processor -- start 2024-03-20T13:38:21.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- start start 2024-03-20T13:38:21.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85201330f0 con 0x7f85200966f0 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f8524ee7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f8524ee7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520130c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42506/0 (socket says 172.21.15.89:42506) 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f8524ee7640 1 -- 172.21.15.89:0/2589238252 learned_addr learned my addr 172.21.15.89:0/2589238252 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f8524ee7640 1 -- 172.21.15.89:0/2589238252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514009420 con 0x7f85200966f0 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f8524ee7640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520130c20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f85140ae040 tx=0x7f851401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85140b7580 con 0x7f85200966f0 2024-03-20T13:38:21.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85140b76e0 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8520131d20 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85140b79c0 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85201336f0 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8520133d80 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f85140b7b20 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851d7fa640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8504035a10 0x7f8504037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f85140e3100 con 0x7f85200966f0 2024-03-20T13:38:21.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.990+0000 7f851ffff640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8504035a10 0x7f8504037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:21.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.994+0000 7f851ffff640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8504035a10 0x7f8504037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f850c007fd0 tx=0x7f850c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:21.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:21.994+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85140c78f0 con 0x7f85200966f0 2024-03-20T13:38:22.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.150+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f852009f840 con 0x7f8504035a10 2024-03-20T13:38:22.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.154+0000 7f851d7fa640 1 -- 172.21.15.89:0/2589238252 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f852009f840 con 0x7f8504035a10 2024-03-20T13:38:22.156 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2024-03-20T13:38:22.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8504035a10 msgr2=0x7f8504037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8504035a10 0x7f8504037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f850c007fd0 tx=0x7f850c007920 comp rx=0 tx=0).stop 2024-03-20T13:38:22.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 msgr2=0x7f8520130c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520130c20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f85140ae040 tx=0x7f851401abb0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 shutdown_connections 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8504035a10 0x7f8504037ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 --2- 172.21.15.89:0/2589238252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85200966f0 0x7f8520130c20 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 >> 172.21.15.89:0/2589238252 conn(0x7f852009e540 msgr2=0x7f8520126f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 shutdown_connections 2024-03-20T13:38:22.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.158+0000 7f852714b640 1 -- 172.21.15.89:0/2589238252 wait complete. 2024-03-20T13:38:22.175 INFO:tasks.ceph:Scrubbing osd.1 2024-03-20T13:38:22.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:38:22.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f3606392640 1 Processor -- start 2024-03-20T13:38:22.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f3606392640 1 -- start start 2024-03-20T13:38:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f3606392640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3600128560 0x7f3600128af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f3606392640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36000964c0 con 0x7f3600129030 2024-03-20T13:38:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f3606392640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3600129490 con 0x7f3600128560 2024-03-20T13:38:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f35fffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3600128560 0x7f3600128af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f35ff7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3600129030 0x7f360012baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56708/0 (socket says 172.21.15.89:56708) 2024-03-20T13:38:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f35ff7fe640 1 -- 172.21.15.89:0/1559074610 learned_addr learned my addr 172.21.15.89:0/1559074610 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f35fffff640 1 -- 172.21.15.89:0/1559074610 >> v1:172.21.15.89:6789/0 conn(0x7f3600129030 legacy=0x7f360012baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f35fffff640 1 -- 172.21.15.89:0/1559074610 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600095740 con 0x7f3600128560 2024-03-20T13:38:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.290+0000 7f35feffd640 1 -- 172.21.15.89:0/1559074610 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461173942 0 0) 0x7f36000964c0 con 0x7f3600129030 2024-03-20T13:38:22.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f35fffff640 1 --2- 172.21.15.89:0/1559074610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f3600128af0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009d90 tx=0x7f35f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153402b5be6c4203 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f35feffd640 1 -- 172.21.15.89:0/1559074610 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f00a6560 con 0x7f3600128560 2024-03-20T13:38:22.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f35feffd640 1 -- 172.21.15.89:0/1559074610 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f00a66c0 con 0x7f3600128560 2024-03-20T13:38:22.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f35feffd640 1 -- 172.21.15.89:0/1559074610 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f00a6980 con 0x7f3600128560 2024-03-20T13:38:22.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- 172.21.15.89:0/1559074610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 msgr2=0x7f3600128af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 --2- 172.21.15.89:0/1559074610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f3600128af0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009d90 tx=0x7f35f001c8c0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- 172.21.15.89:0/1559074610 shutdown_connections 2024-03-20T13:38:22.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 --2- 172.21.15.89:0/1559074610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f3600128af0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- 172.21.15.89:0/1559074610 >> 172.21.15.89:0/1559074610 conn(0x7f360009a050 msgr2=0x7f360009a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- 172.21.15.89:0/1559074610 shutdown_connections 2024-03-20T13:38:22.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- 172.21.15.89:0/1559074610 wait complete. 2024-03-20T13:38:22.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 Processor -- start 2024-03-20T13:38:22.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- start start 2024-03-20T13:38:22.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f360006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.294+0000 7f3606392640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360006dcd0 con 0x7f3600128560 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f360006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f360006c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42534/0 (socket says 172.21.15.89:42534) 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fffff640 1 -- 172.21.15.89:0/3754509676 learned_addr learned my addr 172.21.15.89:0/3754509676 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fffff640 1 -- 172.21.15.89:0/3754509676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009a70 con 0x7f3600128560 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fffff640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f360006c370 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f35f001a4f0 tx=0x7f35f0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f00a7750 con 0x7f3600128560 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f00a78b0 con 0x7f3600128560 2024-03-20T13:38:22.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3600123430 con 0x7f3600128560 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f00a7b70 con 0x7f3600128560 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3600131260 con 0x7f3600128560 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3600062860 con 0x7f3600128560 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35f00a7cd0 con 0x7f3600128560 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35ec035a10 0x7f35ec037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f35f00b7040 con 0x7f3600128560 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f35ec041e80 0x7f35ec044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35ec0449f0 con 0x7f35ec041e80 2024-03-20T13:38:22.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35f00e6610 con 0x7f3600128560 2024-03-20T13:38:22.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35ff7fe640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35ec035a10 0x7f35ec037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f360492f640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f35ec041e80 0x7f35ec044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f35ff7fe640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35ec035a10 0x7f35ec037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f35f4007fd0 tx=0x7f35f4007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.298+0000 7f360492f640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f35ec041e80 0x7f35ec044320 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.302+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== osd.1 v2:172.21.15.123:6800/3706732118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f35ec0449f0 con 0x7f35ec041e80 2024-03-20T13:38:22.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 --> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3600131960 con 0x7f35ec041e80 2024-03-20T13:38:22.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f35fcff9640 1 -- 172.21.15.89:0/3754509676 <== osd.1 v2:172.21.15.123:6800/3706732118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3600131960 con 0x7f35ec041e80 2024-03-20T13:38:22.318 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-03-20T13:38:22.318 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:38:22.318 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-03-20T13:38:22.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f35ec041e80 msgr2=0x7f35ec044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f35ec041e80 0x7f35ec044320 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35ec035a10 msgr2=0x7f35ec037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35ec035a10 0x7f35ec037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f35f4007fd0 tx=0x7f35f4007920 comp rx=0 tx=0).stop 2024-03-20T13:38:22.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 msgr2=0x7f360006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f360006c370 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f35f001a4f0 tx=0x7f35f0019660 comp rx=0 tx=0).stop 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 shutdown_connections 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6800/3706732118,v1:172.21.15.123:6801/3706732118] conn(0x7f35ec041e80 0x7f35ec044320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f35ec035a10 0x7f35ec037ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 --2- 172.21.15.89:0/3754509676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3600128560 0x7f360006c370 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 >> 172.21.15.89:0/3754509676 conn(0x7f360009a050 msgr2=0x7f3600127150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 shutdown_connections 2024-03-20T13:38:22.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.314+0000 7f3606392640 1 -- 172.21.15.89:0/3754509676 wait complete. 2024-03-20T13:38:22.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-20T13:38:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871efbe640 1 Processor -- start 2024-03-20T13:38:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871efbe640 1 -- start start 2024-03-20T13:38:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871efbe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8718098a70 0x7f8718098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871efbe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8718099c10 con 0x7f8718099390 2024-03-20T13:38:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871efbe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871809de50 con 0x7f8718098a70 2024-03-20T13:38:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871cd5a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8718098a70 0x7f8718098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f8717fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8718099390 0x7f871812bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56710/0 (socket says 172.21.15.89:56710) 2024-03-20T13:38:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f8717fff640 1 -- 172.21.15.89:0/903196442 learned_addr learned my addr 172.21.15.89:0/903196442 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871cd5a640 1 -- 172.21.15.89:0/903196442 >> v1:172.21.15.89:6789/0 conn(0x7f8718099390 legacy=0x7f871812bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.446+0000 7f871cd5a640 1 -- 172.21.15.89:0/903196442 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180722c0 con 0x7f8718098a70 2024-03-20T13:38:22.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871cd5a640 1 --2- 172.21.15.89:0/903196442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718098e50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8710009740 tx=0x7f871001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1730e1a0b7d1ae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f87177fe640 1 -- 172.21.15.89:0/903196442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87100ab530 con 0x7f8718098a70 2024-03-20T13:38:22.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f87177fe640 1 -- 172.21.15.89:0/903196442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87100a7050 con 0x7f8718098a70 2024-03-20T13:38:22.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f87177fe640 1 -- 172.21.15.89:0/903196442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87100ab7e0 con 0x7f8718098a70 2024-03-20T13:38:22.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/903196442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 msgr2=0x7f8718098e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 --2- 172.21.15.89:0/903196442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718098e50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8710009740 tx=0x7f871001c400 comp rx=0 tx=0).stop 2024-03-20T13:38:22.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/903196442 shutdown_connections 2024-03-20T13:38:22.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 --2- 172.21.15.89:0/903196442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718098e50 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/903196442 >> 172.21.15.89:0/903196442 conn(0x7f871809c330 msgr2=0x7f8718071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/903196442 shutdown_connections 2024-03-20T13:38:22.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/903196442 wait complete. 2024-03-20T13:38:22.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 Processor -- start 2024-03-20T13:38:22.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- start start 2024-03-20T13:38:22.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718118780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871811bb10 con 0x7f8718098a70 2024-03-20T13:38:22.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871cd5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718118780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871cd5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718118780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42550/0 (socket says 172.21.15.89:42550) 2024-03-20T13:38:22.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871cd5a640 1 -- 172.21.15.89:0/1685325918 learned_addr learned my addr 172.21.15.89:0/1685325918 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:22.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871cd5a640 1 -- 172.21.15.89:0/1685325918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009420 con 0x7f8718098a70 2024-03-20T13:38:22.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871cd5a640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718118780 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f871001a030 tx=0x7f871001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87100b7580 con 0x7f8718098a70 2024-03-20T13:38:22.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87100b76e0 con 0x7f8718098a70 2024-03-20T13:38:22.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8718129bf0 con 0x7f8718098a70 2024-03-20T13:38:22.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87100b7980 con 0x7f8718098a70 2024-03-20T13:38:22.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.450+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871811b480 con 0x7f8718098a70 2024-03-20T13:38:22.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.454+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f87100b7ae0 con 0x7f8718098a70 2024-03-20T13:38:22.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.454+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871811b260 con 0x7f8718098a70 2024-03-20T13:38:22.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.454+0000 7f87157fa640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8704035a10 0x7f8704037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.454+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f87100e36b0 con 0x7f8718098a70 2024-03-20T13:38:22.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.454+0000 7f8717fff640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8704035a10 0x7f8704037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.454+0000 7f8717fff640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8704035a10 0x7f8704037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f870c005c10 tx=0x7f870c0016a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.458+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87100b7d90 con 0x7f8718098a70 2024-03-20T13:38:22.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.602+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f871811a270 con 0x7f8704035a10 2024-03-20T13:38:22.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f87157fa640 1 -- 172.21.15.89:0/1685325918 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f871811a270 con 0x7f8704035a10 2024-03-20T13:38:22.607 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2024-03-20T13:38:22.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8704035a10 msgr2=0x7f8704037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8704035a10 0x7f8704037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f870c005c10 tx=0x7f870c0016a0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 msgr2=0x7f8718118780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718118780 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f871001a030 tx=0x7f871001ac40 comp rx=0 tx=0).stop 2024-03-20T13:38:22.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 shutdown_connections 2024-03-20T13:38:22.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f8704035a10 0x7f8704037ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 --2- 172.21.15.89:0/1685325918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718098a70 0x7f8718118780 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 >> 172.21.15.89:0/1685325918 conn(0x7f871809c330 msgr2=0x7f871812e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 shutdown_connections 2024-03-20T13:38:22.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.606+0000 7f871efbe640 1 -- 172.21.15.89:0/1685325918 wait complete. 2024-03-20T13:38:22.624 INFO:tasks.ceph:Scrubbing osd.2 2024-03-20T13:38:22.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:38:22.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbfbc2640 1 Processor -- start 2024-03-20T13:38:22.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbfbc2640 1 -- start start 2024-03-20T13:38:22.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbfbc2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7cb812e940 0x7f7cb8133170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbfbc2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80991d0 con 0x7f7cb812de50 2024-03-20T13:38:22.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbfbc2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb8099c10 con 0x7f7cb812e940 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbd95e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7cb812de50 0x7f7cb812e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56716/0 (socket says 172.21.15.89:56716) 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbd95e640 1 -- 172.21.15.89:0/959426614 learned_addr learned my addr 172.21.15.89:0/959426614 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbd15d640 1 --2- 172.21.15.89:0/959426614 >> v2:172.21.15.89:3300/0 conn(0x7f7cb812e940 0x7f7cb8133170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbc95c640 1 -- 172.21.15.89:0/959426614 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157473555 0 0) 0x7f7cb80991d0 con 0x7f7cb812de50 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbc95c640 1 -- 172.21.15.89:0/959426614 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca4003530 con 0x7f7cb812de50 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbd15d640 1 -- 172.21.15.89:0/959426614 >> v1:172.21.15.89:6789/0 conn(0x7f7cb812de50 legacy=0x7f7cb812e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.746+0000 7f7cbd15d640 1 -- 172.21.15.89:0/959426614 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb809a030 con 0x7f7cb812e940 2024-03-20T13:38:22.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbd15d640 1 --2- 172.21.15.89:0/959426614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812e940 0x7f7cb8133170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009740 tx=0x7f7ca801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dad23f4cd7375f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbc95c640 1 -- 172.21.15.89:0/959426614 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ca80ab530 con 0x7f7cb812e940 2024-03-20T13:38:22.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbc95c640 1 -- 172.21.15.89:0/959426614 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca80a7050 con 0x7f7cb812e940 2024-03-20T13:38:22.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbc95c640 1 -- 172.21.15.89:0/959426614 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ca80ab7e0 con 0x7f7cb812e940 2024-03-20T13:38:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/959426614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812e940 msgr2=0x7f7cb8133170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/959426614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812e940 0x7f7cb8133170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009740 tx=0x7f7ca801c370 comp rx=0 tx=0).stop 2024-03-20T13:38:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/959426614 shutdown_connections 2024-03-20T13:38:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/959426614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812e940 0x7f7cb8133170 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/959426614 >> 172.21.15.89:0/959426614 conn(0x7f7cb80a0790 msgr2=0x7f7cb80a0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/959426614 shutdown_connections 2024-03-20T13:38:22.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/959426614 wait complete. 2024-03-20T13:38:22.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 Processor -- start 2024-03-20T13:38:22.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- start start 2024-03-20T13:38:22.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 0x7f7cb81c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbfbc2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806c830 con 0x7f7cb812de50 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbd95e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 0x7f7cb81c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbd95e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 0x7f7cb81c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42576/0 (socket says 172.21.15.89:42576) 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.750+0000 7f7cbd95e640 1 -- 172.21.15.89:0/3822632625 learned_addr learned my addr 172.21.15.89:0/3822632625 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbd95e640 1 -- 172.21.15.89:0/3822632625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8009420 con 0x7f7cb812de50 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbd95e640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 0x7f7cb81c57b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400cb40 tx=0x7f7cb400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cb400abf0 con 0x7f7cb812de50 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400ad50 con 0x7f7cb812de50 2024-03-20T13:38:22.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb806d870 con 0x7f7cb812de50 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4012400 con 0x7f7cb812de50 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb806c4b0 con 0x7f7cb812de50 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7cb806d3c0 con 0x7f7cb812de50 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7cb4007070 con 0x7f7cb812de50 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7c9c035a10 0x7f7c9c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7cb4048800 con 0x7f7cb812de50 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7c9c041e80 0x7f7c9c044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c9c0449f0 con 0x7f7c9c041e80 2024-03-20T13:38:22.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cb404d2a0 con 0x7f7cb812de50 2024-03-20T13:38:22.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbd15d640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7c9c035a10 0x7f7c9c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbe15f640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7c9c041e80 0x7f7c9c044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbe15f640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7c9c041e80 0x7f7c9c044320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.754+0000 7f7cbd15d640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7c9c035a10 0x7f7c9c037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80ad000 tx=0x7f7ca8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.758+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== osd.2 v2:172.21.15.123:6803/1251286685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7c9c0449f0 con 0x7f7c9c041e80 2024-03-20T13:38:22.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 --> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7cb806cbb0 con 0x7f7c9c041e80 2024-03-20T13:38:22.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cae7fc640 1 -- 172.21.15.89:0/3822632625 <== osd.2 v2:172.21.15.123:6803/1251286685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7cb0009870 con 0x7f7c9c041e80 2024-03-20T13:38:22.773 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-03-20T13:38:22.774 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:38:22.774 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-03-20T13:38:22.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7c9c041e80 msgr2=0x7f7c9c044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7c9c041e80 0x7f7c9c044320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7c9c035a10 msgr2=0x7f7c9c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7c9c035a10 0x7f7c9c037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80ad000 tx=0x7f7ca8008040 comp rx=0 tx=0).stop 2024-03-20T13:38:22.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 msgr2=0x7f7cb81c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 0x7f7cb81c57b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400cb40 tx=0x7f7cb400a060 comp rx=0 tx=0).stop 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 shutdown_connections 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6803/1251286685,v1:172.21.15.123:6805/1251286685] conn(0x7f7c9c041e80 0x7f7c9c044320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7c9c035a10 0x7f7c9c037ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 --2- 172.21.15.89:0/3822632625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cb812de50 0x7f7cb81c57b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 >> 172.21.15.89:0/3822632625 conn(0x7f7cb80a0790 msgr2=0x7f7cb812c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 shutdown_connections 2024-03-20T13:38:22.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.770+0000 7f7cbfbc2640 1 -- 172.21.15.89:0/3822632625 wait complete. 2024-03-20T13:38:22.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-20T13:38:22.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb32af3f640 1 Processor -- start 2024-03-20T13:38:22.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb32af3f640 1 -- start start 2024-03-20T13:38:22.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb32af3f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb324093d20 0x7fb324094100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb32af3f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240936c0 con 0x7fb324095700 2024-03-20T13:38:22.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb32af3f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb324094640 con 0x7fb324093d20 2024-03-20T13:38:22.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb328cdb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb324093d20 0x7fb324094100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb323fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb324095700 0x7fb324128560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56730/0 (socket says 172.21.15.89:56730) 2024-03-20T13:38:22.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb323fff640 1 -- 172.21.15.89:0/2329576430 learned_addr learned my addr 172.21.15.89:0/2329576430 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:22.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb328cdb640 1 -- 172.21.15.89:0/2329576430 >> v1:172.21.15.89:6789/0 conn(0x7fb324095700 legacy=0x7fb324128560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.906+0000 7fb328cdb640 1 -- 172.21.15.89:0/2329576430 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240938f0 con 0x7fb324093d20 2024-03-20T13:38:22.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb328cdb640 1 --2- 172.21.15.89:0/2329576430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb324094100 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb318009740 tx=0x7fb31801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5685dd750306422b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb3237fe640 1 -- 172.21.15.89:0/2329576430 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb324096080 con 0x7fb324093d20 2024-03-20T13:38:22.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb3237fe640 1 -- 172.21.15.89:0/2329576430 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180a7050 con 0x7fb324093d20 2024-03-20T13:38:22.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb3237fe640 1 -- 172.21.15.89:0/2329576430 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3180ab680 con 0x7fb324093d20 2024-03-20T13:38:22.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/2329576430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 msgr2=0x7fb324094100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 --2- 172.21.15.89:0/2329576430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb324094100 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb318009740 tx=0x7fb31801c370 comp rx=0 tx=0).stop 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/2329576430 shutdown_connections 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 --2- 172.21.15.89:0/2329576430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb324094100 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/2329576430 >> 172.21.15.89:0/2329576430 conn(0x7fb32409a0c0 msgr2=0x7fb32409a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/2329576430 shutdown_connections 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/2329576430 wait complete. 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 Processor -- start 2024-03-20T13:38:22.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- start start 2024-03-20T13:38:22.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb3241c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32412d180 con 0x7fb324093d20 2024-03-20T13:38:22.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb328cdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb3241c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb328cdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb3241c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42596/0 (socket says 172.21.15.89:42596) 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb328cdb640 1 -- 172.21.15.89:0/3557192265 learned_addr learned my addr 172.21.15.89:0/3557192265 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb328cdb640 1 -- 172.21.15.89:0/3557192265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009420 con 0x7fb324093d20 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb328cdb640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb3241c3550 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb318019fa0 tx=0x7fb31801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3180b7450 con 0x7fb324093d20 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180b75b0 con 0x7fb324093d20 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32412cc40 con 0x7fb324093d20 2024-03-20T13:38:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3180b7850 con 0x7fb324093d20 2024-03-20T13:38:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.910+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3241251d0 con 0x7fb324093d20 2024-03-20T13:38:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.914+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb3180b79b0 con 0x7fb324093d20 2024-03-20T13:38:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.914+0000 7fb3217fa640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb310035a10 0x7fb310037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.914+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32412cf30 con 0x7fb324093d20 2024-03-20T13:38:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.914+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb3180e3380 con 0x7fb324093d20 2024-03-20T13:38:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.914+0000 7fb323fff640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb310035a10 0x7fb310037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:22.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.914+0000 7fb323fff640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb310035a10 0x7fb310037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb314005890 tx=0x7fb314007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:22.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:22.918+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb3180c74e0 con 0x7fb324093d20 2024-03-20T13:38:23.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.074+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3240724c0 con 0x7fb310035a10 2024-03-20T13:38:23.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb3217fa640 1 -- 172.21.15.89:0/3557192265 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb3240724c0 con 0x7fb310035a10 2024-03-20T13:38:23.079 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2024-03-20T13:38:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb310035a10 msgr2=0x7fb310037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb310035a10 0x7fb310037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb314005890 tx=0x7fb314007a90 comp rx=0 tx=0).stop 2024-03-20T13:38:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 msgr2=0x7fb3241c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb3241c3550 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb318019fa0 tx=0x7fb31801abb0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 shutdown_connections 2024-03-20T13:38:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb310035a10 0x7fb310037ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 --2- 172.21.15.89:0/3557192265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb324093d20 0x7fb3241c3550 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 >> 172.21.15.89:0/3557192265 conn(0x7fb32409a0c0 msgr2=0x7fb324097510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 shutdown_connections 2024-03-20T13:38:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.078+0000 7fb32af3f640 1 -- 172.21.15.89:0/3557192265 wait complete. 2024-03-20T13:38:23.097 INFO:tasks.ceph:Scrubbing osd.3 2024-03-20T13:38:23.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:38:23.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-20T13:38:23.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb90fe640 1 Processor -- start 2024-03-20T13:38:23.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb90fe640 1 -- start start 2024-03-20T13:38:23.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb90fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efdb412b1b0 0x7efdb412b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb90fe640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb4093be0 con 0x7efdb41274e0 2024-03-20T13:38:23.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb90fe640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb40961f0 con 0x7efdb412b1b0 2024-03-20T13:38:23.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb2d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efdb412b1b0 0x7efdb412b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb2d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efdb412b1b0 0x7efdb412b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42604/0 (socket says 172.21.15.89:42604) 2024-03-20T13:38:23.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb2d9d640 1 -- 172.21.15.89:0/1505457205 learned_addr learned my addr 172.21.15.89:0/1505457205 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:23.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb2d9d640 1 -- 172.21.15.89:0/1505457205 >> v1:172.21.15.89:6789/0 conn(0x7efdb41274e0 legacy=0x7efdb4127950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.222+0000 7efdb2d9d640 1 -- 172.21.15.89:0/1505457205 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb406cf90 con 0x7efdb412b1b0 2024-03-20T13:38:23.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb2d9d640 1 --2- 172.21.15.89:0/1505457205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb412b1b0 0x7efdb412b590 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efdac009e50 tx=0x7efdac01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c070f1e1ec6fa591 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb1d9b640 1 -- 172.21.15.89:0/1505457205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdac009200 con 0x7efdb412b1b0 2024-03-20T13:38:23.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb1d9b640 1 -- 172.21.15.89:0/1505457205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0a57e0 con 0x7efdb412b1b0 2024-03-20T13:38:23.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb1d9b640 1 -- 172.21.15.89:0/1505457205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdac0a5aa0 con 0x7efdb412b1b0 2024-03-20T13:38:23.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/1505457205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb412b1b0 msgr2=0x7efdb412b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 --2- 172.21.15.89:0/1505457205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb412b1b0 0x7efdb412b590 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efdac009e50 tx=0x7efdac01c980 comp rx=0 tx=0).stop 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/1505457205 shutdown_connections 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 --2- 172.21.15.89:0/1505457205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb412b1b0 0x7efdb412b590 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/1505457205 >> 172.21.15.89:0/1505457205 conn(0x7efdb409a050 msgr2=0x7efdb409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/1505457205 shutdown_connections 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/1505457205 wait complete. 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 Processor -- start 2024-03-20T13:38:23.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- start start 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 0x7efdb4131d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4130330 con 0x7efdb41274e0 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 0x7efdb4131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 0x7efdb4131d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42614/0 (socket says 172.21.15.89:42614) 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb2d9d640 1 -- 172.21.15.89:0/2377791934 learned_addr learned my addr 172.21.15.89:0/2377791934 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb2d9d640 1 -- 172.21.15.89:0/2377791934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009b30 con 0x7efdb41274e0 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb2d9d640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 0x7efdb4131d60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efdac01a5b0 tx=0x7efdac019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdac007930 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac007a90 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb4132e20 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdac007d30 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb4133ab0 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.226+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdb4125aa0 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efdac0b8470 con 0x7efdb41274e0 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efda0035a10 0x7efda0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efdac0e44e0 con 0x7efdb41274e0 2024-03-20T13:38:23.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7efda0041e80 0x7efda0044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efda00449f0 con 0x7efda0041e80 2024-03-20T13:38:23.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdac0e6a90 con 0x7efdb41274e0 2024-03-20T13:38:23.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efdb259c640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efda0035a10 0x7efda0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efdb359e640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7efda0041e80 0x7efda0044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efdb359e640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7efda0041e80 0x7efda0044320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efdb259c640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efda0035a10 0x7efda0037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efda8000f70 tx=0x7efda8007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.230+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== osd.3 v2:172.21.15.123:6816/3519650013 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efda00449f0 con 0x7efda0041e80 2024-03-20T13:38:23.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.242+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 --> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efdb4130670 con 0x7efda0041e80 2024-03-20T13:38:23.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efd9b7fe640 1 -- 172.21.15.89:0/2377791934 <== osd.3 v2:172.21.15.123:6816/3519650013 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efdb4130670 con 0x7efda0041e80 2024-03-20T13:38:23.247 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-03-20T13:38:23.248 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:38:23.248 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7efda0041e80 msgr2=0x7efda0044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7efda0041e80 0x7efda0044320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efda0035a10 msgr2=0x7efda0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efda0035a10 0x7efda0037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efda8000f70 tx=0x7efda8007a40 comp rx=0 tx=0).stop 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 msgr2=0x7efdb4131d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 0x7efdb4131d60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efdac01a5b0 tx=0x7efdac019720 comp rx=0 tx=0).stop 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 shutdown_connections 2024-03-20T13:38:23.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6816/3519650013,v1:172.21.15.123:6817/3519650013] conn(0x7efda0041e80 0x7efda0044320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7efda0035a10 0x7efda0037ed0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 --2- 172.21.15.89:0/2377791934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb41274e0 0x7efdb4131d60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 >> 172.21.15.89:0/2377791934 conn(0x7efdb409a050 msgr2=0x7efdb4096980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 shutdown_connections 2024-03-20T13:38:23.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.246+0000 7efdb90fe640 1 -- 172.21.15.89:0/2377791934 wait complete. 2024-03-20T13:38:23.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-20T13:38:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7298794640 1 Processor -- start 2024-03-20T13:38:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7298794640 1 -- start start 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7298794640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7290093d20 0x7f7290094100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7298794640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900936c0 con 0x7f7290095700 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7298794640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7290094640 con 0x7f7290093d20 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7296530640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7290093d20 0x7f7290094100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7295d2f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7290095700 0x7f7290128560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56748/0 (socket says 172.21.15.89:56748) 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7295d2f640 1 -- 172.21.15.89:0/3160924321 learned_addr learned my addr 172.21.15.89:0/3160924321 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f729552e640 1 -- 172.21.15.89:0/3160924321 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453527047 0 0) 0x7f72900936c0 con 0x7f7290095700 2024-03-20T13:38:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f729552e640 1 -- 172.21.15.89:0/3160924321 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f727c003530 con 0x7f7290095700 2024-03-20T13:38:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7296530640 1 -- 172.21.15.89:0/3160924321 >> v1:172.21.15.89:6789/0 conn(0x7f7290095700 legacy=0x7f7290128560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.370+0000 7f7296530640 1 -- 172.21.15.89:0/3160924321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900938f0 con 0x7f7290093d20 2024-03-20T13:38:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7296530640 1 --2- 172.21.15.89:0/3160924321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f7290094100 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7284009740 tx=0x7f728401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba87bea161de3d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f729552e640 1 -- 172.21.15.89:0/3160924321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7290096080 con 0x7f7290093d20 2024-03-20T13:38:23.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f729552e640 1 -- 172.21.15.89:0/3160924321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72840a7050 con 0x7f7290093d20 2024-03-20T13:38:23.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f729552e640 1 -- 172.21.15.89:0/3160924321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72840ab680 con 0x7f7290093d20 2024-03-20T13:38:23.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- 172.21.15.89:0/3160924321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 msgr2=0x7f7290094100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 --2- 172.21.15.89:0/3160924321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f7290094100 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7284009740 tx=0x7f728401c370 comp rx=0 tx=0).stop 2024-03-20T13:38:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- 172.21.15.89:0/3160924321 shutdown_connections 2024-03-20T13:38:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 --2- 172.21.15.89:0/3160924321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f7290094100 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- 172.21.15.89:0/3160924321 >> 172.21.15.89:0/3160924321 conn(0x7f729009a0c0 msgr2=0x7f729009a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- 172.21.15.89:0/3160924321 shutdown_connections 2024-03-20T13:38:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- 172.21.15.89:0/3160924321 wait complete. 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 Processor -- start 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- start start 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f72901c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7298794640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7290128920 con 0x7f7290093d20 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7296530640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f72901c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7296530640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f72901c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42636/0 (socket says 172.21.15.89:42636) 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7296530640 1 -- 172.21.15.89:0/2106467464 learned_addr learned my addr 172.21.15.89:0/2106467464 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7296530640 1 -- 172.21.15.89:0/2106467464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284009420 con 0x7f7290093d20 2024-03-20T13:38:23.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7296530640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f72901c3550 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7284019fa0 tx=0x7f728401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72840abe10 con 0x7f7290093d20 2024-03-20T13:38:23.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72840b7450 con 0x7f7290093d20 2024-03-20T13:38:23.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.374+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72840b76f0 con 0x7f7290093d20 2024-03-20T13:38:23.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7290125500 con 0x7f7290093d20 2024-03-20T13:38:23.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72901250b0 con 0x7f7290093d20 2024-03-20T13:38:23.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72840b7850 con 0x7f7290093d20 2024-03-20T13:38:23.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7290125a10 con 0x7f7290093d20 2024-03-20T13:38:23.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7282ffd640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f72740359c0 0x7f7274037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f72840e31d0 con 0x7f7290093d20 2024-03-20T13:38:23.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7295d2f640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f72740359c0 0x7f7274037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.378+0000 7f7295d2f640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f72740359c0 0x7f7274037e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f728c001570 tx=0x7f728c0016e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.382+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72840c74e0 con 0x7f7290093d20 2024-03-20T13:38:23.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.534+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7290062860 con 0x7f72740359c0 2024-03-20T13:38:23.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7282ffd640 1 -- 172.21.15.89:0/2106467464 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7290062860 con 0x7f72740359c0 2024-03-20T13:38:23.540 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2024-03-20T13:38:23.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f72740359c0 msgr2=0x7f7274037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f72740359c0 0x7f7274037e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f728c001570 tx=0x7f728c0016e0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 msgr2=0x7f72901c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f72901c3550 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7284019fa0 tx=0x7f728401abb0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 shutdown_connections 2024-03-20T13:38:23.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f72740359c0 0x7f7274037e80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 --2- 172.21.15.89:0/2106467464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7290093d20 0x7f72901c3550 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 >> 172.21.15.89:0/2106467464 conn(0x7f729009a0c0 msgr2=0x7f729012c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 shutdown_connections 2024-03-20T13:38:23.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.538+0000 7f7298794640 1 -- 172.21.15.89:0/2106467464 wait complete. 2024-03-20T13:38:23.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:38:23.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.658+0000 7f7a6c256640 1 Processor -- start 2024-03-20T13:38:23.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.658+0000 7f7a6c256640 1 -- start start 2024-03-20T13:38:23.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.658+0000 7f7a6c256640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a64098830 0x7f7a64098c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.658+0000 7f7a6c256640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6409a490 con 0x7f7a64099150 2024-03-20T13:38:23.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.658+0000 7f7a6c256640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a64072800 con 0x7f7a64098830 2024-03-20T13:38:23.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a697f1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7a64099150 0x7f7a64096490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56754/0 (socket says 172.21.15.89:56754) 2024-03-20T13:38:23.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a69ff2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a64098830 0x7f7a64098c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a697f1640 1 -- 172.21.15.89:0/3795240593 learned_addr learned my addr 172.21.15.89:0/3795240593 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:38:23.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a69ff2640 1 -- 172.21.15.89:0/3795240593 >> v1:172.21.15.89:6789/0 conn(0x7f7a64099150 legacy=0x7f7a64096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a69ff2640 1 -- 172.21.15.89:0/3795240593 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6409d790 con 0x7f7a64098830 2024-03-20T13:38:23.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a68ff0640 1 -- 172.21.15.89:0/3795240593 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253046255 0 0) 0x7f7a6409a490 con 0x7f7a64099150 2024-03-20T13:38:23.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a69ff2640 1 --2- 172.21.15.89:0/3795240593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a64098c10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009740 tx=0x7f7a6001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0ee08657379f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a68ff0640 1 -- 172.21.15.89:0/3795240593 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a600ab530 con 0x7f7a64098830 2024-03-20T13:38:23.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a68ff0640 1 -- 172.21.15.89:0/3795240593 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a600a7050 con 0x7f7a64098830 2024-03-20T13:38:23.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a68ff0640 1 -- 172.21.15.89:0/3795240593 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a600ab7e0 con 0x7f7a64098830 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 -- 172.21.15.89:0/3795240593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 msgr2=0x7f7a64098c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 --2- 172.21.15.89:0/3795240593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a64098c10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009740 tx=0x7f7a6001c370 comp rx=0 tx=0).stop 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 -- 172.21.15.89:0/3795240593 shutdown_connections 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 --2- 172.21.15.89:0/3795240593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a64098c10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 -- 172.21.15.89:0/3795240593 >> 172.21.15.89:0/3795240593 conn(0x7f7a640a0920 msgr2=0x7f7a6409ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 -- 172.21.15.89:0/3795240593 shutdown_connections 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.662+0000 7f7a6c256640 1 -- 172.21.15.89:0/3795240593 wait complete. 2024-03-20T13:38:23.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 Processor -- start 2024-03-20T13:38:23.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 -- start start 2024-03-20T13:38:23.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a641c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641317f0 con 0x7f7a64098830 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a69ff2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a641c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a69ff2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a641c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42654/0 (socket says 172.21.15.89:42654) 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a69ff2640 1 -- 172.21.15.89:0/1701229498 learned_addr learned my addr 172.21.15.89:0/1701229498 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a69ff2640 1 -- 172.21.15.89:0/1701229498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a60009420 con 0x7f7a64098830 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a69ff2640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a641c5750 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7a60019fa0 tx=0x7f7a6001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a600abea0 con 0x7f7a64098830 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a60004020 con 0x7f7a64098830 2024-03-20T13:38:23.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a64132fc0 con 0x7f7a64098830 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a600042c0 con 0x7f7a64098830 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a64132410 con 0x7f7a64098830 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a64131340 con 0x7f7a64098830 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7a600b2050 con 0x7f7a64098830 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a5a7fc640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7a48035a10 0x7f7a48037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7a600e2bd0 con 0x7f7a64098830 2024-03-20T13:38:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a697f1640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7a48035a10 0x7f7a48037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:23.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.666+0000 7f7a697f1640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7a48035a10 0x7f7a48037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007fd0 tx=0x7f7a54007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:23.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.670+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7a64131340 con 0x7f7a64098830 2024-03-20T13:38:23.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.814+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a64131340 con 0x7f7a48035a10 2024-03-20T13:38:23.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.862+0000 7f7a5a7fc640 1 -- 172.21.15.89:0/1701229498 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673707 (secure 0 0 0) 0x7f7a64131340 con 0x7f7a48035a10 2024-03-20T13:38:23.869 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:38:23.875 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7a48035a10 msgr2=0x7f7a48037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7a48035a10 0x7f7a48037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007fd0 tx=0x7f7a54007980 comp rx=0 tx=0).stop 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 msgr2=0x7f7a641c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a641c5750 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7a60019fa0 tx=0x7f7a6001abb0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 shutdown_connections 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f7a48035a10 0x7f7a48037ed0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 --2- 172.21.15.89:0/1701229498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a64098830 0x7f7a641c5750 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:23.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 >> 172.21.15.89:0/1701229498 conn(0x7f7a640a0920 msgr2=0x7f7a6412daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 shutdown_connections 2024-03-20T13:38:23.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:23.866+0000 7f7a6c256640 1 -- 172.21.15.89:0/1701229498 wait complete. 2024-03-20T13:38:23.884 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-03-20T13:38:22.322689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3999,"num_read_kb":3645,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3797,"ondisk_log_size":3797,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-824,"num_objects":-17,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17,"num_whiteouts":0,"num_read":393,"num_read_kb":391,"num_write":119,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.041365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353220+0000","last_change":"2024-03-20T13:36:36.834585+0000","last_active":"2024-03-20T13:37:17.353220+0000","last_peered":"2024-03-20T13:37:17.353220+0000","last_clean":"2024-03-20T13:37:17.353220+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:37:17.353220+0000","last_undegraded":"2024-03-20T13:37:17.353220+0000","last_fullsized":"2024-03-20T13:37:17.353220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:42.695830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348328+0000","last_change":"2024-03-20T13:36:38.833359+0000","last_active":"2024-03-20T13:37:17.348328+0000","last_peered":"2024-03-20T13:37:17.348328+0000","last_clean":"2024-03-20T13:37:17.348328+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:37:17.348328+0000","last_undegraded":"2024-03-20T13:37:17.348328+0000","last_fullsized":"2024-03-20T13:37:17.348328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359019+0000","last_change":"2024-03-20T13:36:36.849152+0000","last_active":"2024-03-20T13:37:17.359019+0000","last_peered":"2024-03-20T13:37:17.359019+0000","last_clean":"2024-03-20T13:37:17.359019+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:37:17.359019+0000","last_undegraded":"2024-03-20T13:37:17.359019+0000","last_fullsized":"2024-03-20T13:37:17.359019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:26.137179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038312+0000","last_change":"2024-03-20T13:36:38.817960+0000","last_active":"2024-03-20T13:38:11.038312+0000","last_peered":"2024-03-20T13:38:11.038312+0000","last_clean":"2024-03-20T13:38:11.038312+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:38:11.038312+0000","last_undegraded":"2024-03-20T13:38:11.038312+0000","last_fullsized":"2024-03-20T13:38:11.038312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:21:08.799966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351979+0000","last_change":"2024-03-20T13:36:36.848291+0000","last_active":"2024-03-20T13:37:17.351979+0000","last_peered":"2024-03-20T13:37:17.351979+0000","last_clean":"2024-03-20T13:37:17.351979+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:37:17.351979+0000","last_undegraded":"2024-03-20T13:37:17.351979+0000","last_fullsized":"2024-03-20T13:37:17.351979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559658+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:04.559658+0000","last_peered":"2024-03-20T13:38:04.559658+0000","last_clean":"2024-03-20T13:38:04.559658+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:04.559658+0000","last_undegraded":"2024-03-20T13:38:04.559658+0000","last_fullsized":"2024-03-20T13:38:04.559658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:50.112294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338808+0000","last_change":"2024-03-20T13:36:36.813481+0000","last_active":"2024-03-20T13:37:17.338808+0000","last_peered":"2024-03-20T13:37:17.338808+0000","last_clean":"2024-03-20T13:37:17.338808+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:37:17.338808+0000","last_undegraded":"2024-03-20T13:37:17.338808+0000","last_fullsized":"2024-03-20T13:37:17.338808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:54.373470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.335849+0000","last_change":"2024-03-20T13:36:38.821653+0000","last_active":"2024-03-20T13:37:21.335849+0000","last_peered":"2024-03-20T13:37:21.335849+0000","last_clean":"2024-03-20T13:37:21.335849+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:37:21.335849+0000","last_undegraded":"2024-03-20T13:37:21.335849+0000","last_fullsized":"2024-03-20T13:37:21.335849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.030141+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:11.030141+0000","last_peered":"2024-03-20T13:38:11.030141+0000","last_clean":"2024-03-20T13:38:11.030141+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:11.030141+0000","last_undegraded":"2024-03-20T13:38:11.030141+0000","last_fullsized":"2024-03-20T13:38:11.030141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361558+0000","last_change":"2024-03-20T13:36:38.841957+0000","last_active":"2024-03-20T13:38:05.361558+0000","last_peered":"2024-03-20T13:38:05.361558+0000","last_clean":"2024-03-20T13:38:05.361558+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:05.361558+0000","last_undegraded":"2024-03-20T13:38:05.361558+0000","last_fullsized":"2024-03-20T13:38:05.361558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:10.770393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349494+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:37:17.349494+0000","last_peered":"2024-03-20T13:37:17.349494+0000","last_clean":"2024-03-20T13:37:17.349494+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:37:17.349494+0000","last_undegraded":"2024-03-20T13:37:17.349494+0000","last_fullsized":"2024-03-20T13:37:17.349494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.779828+0000","last_change":"2024-03-20T13:36:38.846021+0000","last_active":"2024-03-20T13:37:21.779828+0000","last_peered":"2024-03-20T13:37:21.779828+0000","last_clean":"2024-03-20T13:37:21.779828+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:37:21.779828+0000","last_undegraded":"2024-03-20T13:37:21.779828+0000","last_fullsized":"2024-03-20T13:37:21.779828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342434+0000","last_change":"2024-03-20T13:36:36.844496+0000","last_active":"2024-03-20T13:37:17.342434+0000","last_peered":"2024-03-20T13:37:17.342434+0000","last_clean":"2024-03-20T13:37:17.342434+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:37:17.342434+0000","last_undegraded":"2024-03-20T13:37:17.342434+0000","last_fullsized":"2024-03-20T13:37:17.342434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356403+0000","last_change":"2024-03-20T13:36:38.843718+0000","last_active":"2024-03-20T13:37:17.356403+0000","last_peered":"2024-03-20T13:37:17.356403+0000","last_clean":"2024-03-20T13:37:17.356403+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:37:17.356403+0000","last_undegraded":"2024-03-20T13:37:17.356403+0000","last_fullsized":"2024-03-20T13:37:17.356403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:16.103447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.529939+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:37:20.529939+0000","last_peered":"2024-03-20T13:37:20.529939+0000","last_clean":"2024-03-20T13:37:20.529939+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:37:20.529939+0000","last_undegraded":"2024-03-20T13:37:20.529939+0000","last_fullsized":"2024-03-20T13:37:20.529939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:29.131356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048710+0000","last_change":"2024-03-20T13:36:38.830884+0000","last_active":"2024-03-20T13:38:11.048710+0000","last_peered":"2024-03-20T13:38:11.048710+0000","last_clean":"2024-03-20T13:38:11.048710+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:11.048710+0000","last_undegraded":"2024-03-20T13:38:11.048710+0000","last_fullsized":"2024-03-20T13:38:11.048710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:06.433353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348004+0000","last_change":"2024-03-20T13:36:38.833138+0000","last_active":"2024-03-20T13:37:17.348004+0000","last_peered":"2024-03-20T13:37:17.348004+0000","last_clean":"2024-03-20T13:37:17.348004+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:37:17.348004+0000","last_undegraded":"2024-03-20T13:37:17.348004+0000","last_fullsized":"2024-03-20T13:37:17.348004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.070212+0000","last_change":"2024-03-20T13:36:36.832461+0000","last_active":"2024-03-20T13:37:22.070212+0000","last_peered":"2024-03-20T13:37:22.070212+0000","last_clean":"2024-03-20T13:37:22.070212+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:37:22.070212+0000","last_undegraded":"2024-03-20T13:37:22.070212+0000","last_fullsized":"2024-03-20T13:37:22.070212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:29:37.186470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.039239+0000","last_change":"2024-03-20T13:36:38.843593+0000","last_active":"2024-03-20T13:38:11.039239+0000","last_peered":"2024-03-20T13:38:11.039239+0000","last_clean":"2024-03-20T13:38:11.039239+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:11.039239+0000","last_undegraded":"2024-03-20T13:38:11.039239+0000","last_fullsized":"2024-03-20T13:38:11.039239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347887+0000","last_change":"2024-03-20T13:36:36.818443+0000","last_active":"2024-03-20T13:37:17.347887+0000","last_peered":"2024-03-20T13:37:17.347887+0000","last_clean":"2024-03-20T13:37:17.347887+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:37:17.347887+0000","last_undegraded":"2024-03-20T13:37:17.347887+0000","last_fullsized":"2024-03-20T13:37:17.347887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:58:23.109004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362815+0000","last_change":"2024-03-20T13:36:38.831759+0000","last_active":"2024-03-20T13:38:05.362815+0000","last_peered":"2024-03-20T13:38:05.362815+0000","last_clean":"2024-03-20T13:38:05.362815+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:05.362815+0000","last_undegraded":"2024-03-20T13:38:05.362815+0000","last_fullsized":"2024-03-20T13:38:05.362815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:21.180969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353762+0000","last_change":"2024-03-20T13:36:36.840606+0000","last_active":"2024-03-20T13:37:17.353762+0000","last_peered":"2024-03-20T13:37:17.353762+0000","last_clean":"2024-03-20T13:37:17.353762+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:37:17.353762+0000","last_undegraded":"2024-03-20T13:37:17.353762+0000","last_fullsized":"2024-03-20T13:37:17.353762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038457+0000","last_change":"2024-03-20T13:36:38.828329+0000","last_active":"2024-03-20T13:38:11.038457+0000","last_peered":"2024-03-20T13:38:11.038457+0000","last_clean":"2024-03-20T13:38:11.038457+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:11.038457+0000","last_undegraded":"2024-03-20T13:38:11.038457+0000","last_fullsized":"2024-03-20T13:38:11.038457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:12.734298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.088045+0000","last_change":"2024-03-20T13:36:36.826166+0000","last_active":"2024-03-20T13:37:22.088045+0000","last_peered":"2024-03-20T13:37:22.088045+0000","last_clean":"2024-03-20T13:37:22.088045+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:37:22.088045+0000","last_undegraded":"2024-03-20T13:37:22.088045+0000","last_fullsized":"2024-03-20T13:37:22.088045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.337413+0000","last_change":"2024-03-20T13:36:38.825590+0000","last_active":"2024-03-20T13:37:21.337413+0000","last_peered":"2024-03-20T13:37:21.337413+0000","last_clean":"2024-03-20T13:37:21.337413+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:37:21.337413+0000","last_undegraded":"2024-03-20T13:37:21.337413+0000","last_fullsized":"2024-03-20T13:37:21.337413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:35.374667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355672+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:37:17.355672+0000","last_peered":"2024-03-20T13:37:17.355672+0000","last_clean":"2024-03-20T13:37:17.355672+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:37:17.355672+0000","last_undegraded":"2024-03-20T13:37:17.355672+0000","last_fullsized":"2024-03-20T13:37:17.355672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:42:27.631307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.336262+0000","last_change":"2024-03-20T13:36:38.836549+0000","last_active":"2024-03-20T13:37:21.336262+0000","last_peered":"2024-03-20T13:37:21.336262+0000","last_clean":"2024-03-20T13:37:21.336262+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:37:21.336262+0000","last_undegraded":"2024-03-20T13:37:21.336262+0000","last_fullsized":"2024-03-20T13:37:21.336262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:33.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356996+0000","last_change":"2024-03-20T13:36:36.848317+0000","last_active":"2024-03-20T13:37:17.356996+0000","last_peered":"2024-03-20T13:37:17.356996+0000","last_clean":"2024-03-20T13:37:17.356996+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:37:17.356996+0000","last_undegraded":"2024-03-20T13:37:17.356996+0000","last_fullsized":"2024-03-20T13:37:17.356996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:49:33.359864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.021474+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:11.021474+0000","last_peered":"2024-03-20T13:38:11.021474+0000","last_clean":"2024-03-20T13:38:11.021474+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:11.021474+0000","last_undegraded":"2024-03-20T13:38:11.021474+0000","last_fullsized":"2024-03-20T13:38:11.021474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:59:50.691433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361696+0000","last_change":"2024-03-20T13:36:38.833120+0000","last_active":"2024-03-20T13:38:05.361696+0000","last_peered":"2024-03-20T13:38:05.361696+0000","last_clean":"2024-03-20T13:38:05.361696+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:05.361696+0000","last_undegraded":"2024-03-20T13:38:05.361696+0000","last_fullsized":"2024-03-20T13:38:05.361696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350014+0000","last_change":"2024-03-20T13:36:36.847955+0000","last_active":"2024-03-20T13:37:17.350014+0000","last_peered":"2024-03-20T13:37:17.350014+0000","last_clean":"2024-03-20T13:37:17.350014+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:37:17.350014+0000","last_undegraded":"2024-03-20T13:37:17.350014+0000","last_fullsized":"2024-03-20T13:37:17.350014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358800+0000","last_change":"2024-03-20T13:36:40.850195+0000","last_active":"2024-03-20T13:37:17.358800+0000","last_peered":"2024-03-20T13:37:17.358800+0000","last_clean":"2024-03-20T13:37:17.358800+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:37:17.358800+0000","last_undegraded":"2024-03-20T13:37:17.358800+0000","last_fullsized":"2024-03-20T13:37:17.358800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'31","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.108385+0000","last_change":"2024-03-20T13:36:42.847305+0000","last_active":"2024-03-20T13:38:19.108385+0000","last_peered":"2024-03-20T13:38:19.108385+0000","last_clean":"2024-03-20T13:38:19.108385+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:19.108385+0000","last_undegraded":"2024-03-20T13:38:19.108385+0000","last_fullsized":"2024-03-20T13:38:19.108385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351069+0000","last_change":"2024-03-20T13:36:44.870120+0000","last_active":"2024-03-20T13:37:17.351069+0000","last_peered":"2024-03-20T13:37:17.351069+0000","last_clean":"2024-03-20T13:37:17.351069+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:37:17.351069+0000","last_undegraded":"2024-03-20T13:37:17.351069+0000","last_fullsized":"2024-03-20T13:37:17.351069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:00.348882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.510685+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:37:59.510685+0000","last_peered":"2024-03-20T13:37:59.510685+0000","last_clean":"2024-03-20T13:37:59.510685+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:37:59.510685+0000","last_undegraded":"2024-03-20T13:37:59.510685+0000","last_fullsized":"2024-03-20T13:37:59.510685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099067+0000","last_change":"2024-03-20T13:36:38.822857+0000","last_active":"2024-03-20T13:37:22.099067+0000","last_peered":"2024-03-20T13:37:22.099067+0000","last_clean":"2024-03-20T13:37:22.099067+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:37:22.099067+0000","last_undegraded":"2024-03-20T13:37:22.099067+0000","last_fullsized":"2024-03-20T13:37:22.099067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337639+0000","last_change":"2024-03-20T13:36:36.815979+0000","last_active":"2024-03-20T13:37:17.337639+0000","last_peered":"2024-03-20T13:37:17.337639+0000","last_clean":"2024-03-20T13:37:17.337639+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:37:17.337639+0000","last_undegraded":"2024-03-20T13:37:17.337639+0000","last_fullsized":"2024-03-20T13:37:17.337639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:15:50.640696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351375+0000","last_change":"2024-03-20T13:36:40.852967+0000","last_active":"2024-03-20T13:37:17.351375+0000","last_peered":"2024-03-20T13:37:17.351375+0000","last_clean":"2024-03-20T13:37:17.351375+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:37:17.351375+0000","last_undegraded":"2024-03-20T13:37:17.351375+0000","last_fullsized":"2024-03-20T13:37:17.351375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:13:55.770914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358636+0000","last_change":"2024-03-20T13:36:42.851506+0000","last_active":"2024-03-20T13:37:17.358636+0000","last_peered":"2024-03-20T13:37:17.358636+0000","last_clean":"2024-03-20T13:37:17.358636+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:37:17.358636+0000","last_undegraded":"2024-03-20T13:37:17.358636+0000","last_fullsized":"2024-03-20T13:37:17.358636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:47:54.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352979+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:37:17.352979+0000","last_peered":"2024-03-20T13:37:17.352979+0000","last_clean":"2024-03-20T13:37:17.352979+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:37:17.352979+0000","last_undegraded":"2024-03-20T13:37:17.352979+0000","last_fullsized":"2024-03-20T13:37:17.352979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:55:33.559340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355634+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:37:17.355634+0000","last_peered":"2024-03-20T13:37:17.355634+0000","last_clean":"2024-03-20T13:37:17.355634+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:37:17.355634+0000","last_undegraded":"2024-03-20T13:37:17.355634+0000","last_fullsized":"2024-03-20T13:37:17.355634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:19.393599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038369+0000","last_change":"2024-03-20T13:37:17.351202+0000","last_active":"2024-03-20T13:38:11.038369+0000","last_peered":"2024-03-20T13:38:11.038369+0000","last_clean":"2024-03-20T13:38:11.038369+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:38:11.038369+0000","last_undegraded":"2024-03-20T13:38:11.038369+0000","last_fullsized":"2024-03-20T13:38:11.038369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:50.469038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347515+0000","last_change":"2024-03-20T13:36:36.825659+0000","last_active":"2024-03-20T13:37:17.347515+0000","last_peered":"2024-03-20T13:37:17.347515+0000","last_clean":"2024-03-20T13:37:17.347515+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:37:17.347515+0000","last_undegraded":"2024-03-20T13:37:17.347515+0000","last_fullsized":"2024-03-20T13:37:17.347515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:45.838351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359882+0000","last_change":"2024-03-20T13:36:40.850731+0000","last_active":"2024-03-20T13:37:17.359882+0000","last_peered":"2024-03-20T13:37:17.359882+0000","last_clean":"2024-03-20T13:37:17.359882+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:37:17.359882+0000","last_undegraded":"2024-03-20T13:37:17.359882+0000","last_fullsized":"2024-03-20T13:37:17.359882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:23:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338522+0000","last_change":"2024-03-20T13:36:42.855730+0000","last_active":"2024-03-20T13:37:17.338522+0000","last_peered":"2024-03-20T13:37:17.338522+0000","last_clean":"2024-03-20T13:37:17.338522+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:37:17.338522+0000","last_undegraded":"2024-03-20T13:37:17.338522+0000","last_fullsized":"2024-03-20T13:37:17.338522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:03:28.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'243","reported_seq":308,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.780283+0000","last_change":"2024-03-20T13:36:44.878389+0000","last_active":"2024-03-20T13:38:18.780283+0000","last_peered":"2024-03-20T13:38:18.780283+0000","last_clean":"2024-03-20T13:38:18.780283+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:38:18.780283+0000","last_undegraded":"2024-03-20T13:38:18.780283+0000","last_fullsized":"2024-03-20T13:38:18.780283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:53.957445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335764+0000","last_change":"2024-03-20T13:36:46.888952+0000","last_active":"2024-03-20T13:37:17.335764+0000","last_peered":"2024-03-20T13:37:17.335764+0000","last_clean":"2024-03-20T13:37:17.335764+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:37:17.335764+0000","last_undegraded":"2024-03-20T13:37:17.335764+0000","last_fullsized":"2024-03-20T13:37:17.335764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:04:07.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.804073+0000","last_change":"2024-03-20T13:36:38.835366+0000","last_active":"2024-03-20T13:37:22.804073+0000","last_peered":"2024-03-20T13:37:22.804073+0000","last_clean":"2024-03-20T13:37:22.804073+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:37:22.804073+0000","last_undegraded":"2024-03-20T13:37:22.804073+0000","last_fullsized":"2024-03-20T13:37:22.804073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:54:35.239357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347002+0000","last_change":"2024-03-20T13:36:36.838074+0000","last_active":"2024-03-20T13:37:17.347002+0000","last_peered":"2024-03-20T13:37:17.347002+0000","last_clean":"2024-03-20T13:37:17.347002+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:37:17.347002+0000","last_undegraded":"2024-03-20T13:37:17.347002+0000","last_fullsized":"2024-03-20T13:37:17.347002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356582+0000","last_change":"2024-03-20T13:36:40.859660+0000","last_active":"2024-03-20T13:37:17.356582+0000","last_peered":"2024-03-20T13:37:17.356582+0000","last_clean":"2024-03-20T13:37:17.356582+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:37:17.356582+0000","last_undegraded":"2024-03-20T13:37:17.356582+0000","last_fullsized":"2024-03-20T13:37:17.356582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:53.175825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'31","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.063181+0000","last_change":"2024-03-20T13:36:42.860645+0000","last_active":"2024-03-20T13:38:19.063181+0000","last_peered":"2024-03-20T13:38:19.063181+0000","last_clean":"2024-03-20T13:38:19.063181+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:19.063181+0000","last_undegraded":"2024-03-20T13:38:19.063181+0000","last_fullsized":"2024-03-20T13:38:19.063181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:31:48.342447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'243","reported_seq":322,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.784502+0000","last_change":"2024-03-20T13:36:44.897812+0000","last_active":"2024-03-20T13:38:18.784502+0000","last_peered":"2024-03-20T13:38:18.784502+0000","last_clean":"2024-03-20T13:38:18.784502+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:18.784502+0000","last_undegraded":"2024-03-20T13:38:18.784502+0000","last_fullsized":"2024-03-20T13:38:18.784502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:31.390443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357541+0000","last_change":"2024-03-20T13:37:17.356166+0000","last_active":"2024-03-20T13:37:17.357541+0000","last_peered":"2024-03-20T13:37:17.357541+0000","last_clean":"2024-03-20T13:37:17.357541+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:37:17.357541+0000","last_undegraded":"2024-03-20T13:37:17.357541+0000","last_fullsized":"2024-03-20T13:37:17.357541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:05.594184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353407+0000","last_change":"2024-03-20T13:36:36.834443+0000","last_active":"2024-03-20T13:37:17.353407+0000","last_peered":"2024-03-20T13:37:17.353407+0000","last_clean":"2024-03-20T13:37:17.353407+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:37:17.353407+0000","last_undegraded":"2024-03-20T13:37:17.353407+0000","last_fullsized":"2024-03-20T13:37:17.353407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:29:03.754269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344058+0000","last_change":"2024-03-20T13:36:40.857714+0000","last_active":"2024-03-20T13:37:17.344058+0000","last_peered":"2024-03-20T13:37:17.344058+0000","last_clean":"2024-03-20T13:37:17.344058+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:37:17.344058+0000","last_undegraded":"2024-03-20T13:37:17.344058+0000","last_fullsized":"2024-03-20T13:37:17.344058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:24:44.271212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.886395+0000","last_change":"2024-03-20T13:36:42.873431+0000","last_active":"2024-03-20T13:38:18.886395+0000","last_peered":"2024-03-20T13:38:18.886395+0000","last_clean":"2024-03-20T13:38:18.886395+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:18.886395+0000","last_undegraded":"2024-03-20T13:38:18.886395+0000","last_fullsized":"2024-03-20T13:38:18.886395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:08:30.363113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349777+0000","last_change":"2024-03-20T13:36:44.866647+0000","last_active":"2024-03-20T13:37:17.349777+0000","last_peered":"2024-03-20T13:37:17.349777+0000","last_clean":"2024-03-20T13:37:17.349777+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:37:17.349777+0000","last_undegraded":"2024-03-20T13:37:17.349777+0000","last_fullsized":"2024-03-20T13:37:17.349777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:19.236268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.105778+0000","last_change":"2024-03-20T13:36:46.889608+0000","last_active":"2024-03-20T13:38:05.105778+0000","last_peered":"2024-03-20T13:38:05.105778+0000","last_clean":"2024-03-20T13:38:05.105778+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:05.105778+0000","last_undegraded":"2024-03-20T13:38:05.105778+0000","last_fullsized":"2024-03-20T13:38:05.105778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:14.771685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345198+0000","last_change":"2024-03-20T13:36:38.831983+0000","last_active":"2024-03-20T13:37:17.345198+0000","last_peered":"2024-03-20T13:37:17.345198+0000","last_clean":"2024-03-20T13:37:17.345198+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:37:17.345198+0000","last_undegraded":"2024-03-20T13:37:17.345198+0000","last_fullsized":"2024-03-20T13:37:17.345198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:57:18.786192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353826+0000","last_change":"2024-03-20T13:36:36.839624+0000","last_active":"2024-03-20T13:37:17.353826+0000","last_peered":"2024-03-20T13:37:17.353826+0000","last_clean":"2024-03-20T13:37:17.353826+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:37:17.353826+0000","last_undegraded":"2024-03-20T13:37:17.353826+0000","last_fullsized":"2024-03-20T13:37:17.353826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:14:30.338597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336329+0000","last_change":"2024-03-20T13:36:40.856999+0000","last_active":"2024-03-20T13:37:17.336329+0000","last_peered":"2024-03-20T13:37:17.336329+0000","last_clean":"2024-03-20T13:37:17.336329+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:37:17.336329+0000","last_undegraded":"2024-03-20T13:37:17.336329+0000","last_fullsized":"2024-03-20T13:37:17.336329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:58.874311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.974450+0000","last_change":"2024-03-20T13:36:42.844797+0000","last_active":"2024-03-20T13:38:18.974450+0000","last_peered":"2024-03-20T13:38:18.974450+0000","last_clean":"2024-03-20T13:38:18.974450+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:18.974450+0000","last_undegraded":"2024-03-20T13:38:18.974450+0000","last_fullsized":"2024-03-20T13:38:18.974450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:15:52.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356072+0000","last_change":"2024-03-20T13:36:44.888691+0000","last_active":"2024-03-20T13:37:17.356072+0000","last_peered":"2024-03-20T13:37:17.356072+0000","last_clean":"2024-03-20T13:37:17.356072+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:37:17.356072+0000","last_undegraded":"2024-03-20T13:37:17.356072+0000","last_fullsized":"2024-03-20T13:37:17.356072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:29.837819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.378145+0000","last_change":"2024-03-20T13:36:46.873147+0000","last_active":"2024-03-20T13:37:59.378145+0000","last_peered":"2024-03-20T13:37:59.378145+0000","last_clean":"2024-03-20T13:37:59.378145+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:37:59.378145+0000","last_undegraded":"2024-03-20T13:37:59.378145+0000","last_fullsized":"2024-03-20T13:37:59.378145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:16.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350555+0000","last_change":"2024-03-20T13:36:38.827772+0000","last_active":"2024-03-20T13:37:17.350555+0000","last_peered":"2024-03-20T13:37:17.350555+0000","last_clean":"2024-03-20T13:37:17.350555+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:37:17.350555+0000","last_undegraded":"2024-03-20T13:37:17.350555+0000","last_fullsized":"2024-03-20T13:37:17.350555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:50.109396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354432+0000","last_change":"2024-03-20T13:36:36.826408+0000","last_active":"2024-03-20T13:37:17.354432+0000","last_peered":"2024-03-20T13:37:17.354432+0000","last_clean":"2024-03-20T13:37:17.354432+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:37:17.354432+0000","last_undegraded":"2024-03-20T13:37:17.354432+0000","last_fullsized":"2024-03-20T13:37:17.354432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:21.851320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338772+0000","last_change":"2024-03-20T13:36:40.846177+0000","last_active":"2024-03-20T13:37:17.338772+0000","last_peered":"2024-03-20T13:37:17.338772+0000","last_clean":"2024-03-20T13:37:17.338772+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:37:17.338772+0000","last_undegraded":"2024-03-20T13:37:17.338772+0000","last_fullsized":"2024-03-20T13:37:17.338772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:09.914384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.898930+0000","last_change":"2024-03-20T13:36:42.841973+0000","last_active":"2024-03-20T13:38:18.898930+0000","last_peered":"2024-03-20T13:38:18.898930+0000","last_clean":"2024-03-20T13:38:18.898930+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:18.898930+0000","last_undegraded":"2024-03-20T13:38:18.898930+0000","last_fullsized":"2024-03-20T13:38:18.898930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'243","reported_seq":287,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.786079+0000","last_change":"2024-03-20T13:36:44.881852+0000","last_active":"2024-03-20T13:38:18.786079+0000","last_peered":"2024-03-20T13:38:18.786079+0000","last_clean":"2024-03-20T13:38:18.786079+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:18.786079+0000","last_undegraded":"2024-03-20T13:38:18.786079+0000","last_fullsized":"2024-03-20T13:38:18.786079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:30:56.157507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351002+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:37:17.351002+0000","last_peered":"2024-03-20T13:37:17.351002+0000","last_clean":"2024-03-20T13:37:17.351002+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:37:17.351002+0000","last_undegraded":"2024-03-20T13:37:17.351002+0000","last_fullsized":"2024-03-20T13:37:17.351002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:18.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361689+0000","last_change":"2024-03-20T13:36:38.840955+0000","last_active":"2024-03-20T13:38:05.361689+0000","last_peered":"2024-03-20T13:38:05.361689+0000","last_clean":"2024-03-20T13:38:05.361689+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:05.361689+0000","last_undegraded":"2024-03-20T13:38:05.361689+0000","last_fullsized":"2024-03-20T13:38:05.361689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:33.249228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350421+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:37:17.350421+0000","last_peered":"2024-03-20T13:37:17.350421+0000","last_clean":"2024-03-20T13:37:17.350421+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:37:17.350421+0000","last_undegraded":"2024-03-20T13:37:17.350421+0000","last_fullsized":"2024-03-20T13:37:17.350421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:45.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343195+0000","last_change":"2024-03-20T13:36:40.845768+0000","last_active":"2024-03-20T13:37:17.343195+0000","last_peered":"2024-03-20T13:37:17.343195+0000","last_clean":"2024-03-20T13:37:17.343195+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:37:17.343195+0000","last_undegraded":"2024-03-20T13:37:17.343195+0000","last_fullsized":"2024-03-20T13:37:17.343195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:33:29.320718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'56","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.998486+0000","last_change":"2024-03-20T13:36:42.869009+0000","last_active":"2024-03-20T13:38:18.998486+0000","last_peered":"2024-03-20T13:38:18.998486+0000","last_clean":"2024-03-20T13:38:18.998486+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:18.998486+0000","last_undegraded":"2024-03-20T13:38:18.998486+0000","last_fullsized":"2024-03-20T13:38:18.998486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:14.441521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335490+0000","last_change":"2024-03-20T13:36:44.867134+0000","last_active":"2024-03-20T13:37:17.335490+0000","last_peered":"2024-03-20T13:37:17.335490+0000","last_clean":"2024-03-20T13:37:17.335490+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:37:17.335490+0000","last_undegraded":"2024-03-20T13:37:17.335490+0000","last_fullsized":"2024-03-20T13:37:17.335490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:26.218996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:46.886740+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:16.012802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.361855+0000","last_change":"2024-03-20T13:36:38.832987+0000","last_active":"2024-03-20T13:38:05.361855+0000","last_peered":"2024-03-20T13:38:05.361855+0000","last_clean":"2024-03-20T13:38:05.361855+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:38:05.361855+0000","last_undegraded":"2024-03-20T13:38:05.361855+0000","last_fullsized":"2024-03-20T13:38:05.361855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:53:17.091959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.064409+0000","last_change":"2024-03-20T13:36:36.846257+0000","last_active":"2024-03-20T13:37:22.064409+0000","last_peered":"2024-03-20T13:37:22.064409+0000","last_clean":"2024-03-20T13:37:22.064409+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:37:22.064409+0000","last_undegraded":"2024-03-20T13:37:22.064409+0000","last_fullsized":"2024-03-20T13:37:22.064409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343865+0000","last_change":"2024-03-20T13:36:40.839225+0000","last_active":"2024-03-20T13:37:17.343865+0000","last_peered":"2024-03-20T13:37:17.343865+0000","last_clean":"2024-03-20T13:37:17.343865+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:37:17.343865+0000","last_undegraded":"2024-03-20T13:37:17.343865+0000","last_fullsized":"2024-03-20T13:37:17.343865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:25.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.008287+0000","last_change":"2024-03-20T13:36:42.876207+0000","last_active":"2024-03-20T13:38:19.008287+0000","last_peered":"2024-03-20T13:38:19.008287+0000","last_clean":"2024-03-20T13:38:19.008287+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:19.008287+0000","last_undegraded":"2024-03-20T13:38:19.008287+0000","last_fullsized":"2024-03-20T13:38:19.008287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:23.373578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360601+0000","last_change":"2024-03-20T13:36:44.899145+0000","last_active":"2024-03-20T13:37:17.360601+0000","last_peered":"2024-03-20T13:37:17.360601+0000","last_clean":"2024-03-20T13:37:17.360601+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:37:17.360601+0000","last_undegraded":"2024-03-20T13:37:17.360601+0000","last_fullsized":"2024-03-20T13:37:17.360601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338015+0000","last_change":"2024-03-20T13:36:46.875764+0000","last_active":"2024-03-20T13:37:17.338015+0000","last_peered":"2024-03-20T13:37:17.338015+0000","last_clean":"2024-03-20T13:37:17.338015+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:37:17.338015+0000","last_undegraded":"2024-03-20T13:37:17.338015+0000","last_fullsized":"2024-03-20T13:37:17.338015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:43.408023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356084+0000","last_change":"2024-03-20T13:36:38.831920+0000","last_active":"2024-03-20T13:37:17.356084+0000","last_peered":"2024-03-20T13:37:17.356084+0000","last_clean":"2024-03-20T13:37:17.356084+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:37:17.356084+0000","last_undegraded":"2024-03-20T13:37:17.356084+0000","last_fullsized":"2024-03-20T13:37:17.356084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.081235+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:37:22.081235+0000","last_peered":"2024-03-20T13:37:22.081235+0000","last_clean":"2024-03-20T13:37:22.081235+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:37:22.081235+0000","last_undegraded":"2024-03-20T13:37:22.081235+0000","last_fullsized":"2024-03-20T13:37:22.081235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350463+0000","last_change":"2024-03-20T13:36:40.847551+0000","last_active":"2024-03-20T13:37:17.350463+0000","last_peered":"2024-03-20T13:37:17.350463+0000","last_clean":"2024-03-20T13:37:17.350463+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:37:17.350463+0000","last_undegraded":"2024-03-20T13:37:17.350463+0000","last_fullsized":"2024-03-20T13:37:17.350463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:03:22.247918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.950853+0000","last_change":"2024-03-20T13:36:42.845589+0000","last_active":"2024-03-20T13:38:18.950853+0000","last_peered":"2024-03-20T13:38:18.950853+0000","last_clean":"2024-03-20T13:38:18.950853+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:18.950853+0000","last_undegraded":"2024-03-20T13:38:18.950853+0000","last_fullsized":"2024-03-20T13:38:18.950853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:56.555692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'243","reported_seq":324,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.779426+0000","last_change":"2024-03-20T13:36:44.879458+0000","last_active":"2024-03-20T13:38:18.779426+0000","last_peered":"2024-03-20T13:38:18.779426+0000","last_clean":"2024-03-20T13:38:18.779426+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:18.779426+0000","last_undegraded":"2024-03-20T13:38:18.779426+0000","last_fullsized":"2024-03-20T13:38:18.779426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:14.860829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.376315+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:05.376315+0000","last_peered":"2024-03-20T13:38:05.376315+0000","last_clean":"2024-03-20T13:38:05.376315+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:05.376315+0000","last_undegraded":"2024-03-20T13:38:05.376315+0000","last_fullsized":"2024-03-20T13:38:05.376315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:30.005016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345914+0000","last_change":"2024-03-20T13:36:38.825748+0000","last_active":"2024-03-20T13:37:17.345914+0000","last_peered":"2024-03-20T13:37:17.345914+0000","last_clean":"2024-03-20T13:37:17.345914+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:37:17.345914+0000","last_undegraded":"2024-03-20T13:37:17.345914+0000","last_fullsized":"2024-03-20T13:37:17.345914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:17.486304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.565297+0000","last_change":"2024-03-20T13:36:36.846954+0000","last_active":"2024-03-20T13:38:04.565297+0000","last_peered":"2024-03-20T13:38:04.565297+0000","last_clean":"2024-03-20T13:38:04.565297+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:38:04.565297+0000","last_undegraded":"2024-03-20T13:38:04.565297+0000","last_fullsized":"2024-03-20T13:38:04.565297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:30.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.752136+0000","last_change":"2024-03-20T13:36:40.855511+0000","last_active":"2024-03-20T13:38:18.752136+0000","last_peered":"2024-03-20T13:38:18.752136+0000","last_clean":"2024-03-20T13:38:18.752136+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:18.752136+0000","last_undegraded":"2024-03-20T13:38:18.752136+0000","last_fullsized":"2024-03-20T13:38:18.752136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:36:09.090540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348292+0000","last_change":"2024-03-20T13:36:42.844667+0000","last_active":"2024-03-20T13:37:17.348292+0000","last_peered":"2024-03-20T13:37:17.348292+0000","last_clean":"2024-03-20T13:37:17.348292+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:37:17.348292+0000","last_undegraded":"2024-03-20T13:37:17.348292+0000","last_fullsized":"2024-03-20T13:37:17.348292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:57.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'243","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.782896+0000","last_change":"2024-03-20T13:36:44.878660+0000","last_active":"2024-03-20T13:38:18.782896+0000","last_peered":"2024-03-20T13:38:18.782896+0000","last_clean":"2024-03-20T13:38:18.782896+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:38:18.782896+0000","last_undegraded":"2024-03-20T13:38:18.782896+0000","last_fullsized":"2024-03-20T13:38:18.782896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:17.394132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335236+0000","last_change":"2024-03-20T13:36:46.894365+0000","last_active":"2024-03-20T13:37:17.335236+0000","last_peered":"2024-03-20T13:37:17.335236+0000","last_clean":"2024-03-20T13:37:17.335236+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:37:17.335236+0000","last_undegraded":"2024-03-20T13:37:17.335236+0000","last_fullsized":"2024-03-20T13:37:17.335236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:16:31.162761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362064+0000","last_change":"2024-03-20T13:36:38.827417+0000","last_active":"2024-03-20T13:38:05.362064+0000","last_peered":"2024-03-20T13:38:05.362064+0000","last_clean":"2024-03-20T13:38:05.362064+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:05.362064+0000","last_undegraded":"2024-03-20T13:38:05.362064+0000","last_fullsized":"2024-03-20T13:38:05.362064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:01.821428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340325+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:37:17.340325+0000","last_peered":"2024-03-20T13:37:17.340325+0000","last_clean":"2024-03-20T13:37:17.340325+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:37:17.340325+0000","last_undegraded":"2024-03-20T13:37:17.340325+0000","last_fullsized":"2024-03-20T13:37:17.340325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:34.568110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362408+0000","last_change":"2024-03-20T13:36:40.850087+0000","last_active":"2024-03-20T13:37:17.362408+0000","last_peered":"2024-03-20T13:37:17.362408+0000","last_clean":"2024-03-20T13:37:17.362408+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:37:17.362408+0000","last_undegraded":"2024-03-20T13:37:17.362408+0000","last_fullsized":"2024-03-20T13:37:17.362408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.864653+0000","last_change":"2024-03-20T13:36:42.876289+0000","last_active":"2024-03-20T13:38:18.864653+0000","last_peered":"2024-03-20T13:38:18.864653+0000","last_clean":"2024-03-20T13:38:18.864653+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:18.864653+0000","last_undegraded":"2024-03-20T13:38:18.864653+0000","last_fullsized":"2024-03-20T13:38:18.864653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:11.362564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356204+0000","last_change":"2024-03-20T13:36:44.871091+0000","last_active":"2024-03-20T13:37:17.356204+0000","last_peered":"2024-03-20T13:37:17.356204+0000","last_clean":"2024-03-20T13:37:17.356204+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:37:17.356204+0000","last_undegraded":"2024-03-20T13:37:17.356204+0000","last_fullsized":"2024-03-20T13:37:17.356204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:17.175441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347541+0000","last_change":"2024-03-20T13:36:46.872197+0000","last_active":"2024-03-20T13:37:17.347541+0000","last_peered":"2024-03-20T13:37:17.347541+0000","last_clean":"2024-03-20T13:37:17.347541+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:37:17.347541+0000","last_undegraded":"2024-03-20T13:37:17.347541+0000","last_fullsized":"2024-03-20T13:37:17.347541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:03:54.127026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354510+0000","last_change":"2024-03-20T13:36:38.845564+0000","last_active":"2024-03-20T13:37:17.354510+0000","last_peered":"2024-03-20T13:37:17.354510+0000","last_clean":"2024-03-20T13:37:17.354510+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:37:17.354510+0000","last_undegraded":"2024-03-20T13:37:17.354510+0000","last_fullsized":"2024-03-20T13:37:17.354510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":201,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341737+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:37:17.341737+0000","last_peered":"2024-03-20T13:37:17.341737+0000","last_clean":"2024-03-20T13:37:17.341737+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:37:17.341737+0000","last_undegraded":"2024-03-20T13:37:17.341737+0000","last_fullsized":"2024-03-20T13:37:17.341737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:11.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350038+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:37:17.350038+0000","last_peered":"2024-03-20T13:37:17.350038+0000","last_clean":"2024-03-20T13:37:17.350038+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:37:17.350038+0000","last_undegraded":"2024-03-20T13:37:17.350038+0000","last_fullsized":"2024-03-20T13:37:17.350038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:20.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356573+0000","last_change":"2024-03-20T13:36:36.849187+0000","last_active":"2024-03-20T13:37:17.356573+0000","last_peered":"2024-03-20T13:37:17.356573+0000","last_clean":"2024-03-20T13:37:17.356573+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:37:17.356573+0000","last_undegraded":"2024-03-20T13:37:17.356573+0000","last_fullsized":"2024-03-20T13:37:17.356573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:20:15.376979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350872+0000","last_change":"2024-03-20T13:36:40.848822+0000","last_active":"2024-03-20T13:37:17.350872+0000","last_peered":"2024-03-20T13:37:17.350872+0000","last_clean":"2024-03-20T13:37:17.350872+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:37:17.350872+0000","last_undegraded":"2024-03-20T13:37:17.350872+0000","last_fullsized":"2024-03-20T13:37:17.350872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:47.518308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'79","reported_seq":159,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.090502+0000","last_change":"2024-03-20T13:36:42.846779+0000","last_active":"2024-03-20T13:38:19.090502+0000","last_peered":"2024-03-20T13:38:19.090502+0000","last_clean":"2024-03-20T13:38:19.090502+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:19.090502+0000","last_undegraded":"2024-03-20T13:38:19.090502+0000","last_fullsized":"2024-03-20T13:38:19.090502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:25.956347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360479+0000","last_change":"2024-03-20T13:36:44.899269+0000","last_active":"2024-03-20T13:37:17.360479+0000","last_peered":"2024-03-20T13:37:17.360479+0000","last_clean":"2024-03-20T13:37:17.360479+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:37:17.360479+0000","last_undegraded":"2024-03-20T13:37:17.360479+0000","last_fullsized":"2024-03-20T13:37:17.360479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'51","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.055469+0000","last_change":"2024-03-20T13:36:46.893348+0000","last_active":"2024-03-20T13:38:11.055469+0000","last_peered":"2024-03-20T13:38:11.055469+0000","last_clean":"2024-03-20T13:38:11.055469+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:38:11.055469+0000","last_undegraded":"2024-03-20T13:38:11.055469+0000","last_fullsized":"2024-03-20T13:38:11.055469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:20.181051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.803949+0000","last_change":"2024-03-20T13:36:38.835115+0000","last_active":"2024-03-20T13:37:22.803949+0000","last_peered":"2024-03-20T13:37:22.803949+0000","last_clean":"2024-03-20T13:37:22.803949+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:37:22.803949+0000","last_undegraded":"2024-03-20T13:37:22.803949+0000","last_fullsized":"2024-03-20T13:37:22.803949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:57.031606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348446+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:37:17.348446+0000","last_peered":"2024-03-20T13:37:17.348446+0000","last_clean":"2024-03-20T13:37:17.348446+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:37:17.348446+0000","last_undegraded":"2024-03-20T13:37:17.348446+0000","last_fullsized":"2024-03-20T13:37:17.348446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:03.493778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.344968+0000","last_change":"2024-03-20T13:36:36.833258+0000","last_active":"2024-03-20T13:37:17.344968+0000","last_peered":"2024-03-20T13:37:17.344968+0000","last_clean":"2024-03-20T13:37:17.344968+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:37:17.344968+0000","last_undegraded":"2024-03-20T13:37:17.344968+0000","last_fullsized":"2024-03-20T13:37:17.344968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:55.537677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356009+0000","last_change":"2024-03-20T13:36:40.850671+0000","last_active":"2024-03-20T13:37:17.356009+0000","last_peered":"2024-03-20T13:37:17.356009+0000","last_clean":"2024-03-20T13:37:17.356009+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:37:17.356009+0000","last_undegraded":"2024-03-20T13:37:17.356009+0000","last_fullsized":"2024-03-20T13:37:17.356009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:49:00.124639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'250","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.083603+0000","last_change":"2024-03-20T13:36:42.863211+0000","last_active":"2024-03-20T13:38:19.083603+0000","last_peered":"2024-03-20T13:38:19.083603+0000","last_clean":"2024-03-20T13:38:19.083603+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:19.083603+0000","last_undegraded":"2024-03-20T13:38:19.083603+0000","last_fullsized":"2024-03-20T13:38:19.083603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:58.451631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351365+0000","last_change":"2024-03-20T13:36:44.897832+0000","last_active":"2024-03-20T13:37:17.351365+0000","last_peered":"2024-03-20T13:37:17.351365+0000","last_clean":"2024-03-20T13:37:17.351365+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:37:17.351365+0000","last_undegraded":"2024-03-20T13:37:17.351365+0000","last_fullsized":"2024-03-20T13:37:17.351365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:52:08.639163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.523020+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:37:59.523020+0000","last_peered":"2024-03-20T13:37:59.523020+0000","last_clean":"2024-03-20T13:37:59.523020+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:37:59.523020+0000","last_undegraded":"2024-03-20T13:37:59.523020+0000","last_fullsized":"2024-03-20T13:37:59.523020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:46.638563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362220+0000","last_change":"2024-03-20T13:36:38.832205+0000","last_active":"2024-03-20T13:38:05.362220+0000","last_peered":"2024-03-20T13:38:05.362220+0000","last_clean":"2024-03-20T13:38:05.362220+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:38:05.362220+0000","last_undegraded":"2024-03-20T13:38:05.362220+0000","last_fullsized":"2024-03-20T13:38:05.362220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:00.408558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334481+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:37:17.334481+0000","last_peered":"2024-03-20T13:37:17.334481+0000","last_clean":"2024-03-20T13:37:17.334481+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.334481+0000","last_undegraded":"2024-03-20T13:37:17.334481+0000","last_fullsized":"2024-03-20T13:37:17.334481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:45.503619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342328+0000","last_change":"2024-03-20T13:36:36.836293+0000","last_active":"2024-03-20T13:37:17.342328+0000","last_peered":"2024-03-20T13:37:17.342328+0000","last_clean":"2024-03-20T13:37:17.342328+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:37:17.342328+0000","last_undegraded":"2024-03-20T13:37:17.342328+0000","last_fullsized":"2024-03-20T13:37:17.342328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:33.995435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349061+0000","last_change":"2024-03-20T13:36:40.842771+0000","last_active":"2024-03-20T13:37:17.349061+0000","last_peered":"2024-03-20T13:37:17.349061+0000","last_clean":"2024-03-20T13:37:17.349061+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:37:17.349061+0000","last_undegraded":"2024-03-20T13:37:17.349061+0000","last_fullsized":"2024-03-20T13:37:17.349061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:42:22.678474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:10.996348+0000","last_change":"2024-03-20T13:36:42.842816+0000","last_active":"2024-03-20T13:38:10.996348+0000","last_peered":"2024-03-20T13:38:10.996348+0000","last_clean":"2024-03-20T13:38:10.996348+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:10.996348+0000","last_undegraded":"2024-03-20T13:38:10.996348+0000","last_fullsized":"2024-03-20T13:38:10.996348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:03.696208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352701+0000","last_change":"2024-03-20T13:36:44.872161+0000","last_active":"2024-03-20T13:37:17.352701+0000","last_peered":"2024-03-20T13:37:17.352701+0000","last_clean":"2024-03-20T13:37:17.352701+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:37:17.352701+0000","last_undegraded":"2024-03-20T13:37:17.352701+0000","last_fullsized":"2024-03-20T13:37:17.352701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:39.436728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347395+0000","last_change":"2024-03-20T13:36:46.874361+0000","last_active":"2024-03-20T13:37:17.347395+0000","last_peered":"2024-03-20T13:37:17.347395+0000","last_clean":"2024-03-20T13:37:17.347395+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:37:17.347395+0000","last_undegraded":"2024-03-20T13:37:17.347395+0000","last_fullsized":"2024-03-20T13:37:17.347395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048631+0000","last_change":"2024-03-20T13:36:38.839568+0000","last_active":"2024-03-20T13:38:11.048631+0000","last_peered":"2024-03-20T13:38:11.048631+0000","last_clean":"2024-03-20T13:38:11.048631+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:11.048631+0000","last_undegraded":"2024-03-20T13:38:11.048631+0000","last_fullsized":"2024-03-20T13:38:11.048631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:16.107824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348452+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:37:17.348452+0000","last_peered":"2024-03-20T13:37:17.348452+0000","last_clean":"2024-03-20T13:37:17.348452+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:37:17.348452+0000","last_undegraded":"2024-03-20T13:37:17.348452+0000","last_fullsized":"2024-03-20T13:37:17.348452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:49:35.289474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350154+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:37:17.350154+0000","last_peered":"2024-03-20T13:37:17.350154+0000","last_clean":"2024-03-20T13:37:17.350154+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:37:17.350154+0000","last_undegraded":"2024-03-20T13:37:17.350154+0000","last_fullsized":"2024-03-20T13:37:17.350154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:33.936697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353282+0000","last_change":"2024-03-20T13:36:40.846094+0000","last_active":"2024-03-20T13:37:17.353282+0000","last_peered":"2024-03-20T13:37:17.353282+0000","last_clean":"2024-03-20T13:37:17.353282+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:37:17.353282+0000","last_undegraded":"2024-03-20T13:37:17.353282+0000","last_fullsized":"2024-03-20T13:37:17.353282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:25:10.138463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.375043+0000","last_change":"2024-03-20T13:36:42.847334+0000","last_active":"2024-03-20T13:38:05.375043+0000","last_peered":"2024-03-20T13:38:05.375043+0000","last_clean":"2024-03-20T13:38:05.375043+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:05.375043+0000","last_undegraded":"2024-03-20T13:38:05.375043+0000","last_fullsized":"2024-03-20T13:38:05.375043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361433+0000","last_change":"2024-03-20T13:36:44.900807+0000","last_active":"2024-03-20T13:37:17.361433+0000","last_peered":"2024-03-20T13:37:17.361433+0000","last_clean":"2024-03-20T13:37:17.361433+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:37:17.361433+0000","last_undegraded":"2024-03-20T13:37:17.361433+0000","last_fullsized":"2024-03-20T13:37:17.361433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341228+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:37:17.341228+0000","last_peered":"2024-03-20T13:37:17.341228+0000","last_clean":"2024-03-20T13:37:17.341228+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:37:17.341228+0000","last_undegraded":"2024-03-20T13:37:17.341228+0000","last_fullsized":"2024-03-20T13:37:17.341228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:47.541449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559479+0000","last_change":"2024-03-20T13:36:38.835114+0000","last_active":"2024-03-20T13:38:04.559479+0000","last_peered":"2024-03-20T13:38:04.559479+0000","last_clean":"2024-03-20T13:38:04.559479+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:38:04.559479+0000","last_undegraded":"2024-03-20T13:38:04.559479+0000","last_fullsized":"2024-03-20T13:38:04.559479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:02.712312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356076+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:37:17.356076+0000","last_peered":"2024-03-20T13:37:17.356076+0000","last_clean":"2024-03-20T13:37:17.356076+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:37:17.356076+0000","last_undegraded":"2024-03-20T13:37:17.356076+0000","last_fullsized":"2024-03-20T13:37:17.356076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:36:17.674002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353028+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:37:17.353028+0000","last_peered":"2024-03-20T13:37:17.353028+0000","last_clean":"2024-03-20T13:37:17.353028+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:37:17.353028+0000","last_undegraded":"2024-03-20T13:37:17.353028+0000","last_fullsized":"2024-03-20T13:37:17.353028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:01:29.010451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337078+0000","last_change":"2024-03-20T13:36:40.847185+0000","last_active":"2024-03-20T13:37:17.337078+0000","last_peered":"2024-03-20T13:37:17.337078+0000","last_clean":"2024-03-20T13:37:17.337078+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:37:17.337078+0000","last_undegraded":"2024-03-20T13:37:17.337078+0000","last_fullsized":"2024-03-20T13:37:17.337078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:07:18.240810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'62","reported_seq":128,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.071661+0000","last_change":"2024-03-20T13:36:42.851741+0000","last_active":"2024-03-20T13:38:19.071661+0000","last_peered":"2024-03-20T13:38:19.071661+0000","last_clean":"2024-03-20T13:38:19.071661+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:19.071661+0000","last_undegraded":"2024-03-20T13:38:19.071661+0000","last_fullsized":"2024-03-20T13:38:19.071661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:54:44.968029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347209+0000","last_change":"2024-03-20T13:36:44.869776+0000","last_active":"2024-03-20T13:37:17.347209+0000","last_peered":"2024-03-20T13:37:17.347209+0000","last_clean":"2024-03-20T13:37:17.347209+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:37:17.347209+0000","last_undegraded":"2024-03-20T13:37:17.347209+0000","last_fullsized":"2024-03-20T13:37:17.347209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:00:44.770676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.347425+0000","last_change":"2024-03-20T13:36:46.889089+0000","last_active":"2024-03-20T13:38:05.347425+0000","last_peered":"2024-03-20T13:38:05.347425+0000","last_clean":"2024-03-20T13:38:05.347425+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:05.347425+0000","last_undegraded":"2024-03-20T13:38:05.347425+0000","last_fullsized":"2024-03-20T13:38:05.347425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:44.885863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.805147+0000","last_change":"2024-03-20T13:36:38.827949+0000","last_active":"2024-03-20T13:37:22.805147+0000","last_peered":"2024-03-20T13:37:22.805147+0000","last_clean":"2024-03-20T13:37:22.805147+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:37:22.805147+0000","last_undegraded":"2024-03-20T13:37:22.805147+0000","last_fullsized":"2024-03-20T13:37:22.805147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:52:06.009730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353286+0000","last_change":"2024-03-20T13:36:36.830990+0000","last_active":"2024-03-20T13:37:17.353286+0000","last_peered":"2024-03-20T13:37:17.353286+0000","last_clean":"2024-03-20T13:37:17.353286+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:37:17.353286+0000","last_undegraded":"2024-03-20T13:37:17.353286+0000","last_fullsized":"2024-03-20T13:37:17.353286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:34.861573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354027+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:37:17.354027+0000","last_peered":"2024-03-20T13:37:17.354027+0000","last_clean":"2024-03-20T13:37:17.354027+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:37:17.354027+0000","last_undegraded":"2024-03-20T13:37:17.354027+0000","last_fullsized":"2024-03-20T13:37:17.354027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:05.095676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348014+0000","last_change":"2024-03-20T13:36:40.850909+0000","last_active":"2024-03-20T13:37:17.348014+0000","last_peered":"2024-03-20T13:37:17.348014+0000","last_clean":"2024-03-20T13:37:17.348014+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:37:17.348014+0000","last_undegraded":"2024-03-20T13:37:17.348014+0000","last_fullsized":"2024-03-20T13:37:17.348014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:51:02.062610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341928+0000","last_change":"2024-03-20T13:36:42.864332+0000","last_active":"2024-03-20T13:37:17.341928+0000","last_peered":"2024-03-20T13:37:17.341928+0000","last_clean":"2024-03-20T13:37:17.341928+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:37:17.341928+0000","last_undegraded":"2024-03-20T13:37:17.341928+0000","last_fullsized":"2024-03-20T13:37:17.341928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:16.666345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'243","reported_seq":321,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.775824+0000","last_change":"2024-03-20T13:36:44.872646+0000","last_active":"2024-03-20T13:38:18.775824+0000","last_peered":"2024-03-20T13:38:18.775824+0000","last_clean":"2024-03-20T13:38:18.775824+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:18.775824+0000","last_undegraded":"2024-03-20T13:38:18.775824+0000","last_fullsized":"2024-03-20T13:38:18.775824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:04.548860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358653+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:37:17.358653+0000","last_peered":"2024-03-20T13:37:17.358653+0000","last_clean":"2024-03-20T13:37:17.358653+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:37:17.358653+0000","last_undegraded":"2024-03-20T13:37:17.358653+0000","last_fullsized":"2024-03-20T13:37:17.358653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.098925+0000","last_change":"2024-03-20T13:36:38.813661+0000","last_active":"2024-03-20T13:37:22.098925+0000","last_peered":"2024-03-20T13:37:22.098925+0000","last_clean":"2024-03-20T13:37:22.098925+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:37:22.098925+0000","last_undegraded":"2024-03-20T13:37:22.098925+0000","last_fullsized":"2024-03-20T13:37:22.098925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:25.058189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362921+0000","last_change":"2024-03-20T13:36:36.847617+0000","last_active":"2024-03-20T13:37:17.362921+0000","last_peered":"2024-03-20T13:37:17.362921+0000","last_clean":"2024-03-20T13:37:17.362921+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:37:17.362921+0000","last_undegraded":"2024-03-20T13:37:17.362921+0000","last_fullsized":"2024-03-20T13:37:17.362921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360074+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:37:17.360074+0000","last_peered":"2024-03-20T13:37:17.360074+0000","last_clean":"2024-03-20T13:37:17.360074+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:37:17.360074+0000","last_undegraded":"2024-03-20T13:37:17.360074+0000","last_fullsized":"2024-03-20T13:37:17.360074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:06.931743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349095+0000","last_change":"2024-03-20T13:36:40.857874+0000","last_active":"2024-03-20T13:37:17.349095+0000","last_peered":"2024-03-20T13:37:17.349095+0000","last_clean":"2024-03-20T13:37:17.349095+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:37:17.349095+0000","last_undegraded":"2024-03-20T13:37:17.349095+0000","last_fullsized":"2024-03-20T13:37:17.349095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:18:26.064828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358074+0000","last_change":"2024-03-20T13:36:42.855371+0000","last_active":"2024-03-20T13:37:17.358074+0000","last_peered":"2024-03-20T13:37:17.358074+0000","last_clean":"2024-03-20T13:37:17.358074+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:37:17.358074+0000","last_undegraded":"2024-03-20T13:37:17.358074+0000","last_fullsized":"2024-03-20T13:37:17.358074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:58:21.419980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'243","reported_seq":319,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.783142+0000","last_change":"2024-03-20T13:36:44.894325+0000","last_active":"2024-03-20T13:38:18.783142+0000","last_peered":"2024-03-20T13:38:18.783142+0000","last_clean":"2024-03-20T13:38:18.783142+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:18.783142+0000","last_undegraded":"2024-03-20T13:38:18.783142+0000","last_fullsized":"2024-03-20T13:38:18.783142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:59.125889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.777950+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:37:21.777950+0000","last_peered":"2024-03-20T13:37:21.777950+0000","last_clean":"2024-03-20T13:37:21.777950+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:37:21.777950+0000","last_undegraded":"2024-03-20T13:37:21.777950+0000","last_fullsized":"2024-03-20T13:37:21.777950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:41.446025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099051+0000","last_change":"2024-03-20T13:36:38.825848+0000","last_active":"2024-03-20T13:37:22.099051+0000","last_peered":"2024-03-20T13:37:22.099051+0000","last_clean":"2024-03-20T13:37:22.099051+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:37:22.099051+0000","last_undegraded":"2024-03-20T13:37:22.099051+0000","last_fullsized":"2024-03-20T13:37:22.099051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:41.028184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358700+0000","last_change":"2024-03-20T13:36:36.831337+0000","last_active":"2024-03-20T13:37:17.358700+0000","last_peered":"2024-03-20T13:37:17.358700+0000","last_clean":"2024-03-20T13:37:17.358700+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:37:17.358700+0000","last_undegraded":"2024-03-20T13:37:17.358700+0000","last_fullsized":"2024-03-20T13:37:17.358700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:05.365347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353981+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:37:17.353981+0000","last_peered":"2024-03-20T13:37:17.353981+0000","last_clean":"2024-03-20T13:37:17.353981+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:37:17.353981+0000","last_undegraded":"2024-03-20T13:37:17.353981+0000","last_fullsized":"2024-03-20T13:37:17.353981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:22.659362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.366089+0000","last_change":"2024-03-20T13:37:17.366089+0000","last_active":"2024-03-20T13:37:17.366089+0000","last_peered":"2024-03-20T13:37:17.366089+0000","last_clean":"2024-03-20T13:37:17.366089+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:37:17.366089+0000","last_undegraded":"2024-03-20T13:37:17.366089+0000","last_fullsized":"2024-03-20T13:37:17.366089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:48.645299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'86","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.099800+0000","last_change":"2024-03-20T13:36:42.842883+0000","last_active":"2024-03-20T13:38:19.099800+0000","last_peered":"2024-03-20T13:38:19.099800+0000","last_clean":"2024-03-20T13:38:19.099800+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:19.099800+0000","last_undegraded":"2024-03-20T13:38:19.099800+0000","last_fullsized":"2024-03-20T13:38:19.099800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:47.727785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357474+0000","last_change":"2024-03-20T13:36:44.894727+0000","last_active":"2024-03-20T13:37:17.357474+0000","last_peered":"2024-03-20T13:37:17.357474+0000","last_clean":"2024-03-20T13:37:17.357474+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:37:17.357474+0000","last_undegraded":"2024-03-20T13:37:17.357474+0000","last_fullsized":"2024-03-20T13:37:17.357474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:11.857697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339944+0000","last_change":"2024-03-20T13:36:46.888822+0000","last_active":"2024-03-20T13:37:17.339944+0000","last_peered":"2024-03-20T13:37:17.339944+0000","last_clean":"2024-03-20T13:37:17.339944+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:37:17.339944+0000","last_undegraded":"2024-03-20T13:37:17.339944+0000","last_fullsized":"2024-03-20T13:37:17.339944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:28:05.896472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345713+0000","last_change":"2024-03-20T13:36:46.889735+0000","last_active":"2024-03-20T13:37:17.345713+0000","last_peered":"2024-03-20T13:37:17.345713+0000","last_clean":"2024-03-20T13:37:17.345713+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:37:17.345713+0000","last_undegraded":"2024-03-20T13:37:17.345713+0000","last_fullsized":"2024-03-20T13:37:17.345713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:26.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038995+0000","last_change":"2024-03-20T13:36:38.826974+0000","last_active":"2024-03-20T13:38:11.038995+0000","last_peered":"2024-03-20T13:38:11.038995+0000","last_clean":"2024-03-20T13:38:11.038995+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:11.038995+0000","last_undegraded":"2024-03-20T13:38:11.038995+0000","last_fullsized":"2024-03-20T13:38:11.038995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:12:47.853154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352952+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:37:17.352952+0000","last_peered":"2024-03-20T13:37:17.352952+0000","last_clean":"2024-03-20T13:37:17.352952+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:37:17.352952+0000","last_undegraded":"2024-03-20T13:37:17.352952+0000","last_fullsized":"2024-03-20T13:37:17.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346955+0000","last_change":"2024-03-20T13:36:40.845473+0000","last_active":"2024-03-20T13:37:17.346955+0000","last_peered":"2024-03-20T13:37:17.346955+0000","last_clean":"2024-03-20T13:37:17.346955+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:37:17.346955+0000","last_undegraded":"2024-03-20T13:37:17.346955+0000","last_fullsized":"2024-03-20T13:37:17.346955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:45:53.190145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.891789+0000","last_change":"2024-03-20T13:36:42.865392+0000","last_active":"2024-03-20T13:38:18.891789+0000","last_peered":"2024-03-20T13:38:18.891789+0000","last_clean":"2024-03-20T13:38:18.891789+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:18.891789+0000","last_undegraded":"2024-03-20T13:38:18.891789+0000","last_fullsized":"2024-03-20T13:38:18.891789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:23.969005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338712+0000","last_change":"2024-03-20T13:36:44.884122+0000","last_active":"2024-03-20T13:37:17.338712+0000","last_peered":"2024-03-20T13:37:17.338712+0000","last_clean":"2024-03-20T13:37:17.338712+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:37:17.338712+0000","last_undegraded":"2024-03-20T13:37:17.338712+0000","last_fullsized":"2024-03-20T13:37:17.338712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:16:30.331163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361092+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:37:17.361092+0000","last_peered":"2024-03-20T13:37:17.361092+0000","last_clean":"2024-03-20T13:37:17.361092+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:37:17.361092+0000","last_undegraded":"2024-03-20T13:37:17.361092+0000","last_fullsized":"2024-03-20T13:37:17.361092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099295+0000","last_change":"2024-03-20T13:36:38.835372+0000","last_active":"2024-03-20T13:37:22.099295+0000","last_peered":"2024-03-20T13:37:22.099295+0000","last_clean":"2024-03-20T13:37:22.099295+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:37:22.099295+0000","last_undegraded":"2024-03-20T13:37:22.099295+0000","last_fullsized":"2024-03-20T13:37:22.099295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:34.776234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340380+0000","last_change":"2024-03-20T13:36:36.812213+0000","last_active":"2024-03-20T13:37:17.340380+0000","last_peered":"2024-03-20T13:37:17.340380+0000","last_clean":"2024-03-20T13:37:17.340380+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:37:17.340380+0000","last_undegraded":"2024-03-20T13:37:17.340380+0000","last_fullsized":"2024-03-20T13:37:17.340380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:43.391446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348705+0000","last_change":"2024-03-20T13:36:40.849295+0000","last_active":"2024-03-20T13:37:17.348705+0000","last_peered":"2024-03-20T13:37:17.348705+0000","last_clean":"2024-03-20T13:37:17.348705+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:37:17.348705+0000","last_undegraded":"2024-03-20T13:37:17.348705+0000","last_fullsized":"2024-03-20T13:37:17.348705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:20.801941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:57.995056+0000","last_change":"2024-03-20T13:36:42.861263+0000","last_active":"2024-03-20T13:37:57.995056+0000","last_peered":"2024-03-20T13:37:57.995056+0000","last_clean":"2024-03-20T13:37:57.995056+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:37:57.995056+0000","last_undegraded":"2024-03-20T13:37:57.995056+0000","last_fullsized":"2024-03-20T13:37:57.995056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:19.148076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335656+0000","last_change":"2024-03-20T13:36:44.868223+0000","last_active":"2024-03-20T13:37:17.335656+0000","last_peered":"2024-03-20T13:37:17.335656+0000","last_clean":"2024-03-20T13:37:17.335656+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:37:17.335656+0000","last_undegraded":"2024-03-20T13:37:17.335656+0000","last_fullsized":"2024-03-20T13:37:17.335656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:15:27.229079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.348498+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:05.348498+0000","last_peered":"2024-03-20T13:38:05.348498+0000","last_clean":"2024-03-20T13:38:05.348498+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:05.348498+0000","last_undegraded":"2024-03-20T13:38:05.348498+0000","last_fullsized":"2024-03-20T13:38:05.348498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:11:03.011925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347543+0000","last_change":"2024-03-20T13:36:38.830562+0000","last_active":"2024-03-20T13:37:17.347543+0000","last_peered":"2024-03-20T13:37:17.347543+0000","last_clean":"2024-03-20T13:37:17.347543+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:37:17.347543+0000","last_undegraded":"2024-03-20T13:37:17.347543+0000","last_fullsized":"2024-03-20T13:37:17.347543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354095+0000","last_change":"2024-03-20T13:36:36.836705+0000","last_active":"2024-03-20T13:37:17.354095+0000","last_peered":"2024-03-20T13:37:17.354095+0000","last_clean":"2024-03-20T13:37:17.354095+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:37:17.354095+0000","last_undegraded":"2024-03-20T13:37:17.354095+0000","last_fullsized":"2024-03-20T13:37:17.354095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346933+0000","last_change":"2024-03-20T13:36:40.855508+0000","last_active":"2024-03-20T13:37:17.346933+0000","last_peered":"2024-03-20T13:37:17.346933+0000","last_clean":"2024-03-20T13:37:17.346933+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:37:17.346933+0000","last_undegraded":"2024-03-20T13:37:17.346933+0000","last_fullsized":"2024-03-20T13:37:17.346933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:51.813504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'37","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.053772+0000","last_change":"2024-03-20T13:36:42.868367+0000","last_active":"2024-03-20T13:38:19.053772+0000","last_peered":"2024-03-20T13:38:19.053772+0000","last_clean":"2024-03-20T13:38:19.053772+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:19.053772+0000","last_undegraded":"2024-03-20T13:38:19.053772+0000","last_fullsized":"2024-03-20T13:38:19.053772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:24.991506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345357+0000","last_change":"2024-03-20T13:36:44.888584+0000","last_active":"2024-03-20T13:37:17.345357+0000","last_peered":"2024-03-20T13:37:17.345357+0000","last_clean":"2024-03-20T13:37:17.345357+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:37:17.345357+0000","last_undegraded":"2024-03-20T13:37:17.345357+0000","last_fullsized":"2024-03-20T13:37:17.345357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:50.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349560+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:37:17.349560+0000","last_peered":"2024-03-20T13:37:17.349560+0000","last_clean":"2024-03-20T13:37:17.349560+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:37:17.349560+0000","last_undegraded":"2024-03-20T13:37:17.349560+0000","last_fullsized":"2024-03-20T13:37:17.349560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:48.938118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370915+0000","last_change":"2024-03-20T13:36:38.834173+0000","last_active":"2024-03-20T13:38:05.370915+0000","last_peered":"2024-03-20T13:38:05.370915+0000","last_clean":"2024-03-20T13:38:05.370915+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:05.370915+0000","last_undegraded":"2024-03-20T13:38:05.370915+0000","last_fullsized":"2024-03-20T13:38:05.370915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:44.080119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353785+0000","last_change":"2024-03-20T13:36:36.829532+0000","last_active":"2024-03-20T13:37:17.353785+0000","last_peered":"2024-03-20T13:37:17.353785+0000","last_clean":"2024-03-20T13:37:17.353785+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:37:17.353785+0000","last_undegraded":"2024-03-20T13:37:17.353785+0000","last_fullsized":"2024-03-20T13:37:17.353785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:30:12.679787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339023+0000","last_change":"2024-03-20T13:36:40.852289+0000","last_active":"2024-03-20T13:37:17.339023+0000","last_peered":"2024-03-20T13:37:17.339023+0000","last_clean":"2024-03-20T13:37:17.339023+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:37:17.339023+0000","last_undegraded":"2024-03-20T13:37:17.339023+0000","last_fullsized":"2024-03-20T13:37:17.339023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:08.730342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.024077+0000","last_change":"2024-03-20T13:36:42.860451+0000","last_active":"2024-03-20T13:38:19.024077+0000","last_peered":"2024-03-20T13:38:19.024077+0000","last_clean":"2024-03-20T13:38:19.024077+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:19.024077+0000","last_undegraded":"2024-03-20T13:38:19.024077+0000","last_fullsized":"2024-03-20T13:38:19.024077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:35.520740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336298+0000","last_change":"2024-03-20T13:36:44.862966+0000","last_active":"2024-03-20T13:37:17.336298+0000","last_peered":"2024-03-20T13:37:17.336298+0000","last_clean":"2024-03-20T13:37:17.336298+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:37:17.336298+0000","last_undegraded":"2024-03-20T13:37:17.336298+0000","last_fullsized":"2024-03-20T13:37:17.336298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:59.751229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103956+0000","last_change":"2024-03-20T13:36:38.832438+0000","last_active":"2024-03-20T13:37:22.103956+0000","last_peered":"2024-03-20T13:37:22.103956+0000","last_clean":"2024-03-20T13:37:22.103956+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:37:22.103956+0000","last_undegraded":"2024-03-20T13:37:22.103956+0000","last_fullsized":"2024-03-20T13:37:22.103956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:10:40.231347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339417+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:37:17.339417+0000","last_peered":"2024-03-20T13:37:17.339417+0000","last_clean":"2024-03-20T13:37:17.339417+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:37:17.339417+0000","last_undegraded":"2024-03-20T13:37:17.339417+0000","last_fullsized":"2024-03-20T13:37:17.339417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:42.936647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353909+0000","last_change":"2024-03-20T13:36:40.854924+0000","last_active":"2024-03-20T13:37:17.353909+0000","last_peered":"2024-03-20T13:37:17.353909+0000","last_clean":"2024-03-20T13:37:17.353909+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:37:17.353909+0000","last_undegraded":"2024-03-20T13:37:17.353909+0000","last_fullsized":"2024-03-20T13:37:17.353909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:58:14.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.015046+0000","last_change":"2024-03-20T13:37:17.384644+0000","last_active":"2024-03-20T13:38:19.015046+0000","last_peered":"2024-03-20T13:38:19.015046+0000","last_clean":"2024-03-20T13:38:19.015046+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:19.015046+0000","last_undegraded":"2024-03-20T13:38:19.015046+0000","last_fullsized":"2024-03-20T13:38:19.015046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:24.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337105+0000","last_change":"2024-03-20T13:36:44.873958+0000","last_active":"2024-03-20T13:37:17.337105+0000","last_peered":"2024-03-20T13:37:17.337105+0000","last_clean":"2024-03-20T13:37:17.337105+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:37:17.337105+0000","last_undegraded":"2024-03-20T13:37:17.337105+0000","last_fullsized":"2024-03-20T13:37:17.337105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:20.295832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.704046+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:04.704046+0000","last_peered":"2024-03-20T13:38:04.704046+0000","last_clean":"2024-03-20T13:38:04.704046+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:04.704046+0000","last_undegraded":"2024-03-20T13:38:04.704046+0000","last_fullsized":"2024-03-20T13:38:04.704046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:33.949395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559430+0000","last_change":"2024-03-20T13:36:38.834011+0000","last_active":"2024-03-20T13:38:04.559430+0000","last_peered":"2024-03-20T13:38:04.559430+0000","last_clean":"2024-03-20T13:38:04.559430+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:38:04.559430+0000","last_undegraded":"2024-03-20T13:38:04.559430+0000","last_fullsized":"2024-03-20T13:38:04.559430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:14:02.478170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342800+0000","last_change":"2024-03-20T13:36:36.833334+0000","last_active":"2024-03-20T13:37:17.342800+0000","last_peered":"2024-03-20T13:37:17.342800+0000","last_clean":"2024-03-20T13:37:17.342800+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:37:17.342800+0000","last_undegraded":"2024-03-20T13:37:17.342800+0000","last_fullsized":"2024-03-20T13:37:17.342800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:43:40.299686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353658+0000","last_change":"2024-03-20T13:36:40.840832+0000","last_active":"2024-03-20T13:37:17.353658+0000","last_peered":"2024-03-20T13:37:17.353658+0000","last_clean":"2024-03-20T13:37:17.353658+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:37:17.353658+0000","last_undegraded":"2024-03-20T13:37:17.353658+0000","last_fullsized":"2024-03-20T13:37:17.353658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:18:58.479248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.035095+0000","last_change":"2024-03-20T13:36:42.860856+0000","last_active":"2024-03-20T13:38:19.035095+0000","last_peered":"2024-03-20T13:38:19.035095+0000","last_clean":"2024-03-20T13:38:19.035095+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:19.035095+0000","last_undegraded":"2024-03-20T13:38:19.035095+0000","last_fullsized":"2024-03-20T13:38:19.035095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:44:34.562790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350102+0000","last_change":"2024-03-20T13:36:44.880578+0000","last_active":"2024-03-20T13:37:17.350102+0000","last_peered":"2024-03-20T13:37:17.350102+0000","last_clean":"2024-03-20T13:37:17.350102+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:37:17.350102+0000","last_undegraded":"2024-03-20T13:37:17.350102+0000","last_fullsized":"2024-03-20T13:37:17.350102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:33:34.967987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347355+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:37:17.347355+0000","last_peered":"2024-03-20T13:37:17.347355+0000","last_clean":"2024-03-20T13:37:17.347355+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:37:17.347355+0000","last_undegraded":"2024-03-20T13:37:17.347355+0000","last_fullsized":"2024-03-20T13:37:17.347355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358358+0000","last_change":"2024-03-20T13:36:38.839355+0000","last_active":"2024-03-20T13:37:17.358358+0000","last_peered":"2024-03-20T13:37:17.358358+0000","last_clean":"2024-03-20T13:37:17.358358+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:37:17.358358+0000","last_undegraded":"2024-03-20T13:37:17.358358+0000","last_fullsized":"2024-03-20T13:37:17.358358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.170885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349222+0000","last_change":"2024-03-20T13:36:36.835178+0000","last_active":"2024-03-20T13:37:17.349222+0000","last_peered":"2024-03-20T13:37:17.349222+0000","last_clean":"2024-03-20T13:37:17.349222+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:37:17.349222+0000","last_undegraded":"2024-03-20T13:37:17.349222+0000","last_fullsized":"2024-03-20T13:37:17.349222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:39.013381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354014+0000","last_change":"2024-03-20T13:36:40.859670+0000","last_active":"2024-03-20T13:37:17.354014+0000","last_peered":"2024-03-20T13:37:17.354014+0000","last_clean":"2024-03-20T13:37:17.354014+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:37:17.354014+0000","last_undegraded":"2024-03-20T13:37:17.354014+0000","last_fullsized":"2024-03-20T13:37:17.354014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:03.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.915165+0000","last_change":"2024-03-20T13:36:42.853208+0000","last_active":"2024-03-20T13:38:18.915165+0000","last_peered":"2024-03-20T13:38:18.915165+0000","last_clean":"2024-03-20T13:38:18.915165+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:18.915165+0000","last_undegraded":"2024-03-20T13:38:18.915165+0000","last_fullsized":"2024-03-20T13:38:18.915165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353489+0000","last_change":"2024-03-20T13:36:44.881033+0000","last_active":"2024-03-20T13:37:17.353489+0000","last_peered":"2024-03-20T13:37:17.353489+0000","last_clean":"2024-03-20T13:37:17.353489+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:37:17.353489+0000","last_undegraded":"2024-03-20T13:37:17.353489+0000","last_fullsized":"2024-03-20T13:37:17.353489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:51:03.967670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346808+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:37:17.346808+0000","last_peered":"2024-03-20T13:37:17.346808+0000","last_clean":"2024-03-20T13:37:17.346808+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:37:17.346808+0000","last_undegraded":"2024-03-20T13:37:17.346808+0000","last_fullsized":"2024-03-20T13:37:17.346808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:56:55.827559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340185+0000","last_change":"2024-03-20T13:36:38.841841+0000","last_active":"2024-03-20T13:37:17.340185+0000","last_peered":"2024-03-20T13:37:17.340185+0000","last_clean":"2024-03-20T13:37:17.340185+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:37:17.340185+0000","last_undegraded":"2024-03-20T13:37:17.340185+0000","last_fullsized":"2024-03-20T13:37:17.340185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:56:32.797279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355510+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:37:17.355510+0000","last_peered":"2024-03-20T13:37:17.355510+0000","last_clean":"2024-03-20T13:37:17.355510+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:37:17.355510+0000","last_undegraded":"2024-03-20T13:37:17.355510+0000","last_fullsized":"2024-03-20T13:37:17.355510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:33:21.986721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351081+0000","last_change":"2024-03-20T13:36:40.847481+0000","last_active":"2024-03-20T13:37:17.351081+0000","last_peered":"2024-03-20T13:37:17.351081+0000","last_clean":"2024-03-20T13:37:17.351081+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:37:17.351081+0000","last_undegraded":"2024-03-20T13:37:17.351081+0000","last_fullsized":"2024-03-20T13:37:17.351081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:49.265948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358102+0000","last_change":"2024-03-20T13:36:42.846652+0000","last_active":"2024-03-20T13:37:17.358102+0000","last_peered":"2024-03-20T13:37:17.358102+0000","last_clean":"2024-03-20T13:37:17.358102+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:37:17.358102+0000","last_undegraded":"2024-03-20T13:37:17.358102+0000","last_fullsized":"2024-03-20T13:37:17.358102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:53:01.183501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'243","reported_seq":307,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.775675+0000","last_change":"2024-03-20T13:36:44.870739+0000","last_active":"2024-03-20T13:38:18.775675+0000","last_peered":"2024-03-20T13:38:18.775675+0000","last_clean":"2024-03-20T13:38:18.775675+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:18.775675+0000","last_undegraded":"2024-03-20T13:38:18.775675+0000","last_fullsized":"2024-03-20T13:38:18.775675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:00:28.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346663+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:37:17.346663+0000","last_peered":"2024-03-20T13:37:17.346663+0000","last_clean":"2024-03-20T13:37:17.346663+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:37:17.346663+0000","last_undegraded":"2024-03-20T13:37:17.346663+0000","last_fullsized":"2024-03-20T13:37:17.346663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:19:36.152749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.774657+0000","last_change":"2024-03-20T13:36:38.838732+0000","last_active":"2024-03-20T13:37:21.774657+0000","last_peered":"2024-03-20T13:37:21.774657+0000","last_clean":"2024-03-20T13:37:21.774657+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:37:21.774657+0000","last_undegraded":"2024-03-20T13:37:21.774657+0000","last_fullsized":"2024-03-20T13:37:21.774657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:57.039567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352407+0000","last_change":"2024-03-20T13:36:36.847653+0000","last_active":"2024-03-20T13:37:17.352407+0000","last_peered":"2024-03-20T13:37:17.352407+0000","last_clean":"2024-03-20T13:37:17.352407+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:37:17.352407+0000","last_undegraded":"2024-03-20T13:37:17.352407+0000","last_fullsized":"2024-03-20T13:37:17.352407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:01:47.804240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.737872+0000","last_change":"2024-03-20T13:36:40.851669+0000","last_active":"2024-03-20T13:38:18.737872+0000","last_peered":"2024-03-20T13:38:18.737872+0000","last_clean":"2024-03-20T13:38:18.737872+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:18.737872+0000","last_undegraded":"2024-03-20T13:38:18.737872+0000","last_fullsized":"2024-03-20T13:38:18.737872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:16.049885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.960734+0000","last_change":"2024-03-20T13:36:42.876652+0000","last_active":"2024-03-20T13:38:18.960734+0000","last_peered":"2024-03-20T13:38:18.960734+0000","last_clean":"2024-03-20T13:38:18.960734+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:18.960734+0000","last_undegraded":"2024-03-20T13:38:18.960734+0000","last_fullsized":"2024-03-20T13:38:18.960734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:17:10.310454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338477+0000","last_change":"2024-03-20T13:36:44.880706+0000","last_active":"2024-03-20T13:37:17.338477+0000","last_peered":"2024-03-20T13:37:17.338477+0000","last_clean":"2024-03-20T13:37:17.338477+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:37:17.338477+0000","last_undegraded":"2024-03-20T13:37:17.338477+0000","last_fullsized":"2024-03-20T13:37:17.338477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:27:51.535549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354658+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:37:17.354658+0000","last_peered":"2024-03-20T13:37:17.354658+0000","last_clean":"2024-03-20T13:37:17.354658+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:37:17.354658+0000","last_undegraded":"2024-03-20T13:37:17.354658+0000","last_fullsized":"2024-03-20T13:37:17.354658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:36:39.965842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350635+0000","last_change":"2024-03-20T13:36:38.827830+0000","last_active":"2024-03-20T13:37:17.350635+0000","last_peered":"2024-03-20T13:37:17.350635+0000","last_clean":"2024-03-20T13:37:17.350635+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:37:17.350635+0000","last_undegraded":"2024-03-20T13:37:17.350635+0000","last_fullsized":"2024-03-20T13:37:17.350635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:08.812718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353488+0000","last_change":"2024-03-20T13:36:36.837596+0000","last_active":"2024-03-20T13:37:17.353488+0000","last_peered":"2024-03-20T13:37:17.353488+0000","last_clean":"2024-03-20T13:37:17.353488+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:37:17.353488+0000","last_undegraded":"2024-03-20T13:37:17.353488+0000","last_fullsized":"2024-03-20T13:37:17.353488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:35:15.471501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":201,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.737054+0000","last_change":"2024-03-20T13:36:40.851969+0000","last_active":"2024-03-20T13:38:18.737054+0000","last_peered":"2024-03-20T13:38:18.737054+0000","last_clean":"2024-03-20T13:38:18.737054+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:18.737054+0000","last_undegraded":"2024-03-20T13:38:18.737054+0000","last_fullsized":"2024-03-20T13:38:18.737054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:11:05.906039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.967872+0000","last_change":"2024-03-20T13:36:42.863180+0000","last_active":"2024-03-20T13:38:18.967872+0000","last_peered":"2024-03-20T13:38:18.967872+0000","last_clean":"2024-03-20T13:38:18.967872+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:18.967872+0000","last_undegraded":"2024-03-20T13:38:18.967872+0000","last_fullsized":"2024-03-20T13:38:18.967872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:45:02.764876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347146+0000","last_change":"2024-03-20T13:36:44.869579+0000","last_active":"2024-03-20T13:37:17.347146+0000","last_peered":"2024-03-20T13:37:17.347146+0000","last_clean":"2024-03-20T13:37:17.347146+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:37:17.347146+0000","last_undegraded":"2024-03-20T13:37:17.347146+0000","last_fullsized":"2024-03-20T13:37:17.347146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:11.806504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.022745+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:11.022745+0000","last_peered":"2024-03-20T13:38:11.022745+0000","last_clean":"2024-03-20T13:38:11.022745+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:11.022745+0000","last_undegraded":"2024-03-20T13:38:11.022745+0000","last_fullsized":"2024-03-20T13:38:11.022745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560346+0000","last_change":"2024-03-20T13:36:38.826048+0000","last_active":"2024-03-20T13:38:04.560346+0000","last_peered":"2024-03-20T13:38:04.560346+0000","last_clean":"2024-03-20T13:38:04.560346+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:38:04.560346+0000","last_undegraded":"2024-03-20T13:38:04.560346+0000","last_fullsized":"2024-03-20T13:38:04.560346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:34:12.039747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362384+0000","last_change":"2024-03-20T13:36:36.848516+0000","last_active":"2024-03-20T13:37:17.362384+0000","last_peered":"2024-03-20T13:37:17.362384+0000","last_clean":"2024-03-20T13:37:17.362384+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:37:17.362384+0000","last_undegraded":"2024-03-20T13:37:17.362384+0000","last_fullsized":"2024-03-20T13:37:17.362384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:02:03.251470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343154+0000","last_change":"2024-03-20T13:36:40.851382+0000","last_active":"2024-03-20T13:37:17.343154+0000","last_peered":"2024-03-20T13:37:17.343154+0000","last_clean":"2024-03-20T13:37:17.343154+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:37:17.343154+0000","last_undegraded":"2024-03-20T13:37:17.343154+0000","last_fullsized":"2024-03-20T13:37:17.343154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:56.202294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'27","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.904311+0000","last_change":"2024-03-20T13:36:42.845176+0000","last_active":"2024-03-20T13:38:18.904311+0000","last_peered":"2024-03-20T13:38:18.904311+0000","last_clean":"2024-03-20T13:38:18.904311+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:18.904311+0000","last_undegraded":"2024-03-20T13:38:18.904311+0000","last_fullsized":"2024-03-20T13:38:18.904311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:22.548562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348416+0000","last_change":"2024-03-20T13:36:44.871360+0000","last_active":"2024-03-20T13:37:17.348416+0000","last_peered":"2024-03-20T13:37:17.348416+0000","last_clean":"2024-03-20T13:37:17.348416+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:37:17.348416+0000","last_undegraded":"2024-03-20T13:37:17.348416+0000","last_fullsized":"2024-03-20T13:37:17.348416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:41:36.444963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.055574+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:37:22.055574+0000","last_peered":"2024-03-20T13:37:22.055574+0000","last_clean":"2024-03-20T13:37:22.055574+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:37:22.055574+0000","last_undegraded":"2024-03-20T13:37:22.055574+0000","last_fullsized":"2024-03-20T13:37:22.055574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:42.677131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103962+0000","last_change":"2024-03-20T13:36:38.844162+0000","last_active":"2024-03-20T13:37:22.103962+0000","last_peered":"2024-03-20T13:37:22.103962+0000","last_clean":"2024-03-20T13:37:22.103962+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:37:22.103962+0000","last_undegraded":"2024-03-20T13:37:22.103962+0000","last_fullsized":"2024-03-20T13:37:22.103962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354264+0000","last_change":"2024-03-20T13:36:36.832558+0000","last_active":"2024-03-20T13:37:17.354264+0000","last_peered":"2024-03-20T13:37:17.354264+0000","last_clean":"2024-03-20T13:37:17.354264+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:37:17.354264+0000","last_undegraded":"2024-03-20T13:37:17.354264+0000","last_fullsized":"2024-03-20T13:37:17.354264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:27.481357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342345+0000","last_change":"2024-03-20T13:36:40.857715+0000","last_active":"2024-03-20T13:37:17.342345+0000","last_peered":"2024-03-20T13:37:17.342345+0000","last_clean":"2024-03-20T13:37:17.342345+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:37:17.342345+0000","last_undegraded":"2024-03-20T13:37:17.342345+0000","last_fullsized":"2024-03-20T13:37:17.342345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:54.489899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.923237+0000","last_change":"2024-03-20T13:36:42.860634+0000","last_active":"2024-03-20T13:38:18.923237+0000","last_peered":"2024-03-20T13:38:18.923237+0000","last_clean":"2024-03-20T13:38:18.923237+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:18.923237+0000","last_undegraded":"2024-03-20T13:38:18.923237+0000","last_fullsized":"2024-03-20T13:38:18.923237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:14:18.799933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.336050+0000","last_change":"2024-03-20T13:36:44.875311+0000","last_active":"2024-03-20T13:37:17.336050+0000","last_peered":"2024-03-20T13:37:17.336050+0000","last_clean":"2024-03-20T13:37:17.336050+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:37:17.336050+0000","last_undegraded":"2024-03-20T13:37:17.336050+0000","last_fullsized":"2024-03-20T13:37:17.336050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:40.597951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354486+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:37:17.354486+0000","last_peered":"2024-03-20T13:37:17.354486+0000","last_clean":"2024-03-20T13:37:17.354486+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:37:17.354486+0000","last_undegraded":"2024-03-20T13:37:17.354486+0000","last_fullsized":"2024-03-20T13:37:17.354486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:08:30.493612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.362094+0000","last_change":"2024-03-20T13:36:38.834433+0000","last_active":"2024-03-20T13:38:05.362094+0000","last_peered":"2024-03-20T13:38:05.362094+0000","last_clean":"2024-03-20T13:38:05.362094+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:38:05.362094+0000","last_undegraded":"2024-03-20T13:38:05.362094+0000","last_fullsized":"2024-03-20T13:38:05.362094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:57.952498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334809+0000","last_change":"2024-03-20T13:36:36.812837+0000","last_active":"2024-03-20T13:37:17.334809+0000","last_peered":"2024-03-20T13:37:17.334809+0000","last_clean":"2024-03-20T13:37:17.334809+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:37:17.334809+0000","last_undegraded":"2024-03-20T13:37:17.334809+0000","last_fullsized":"2024-03-20T13:37:17.334809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:34.606521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.333133+0000","last_change":"2024-03-20T13:36:38.839230+0000","last_active":"2024-03-20T13:37:21.333133+0000","last_peered":"2024-03-20T13:37:21.333133+0000","last_clean":"2024-03-20T13:37:21.333133+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:37:21.333133+0000","last_undegraded":"2024-03-20T13:37:21.333133+0000","last_fullsized":"2024-03-20T13:37:21.333133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:30.816812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.334989+0000","last_change":"2024-03-20T13:36:36.814746+0000","last_active":"2024-03-20T13:37:17.334989+0000","last_peered":"2024-03-20T13:37:17.334989+0000","last_clean":"2024-03-20T13:37:17.334989+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:37:17.334989+0000","last_undegraded":"2024-03-20T13:37:17.334989+0000","last_fullsized":"2024-03-20T13:37:17.334989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:55.744070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353374+0000","last_change":"2024-03-20T13:36:38.837487+0000","last_active":"2024-03-20T13:37:17.353374+0000","last_peered":"2024-03-20T13:37:17.353374+0000","last_clean":"2024-03-20T13:37:17.353374+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:37:17.353374+0000","last_undegraded":"2024-03-20T13:37:17.353374+0000","last_fullsized":"2024-03-20T13:37:17.353374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:02:07.258709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356320+0000","last_change":"2024-03-20T13:36:36.851159+0000","last_active":"2024-03-20T13:37:17.356320+0000","last_peered":"2024-03-20T13:37:17.356320+0000","last_clean":"2024-03-20T13:37:17.356320+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:37:17.356320+0000","last_undegraded":"2024-03-20T13:37:17.356320+0000","last_fullsized":"2024-03-20T13:37:17.356320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:19:31.572008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352794+0000","last_change":"2024-03-20T13:36:38.839750+0000","last_active":"2024-03-20T13:37:17.352794+0000","last_peered":"2024-03-20T13:37:17.352794+0000","last_clean":"2024-03-20T13:37:17.352794+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:37:17.352794+0000","last_undegraded":"2024-03-20T13:37:17.352794+0000","last_fullsized":"2024-03-20T13:37:17.352794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:04:09.779028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.353796+0000","last_change":"2024-03-20T13:36:36.811977+0000","last_active":"2024-03-20T13:38:05.353796+0000","last_peered":"2024-03-20T13:38:05.353796+0000","last_clean":"2024-03-20T13:38:05.353796+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:05.353796+0000","last_undegraded":"2024-03-20T13:38:05.353796+0000","last_fullsized":"2024-03-20T13:38:05.353796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:32:12.757319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559426+0000","last_change":"2024-03-20T13:37:17.364712+0000","last_active":"2024-03-20T13:38:04.559426+0000","last_peered":"2024-03-20T13:38:04.559426+0000","last_clean":"2024-03-20T13:38:04.559426+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:38:04.559426+0000","last_undegraded":"2024-03-20T13:38:04.559426+0000","last_fullsized":"2024-03-20T13:38:04.559426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:40:19.939344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348779+0000","last_change":"2024-03-20T13:36:36.846100+0000","last_active":"2024-03-20T13:37:17.348779+0000","last_peered":"2024-03-20T13:37:17.348779+0000","last_clean":"2024-03-20T13:37:17.348779+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:37:17.348779+0000","last_undegraded":"2024-03-20T13:37:17.348779+0000","last_fullsized":"2024-03-20T13:37:17.348779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:40:31.234425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348556+0000","last_change":"2024-03-20T13:36:38.837474+0000","last_active":"2024-03-20T13:37:17.348556+0000","last_peered":"2024-03-20T13:37:17.348556+0000","last_clean":"2024-03-20T13:37:17.348556+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:37:17.348556+0000","last_undegraded":"2024-03-20T13:37:17.348556+0000","last_fullsized":"2024-03-20T13:37:17.348556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:44.912843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350563+0000","last_change":"2024-03-20T13:36:36.831139+0000","last_active":"2024-03-20T13:37:17.350563+0000","last_peered":"2024-03-20T13:37:17.350563+0000","last_clean":"2024-03-20T13:37:17.350563+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:37:17.350563+0000","last_undegraded":"2024-03-20T13:37:17.350563+0000","last_fullsized":"2024-03-20T13:37:17.350563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:37.352809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038682+0000","last_change":"2024-03-20T13:36:38.836423+0000","last_active":"2024-03-20T13:38:11.038682+0000","last_peered":"2024-03-20T13:38:11.038682+0000","last_clean":"2024-03-20T13:38:11.038682+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:11.038682+0000","last_undegraded":"2024-03-20T13:38:11.038682+0000","last_fullsized":"2024-03-20T13:38:11.038682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:39.088995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345654+0000","last_change":"2024-03-20T13:36:36.818776+0000","last_active":"2024-03-20T13:37:17.345654+0000","last_peered":"2024-03-20T13:37:17.345654+0000","last_clean":"2024-03-20T13:37:17.345654+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:37:17.345654+0000","last_undegraded":"2024-03-20T13:37:17.345654+0000","last_fullsized":"2024-03-20T13:37:17.345654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:47.923230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349498+0000","last_change":"2024-03-20T13:36:38.831672+0000","last_active":"2024-03-20T13:37:17.349498+0000","last_peered":"2024-03-20T13:37:17.349498+0000","last_clean":"2024-03-20T13:37:17.349498+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:37:17.349498+0000","last_undegraded":"2024-03-20T13:37:17.349498+0000","last_fullsized":"2024-03-20T13:37:17.349498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:14.247721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360818+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:37:17.360818+0000","last_peered":"2024-03-20T13:37:17.360818+0000","last_clean":"2024-03-20T13:37:17.360818+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:37:17.360818+0000","last_undegraded":"2024-03-20T13:37:17.360818+0000","last_fullsized":"2024-03-20T13:37:17.360818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:38:04.418549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.038256+0000","last_change":"2024-03-20T13:36:38.839448+0000","last_active":"2024-03-20T13:38:11.038256+0000","last_peered":"2024-03-20T13:38:11.038256+0000","last_clean":"2024-03-20T13:38:11.038256+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:11.038256+0000","last_undegraded":"2024-03-20T13:38:11.038256+0000","last_fullsized":"2024-03-20T13:38:11.038256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:44:49.590482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339930+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:37:17.339930+0000","last_peered":"2024-03-20T13:37:17.339930+0000","last_clean":"2024-03-20T13:37:17.339930+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:37:17.339930+0000","last_undegraded":"2024-03-20T13:37:17.339930+0000","last_fullsized":"2024-03-20T13:37:17.339930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361835+0000","last_change":"2024-03-20T13:36:38.828492+0000","last_active":"2024-03-20T13:37:17.361835+0000","last_peered":"2024-03-20T13:37:17.361835+0000","last_clean":"2024-03-20T13:37:17.361835+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:37:17.361835+0000","last_undegraded":"2024-03-20T13:37:17.361835+0000","last_fullsized":"2024-03-20T13:37:17.361835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:50.713120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341186+0000","last_change":"2024-03-20T13:36:36.848972+0000","last_active":"2024-03-20T13:37:17.341186+0000","last_peered":"2024-03-20T13:37:17.341186+0000","last_clean":"2024-03-20T13:37:17.341186+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:37:17.341186+0000","last_undegraded":"2024-03-20T13:37:17.341186+0000","last_fullsized":"2024-03-20T13:37:17.341186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:57.609406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.559674+0000","last_change":"2024-03-20T13:36:38.830672+0000","last_active":"2024-03-20T13:38:04.559674+0000","last_peered":"2024-03-20T13:38:04.559674+0000","last_clean":"2024-03-20T13:38:04.559674+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:04.559674+0000","last_undegraded":"2024-03-20T13:38:04.559674+0000","last_fullsized":"2024-03-20T13:38:04.559674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.951500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.094321+0000","last_change":"2024-03-20T13:36:36.830049+0000","last_active":"2024-03-20T13:37:22.094321+0000","last_peered":"2024-03-20T13:37:22.094321+0000","last_clean":"2024-03-20T13:37:22.094321+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:37:22.094321+0000","last_undegraded":"2024-03-20T13:37:22.094321+0000","last_fullsized":"2024-03-20T13:37:22.094321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.370623+0000","last_change":"2024-03-20T13:37:17.369630+0000","last_active":"2024-03-20T13:37:17.370623+0000","last_peered":"2024-03-20T13:37:17.370623+0000","last_clean":"2024-03-20T13:37:17.370623+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:37:17.370623+0000","last_undegraded":"2024-03-20T13:37:17.370623+0000","last_fullsized":"2024-03-20T13:37:17.370623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:57:10.411859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348081+0000","last_change":"2024-03-20T13:36:36.831557+0000","last_active":"2024-03-20T13:37:17.348081+0000","last_peered":"2024-03-20T13:37:17.348081+0000","last_clean":"2024-03-20T13:37:17.348081+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:37:17.348081+0000","last_undegraded":"2024-03-20T13:37:17.348081+0000","last_fullsized":"2024-03-20T13:37:17.348081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:10:52.993902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.560621+0000","last_change":"2024-03-20T13:36:38.829272+0000","last_active":"2024-03-20T13:38:04.560621+0000","last_peered":"2024-03-20T13:38:04.560621+0000","last_clean":"2024-03-20T13:38:04.560621+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:38:04.560621+0000","last_undegraded":"2024-03-20T13:38:04.560621+0000","last_fullsized":"2024-03-20T13:38:04.560621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:10.202844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349002+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:37:17.349002+0000","last_peered":"2024-03-20T13:37:17.349002+0000","last_clean":"2024-03-20T13:37:17.349002+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:37:17.349002+0000","last_undegraded":"2024-03-20T13:37:17.349002+0000","last_fullsized":"2024-03-20T13:37:17.349002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:55.024764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.775462+0000","last_change":"2024-03-20T13:37:17.354371+0000","last_active":"2024-03-20T13:37:21.775462+0000","last_peered":"2024-03-20T13:37:21.775462+0000","last_clean":"2024-03-20T13:37:21.775462+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:37:21.775462+0000","last_undegraded":"2024-03-20T13:37:21.775462+0000","last_fullsized":"2024-03-20T13:37:21.775462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:51.168656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351746+0000","last_change":"2024-03-20T13:36:36.848902+0000","last_active":"2024-03-20T13:37:17.351746+0000","last_peered":"2024-03-20T13:37:17.351746+0000","last_clean":"2024-03-20T13:37:17.351746+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:37:17.351746+0000","last_undegraded":"2024-03-20T13:37:17.351746+0000","last_fullsized":"2024-03-20T13:37:17.351746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:48:05.712111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347273+0000","last_change":"2024-03-20T13:36:38.836588+0000","last_active":"2024-03-20T13:37:17.347273+0000","last_peered":"2024-03-20T13:37:17.347273+0000","last_clean":"2024-03-20T13:37:17.347273+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:37:17.347273+0000","last_undegraded":"2024-03-20T13:37:17.347273+0000","last_fullsized":"2024-03-20T13:37:17.347273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:49:53.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346147+0000","last_change":"2024-03-20T13:36:36.818507+0000","last_active":"2024-03-20T13:37:17.346147+0000","last_peered":"2024-03-20T13:37:17.346147+0000","last_clean":"2024-03-20T13:37:17.346147+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:37:17.346147+0000","last_undegraded":"2024-03-20T13:37:17.346147+0000","last_fullsized":"2024-03-20T13:37:17.346147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:42:17.676549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.103624+0000","last_change":"2024-03-20T13:36:38.828728+0000","last_active":"2024-03-20T13:37:22.103624+0000","last_peered":"2024-03-20T13:37:22.103624+0000","last_clean":"2024-03-20T13:37:22.103624+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:37:22.103624+0000","last_undegraded":"2024-03-20T13:37:22.103624+0000","last_fullsized":"2024-03-20T13:37:22.103624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:34.549840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.311031+0000","last_change":"2024-03-20T13:36:36.846419+0000","last_active":"2024-03-20T13:37:21.311031+0000","last_peered":"2024-03-20T13:37:21.311031+0000","last_clean":"2024-03-20T13:37:21.311031+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:37:21.311031+0000","last_undegraded":"2024-03-20T13:37:21.311031+0000","last_fullsized":"2024-03-20T13:37:21.311031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:01:10.719495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347654+0000","last_change":"2024-03-20T13:36:36.834343+0000","last_active":"2024-03-20T13:37:17.347654+0000","last_peered":"2024-03-20T13:37:17.347654+0000","last_clean":"2024-03-20T13:37:17.347654+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:37:17.347654+0000","last_undegraded":"2024-03-20T13:37:17.347654+0000","last_fullsized":"2024-03-20T13:37:17.347654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:25.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099296+0000","last_change":"2024-03-20T13:36:38.830650+0000","last_active":"2024-03-20T13:37:22.099296+0000","last_peered":"2024-03-20T13:37:22.099296+0000","last_clean":"2024-03-20T13:37:22.099296+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:37:22.099296+0000","last_undegraded":"2024-03-20T13:37:22.099296+0000","last_fullsized":"2024-03-20T13:37:22.099296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:47.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343075+0000","last_change":"2024-03-20T13:36:36.833552+0000","last_active":"2024-03-20T13:37:17.343075+0000","last_peered":"2024-03-20T13:37:17.343075+0000","last_clean":"2024-03-20T13:37:17.343075+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:37:17.343075+0000","last_undegraded":"2024-03-20T13:37:17.343075+0000","last_fullsized":"2024-03-20T13:37:17.343075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:30:36.635928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099152+0000","last_change":"2024-03-20T13:36:38.827748+0000","last_active":"2024-03-20T13:37:22.099152+0000","last_peered":"2024-03-20T13:37:22.099152+0000","last_clean":"2024-03-20T13:37:22.099152+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:37:22.099152+0000","last_undegraded":"2024-03-20T13:37:22.099152+0000","last_fullsized":"2024-03-20T13:37:22.099152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:07.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1269,"ondisk_log_size":1269,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672988,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Mar 20 13:37:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.68999999999999995}]}]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68899999999999995}]},{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.72899999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003}]}]},{"osd":1,"up_from":10,"seq":42949672987,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.627}]},{"osd":3,"last update":"Wed Mar 20 13:37:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57299999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.627}]},{"osd":3,"last update":"Wed Mar 20 13:37:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:38:23.897 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.897 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.897 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.897 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.897 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.898 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.898 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.898 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.898 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.898 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.898 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.899 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.900 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.900 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.900 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.900 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.900 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.901 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.901 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.901 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.901 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.901 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.901 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.902 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.902 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.902 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.902 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.902 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.902 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.903 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.903 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.903 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.903 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.903 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.904 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.904 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.904 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.904 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.904 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.904 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.905 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.905 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.905 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.905 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.905 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.905 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.906 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.906 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.906 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.906 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.906 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.907 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.907 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.907 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.907 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.907 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.908 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.908 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.908 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.908 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.908 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.908 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.909 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.909 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.909 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.909 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.909 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.909 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.910 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.910 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.910 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.910 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.910 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.910 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.911 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.911 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.911 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.911 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.911 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.911 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.912 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.913 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.913 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.913 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.913 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.913 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.913 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.914 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.914 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.914 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-20T13:36:22.715062+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=22, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.914 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.914 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.915 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.915 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.915 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.915 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.915 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.915 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.916 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.917 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.917 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.917 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.917 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.918 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.918 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.918 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.919 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.919 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.919 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.920 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.920 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.920 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.921 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.921 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.921 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.921 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.922 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.922 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.922 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.923 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.923 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.923 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.924 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.924 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.924 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.925 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.925 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.925 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.926 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.926 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.926 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.927 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.927 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.927 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.927 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.928 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.928 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.928 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.929 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.929 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.929 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.930 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.930 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.930 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.931 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.931 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.931 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.932 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.932 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.932 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.933 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.933 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.933 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.934 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.934 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.934 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.935 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.935 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.935 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.936 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.936 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.936 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.937 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.937 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.937 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.938 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.938 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.938 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.939 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.939 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.939 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.939 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.939 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.940 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.940 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.940 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.941 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.941 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.941 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.941 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.942 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.942 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.942 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.942 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.943 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.943 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.943 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.943 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.944 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.944 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.944 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.944 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.945 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.945 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.945 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.945 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.945 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.946 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.946 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.946 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.946 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.946 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.946 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.947 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.947 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.947 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.947 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.947 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.947 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.948 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.949 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.949 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.949 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.949 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.949 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.949 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.950 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.950 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.950 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.950 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.950 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.950 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.951 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.954 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.954 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.954 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.954 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.955 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.956 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.956 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.956 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.956 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.956 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.956 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.957 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:23.957 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:38:43.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:38:44.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.084+0000 7fe017122640 1 Processor -- start 2024-03-20T13:38:44.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.084+0000 7fe017122640 1 -- start start 2024-03-20T13:38:44.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.084+0000 7fe017122640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe01012b000 0x7fe01012b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe010072390 con 0x7fe01006c3f0 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01009c1e0 con 0x7fe01012b000 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe014ebe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe01012b000 0x7fe01012b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe014ebe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe01012b000 0x7fe01012b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36420/0 (socket says 172.21.15.89:36420) 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe014ebe640 1 -- 172.21.15.89:0/651131036 learned_addr learned my addr 172.21.15.89:0/651131036 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe014ebe640 1 -- 172.21.15.89:0/651131036 >> v1:172.21.15.89:6789/0 conn(0x7fe01006c3f0 legacy=0x7fe0101210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:44.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe014ebe640 1 -- 172.21.15.89:0/651131036 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01006d030 con 0x7fe01012b000 2024-03-20T13:38:44.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe014ebe640 1 --2- 172.21.15.89:0/651131036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01012b000 0x7fe01012b3e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097f0 tx=0x7fe00001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1f182bf65bdd2a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:44.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe00f7fe640 1 -- 172.21.15.89:0/651131036 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0000ab530 con 0x7fe01012b000 2024-03-20T13:38:44.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe00f7fe640 1 -- 172.21.15.89:0/651131036 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000a7050 con 0x7fe01012b000 2024-03-20T13:38:44.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe00f7fe640 1 -- 172.21.15.89:0/651131036 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0000ab7e0 con 0x7fe01012b000 2024-03-20T13:38:44.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- 172.21.15.89:0/651131036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01012b000 msgr2=0x7fe01012b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:44.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 --2- 172.21.15.89:0/651131036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01012b000 0x7fe01012b3e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097f0 tx=0x7fe00001c430 comp rx=0 tx=0).stop 2024-03-20T13:38:44.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- 172.21.15.89:0/651131036 shutdown_connections 2024-03-20T13:38:44.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 --2- 172.21.15.89:0/651131036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01012b000 0x7fe01012b3e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:44.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- 172.21.15.89:0/651131036 >> 172.21.15.89:0/651131036 conn(0x7fe01009a2f0 msgr2=0x7fe01009a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:44.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- 172.21.15.89:0/651131036 shutdown_connections 2024-03-20T13:38:44.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.088+0000 7fe017122640 1 -- 172.21.15.89:0/651131036 wait complete. 2024-03-20T13:38:44.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 Processor -- start 2024-03-20T13:38:44.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 -- start start 2024-03-20T13:38:44.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 0x7fe010092460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:44.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101249d0 con 0x7fe01006c3f0 2024-03-20T13:38:44.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe014ebe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 0x7fe010092460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:44.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe014ebe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 0x7fe010092460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36422/0 (socket says 172.21.15.89:36422) 2024-03-20T13:38:44.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe014ebe640 1 -- 172.21.15.89:0/2528681824 learned_addr learned my addr 172.21.15.89:0/2528681824 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:38:44.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe014ebe640 1 -- 172.21.15.89:0/2528681824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000094d0 con 0x7fe01006c3f0 2024-03-20T13:38:44.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe014ebe640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 0x7fe010092460 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe00001a060 tx=0x7fe00001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:44.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0000b6630 con 0x7fe01006c3f0 2024-03-20T13:38:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000b6790 con 0x7fe01006c3f0 2024-03-20T13:38:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010130190 con 0x7fe01006c3f0 2024-03-20T13:38:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0000b6a50 con 0x7fe01006c3f0 2024-03-20T13:38:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0100943e0 con 0x7fe01006c3f0 2024-03-20T13:38:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe0000b2040 con 0x7fe01006c3f0 2024-03-20T13:38:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01012a550 con 0x7fe01006c3f0 2024-03-20T13:38:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00d7fa640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fdffc0359c0 0x7fdffc037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fe0000e2fe0 con 0x7fe01006c3f0 2024-03-20T13:38:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.092+0000 7fe00ffff640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fdffc0359c0 0x7fdffc037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.096+0000 7fe00ffff640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fdffc0359c0 0x7fdffc037e80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe004000f70 tx=0x7fe004007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:44.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.096+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0000bd950 con 0x7fe01006c3f0 2024-03-20T13:38:44.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.252+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe010067e00 con 0x7fdffc0359c0 2024-03-20T13:38:44.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.296+0000 7fe00d7fa640 1 -- 172.21.15.89:0/2528681824 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666738 (secure 0 0 0) 0x7fe010067e00 con 0x7fdffc0359c0 2024-03-20T13:38:44.303 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:38:44.309 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fdffc0359c0 msgr2=0x7fdffc037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fdffc0359c0 0x7fdffc037e80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe004000f70 tx=0x7fe004007a40 comp rx=0 tx=0).stop 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 msgr2=0x7fe010092460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 0x7fe010092460 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe00001a060 tx=0x7fe00001ac70 comp rx=0 tx=0).stop 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 shutdown_connections 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fdffc0359c0 0x7fdffc037e80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:44.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 --2- 172.21.15.89:0/2528681824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe01006c3f0 0x7fe010092460 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 >> 172.21.15.89:0/2528681824 conn(0x7fe01009a2f0 msgr2=0x7fe0100969f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 shutdown_connections 2024-03-20T13:38:44.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:38:44.300+0000 7fe017122640 1 -- 172.21.15.89:0/2528681824 wait complete. 2024-03-20T13:38:44.322 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-03-20T13:38:42.333596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3999,"num_read_kb":3645,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3922,"ondisk_log_size":3922,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006091"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353360+0000","last_change":"2024-03-20T13:36:36.834585+0000","last_active":"2024-03-20T13:37:17.353360+0000","last_peered":"2024-03-20T13:37:17.353360+0000","last_clean":"2024-03-20T13:37:17.353360+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:37:17.353360+0000","last_undegraded":"2024-03-20T13:37:17.353360+0000","last_fullsized":"2024-03-20T13:37:17.353360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348457+0000","last_change":"2024-03-20T13:36:38.833359+0000","last_active":"2024-03-20T13:37:17.348457+0000","last_peered":"2024-03-20T13:37:17.348457+0000","last_clean":"2024-03-20T13:37:17.348457+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:37:17.348457+0000","last_undegraded":"2024-03-20T13:37:17.348457+0000","last_fullsized":"2024-03-20T13:37:17.348457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609646+0000","last_change":"2024-03-20T13:36:36.849152+0000","last_active":"2024-03-20T13:38:22.609646+0000","last_peered":"2024-03-20T13:38:22.609646+0000","last_clean":"2024-03-20T13:38:22.609646+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:38:22.609646+0000","last_undegraded":"2024-03-20T13:38:22.609646+0000","last_fullsized":"2024-03-20T13:38:22.609646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.049052+0000","last_change":"2024-03-20T13:36:38.817960+0000","last_active":"2024-03-20T13:38:11.049052+0000","last_peered":"2024-03-20T13:38:11.049052+0000","last_clean":"2024-03-20T13:38:11.049052+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:38:11.049052+0000","last_undegraded":"2024-03-20T13:38:11.049052+0000","last_fullsized":"2024-03-20T13:38:11.049052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542682+0000","last_change":"2024-03-20T13:36:36.848291+0000","last_active":"2024-03-20T13:38:23.542682+0000","last_peered":"2024-03-20T13:38:23.542682+0000","last_clean":"2024-03-20T13:38:23.542682+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:38:23.542682+0000","last_undegraded":"2024-03-20T13:38:23.542682+0000","last_fullsized":"2024-03-20T13:38:23.542682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902495+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:04.902495+0000","last_peered":"2024-03-20T13:38:04.902495+0000","last_clean":"2024-03-20T13:38:04.902495+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:04.902495+0000","last_undegraded":"2024-03-20T13:38:04.902495+0000","last_fullsized":"2024-03-20T13:38:04.902495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.081289+0000","last_change":"2024-03-20T13:36:36.813481+0000","last_active":"2024-03-20T13:38:23.081289+0000","last_peered":"2024-03-20T13:38:23.081289+0000","last_clean":"2024-03-20T13:38:23.081289+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:38:23.081289+0000","last_undegraded":"2024-03-20T13:38:23.081289+0000","last_fullsized":"2024-03-20T13:38:23.081289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.346499+0000","last_change":"2024-03-20T13:36:38.821653+0000","last_active":"2024-03-20T13:37:21.346499+0000","last_peered":"2024-03-20T13:37:21.346499+0000","last_clean":"2024-03-20T13:37:21.346499+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:37:21.346499+0000","last_undegraded":"2024-03-20T13:37:21.346499+0000","last_fullsized":"2024-03-20T13:37:21.346499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.035487+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:11.035487+0000","last_peered":"2024-03-20T13:38:11.035487+0000","last_clean":"2024-03-20T13:38:11.035487+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:11.035487+0000","last_undegraded":"2024-03-20T13:38:11.035487+0000","last_fullsized":"2024-03-20T13:38:11.035487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.610404+0000","last_change":"2024-03-20T13:36:38.841957+0000","last_active":"2024-03-20T13:38:22.610404+0000","last_peered":"2024-03-20T13:38:22.610404+0000","last_clean":"2024-03-20T13:38:22.610404+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:22.610404+0000","last_undegraded":"2024-03-20T13:38:22.610404+0000","last_fullsized":"2024-03-20T13:38:22.610404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349963+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:37:17.349963+0000","last_peered":"2024-03-20T13:37:17.349963+0000","last_clean":"2024-03-20T13:37:17.349963+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:37:17.349963+0000","last_undegraded":"2024-03-20T13:37:17.349963+0000","last_fullsized":"2024-03-20T13:37:17.349963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.360328+0000","last_change":"2024-03-20T13:38:34.360390+0000","last_active":"2024-03-20T13:38:34.360328+0000","last_peered":"2024-03-20T13:38:34.360328+0000","last_clean":"2024-03-20T13:38:34.360328+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:38:34.360328+0000","last_undegraded":"2024-03-20T13:38:34.360328+0000","last_fullsized":"2024-03-20T13:38:34.360328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.360106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:40.327388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342569+0000","last_change":"2024-03-20T13:36:36.844496+0000","last_active":"2024-03-20T13:37:17.342569+0000","last_peered":"2024-03-20T13:37:17.342569+0000","last_clean":"2024-03-20T13:37:17.342569+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:37:17.342569+0000","last_undegraded":"2024-03-20T13:37:17.342569+0000","last_fullsized":"2024-03-20T13:37:17.342569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356513+0000","last_change":"2024-03-20T13:36:38.843718+0000","last_active":"2024-03-20T13:37:17.356513+0000","last_peered":"2024-03-20T13:37:17.356513+0000","last_clean":"2024-03-20T13:37:17.356513+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:37:17.356513+0000","last_undegraded":"2024-03-20T13:37:17.356513+0000","last_fullsized":"2024-03-20T13:37:17.356513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.532450+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:37:20.532450+0000","last_peered":"2024-03-20T13:37:20.532450+0000","last_clean":"2024-03-20T13:37:20.532450+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:37:20.532450+0000","last_undegraded":"2024-03-20T13:37:20.532450+0000","last_fullsized":"2024-03-20T13:37:20.532450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.049288+0000","last_change":"2024-03-20T13:36:38.830884+0000","last_active":"2024-03-20T13:38:11.049288+0000","last_peered":"2024-03-20T13:38:11.049288+0000","last_clean":"2024-03-20T13:38:11.049288+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:11.049288+0000","last_undegraded":"2024-03-20T13:38:11.049288+0000","last_fullsized":"2024-03-20T13:38:11.049288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348286+0000","last_change":"2024-03-20T13:36:38.833138+0000","last_active":"2024-03-20T13:37:17.348286+0000","last_peered":"2024-03-20T13:37:17.348286+0000","last_clean":"2024-03-20T13:37:17.348286+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:37:17.348286+0000","last_undegraded":"2024-03-20T13:37:17.348286+0000","last_fullsized":"2024-03-20T13:37:17.348286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.075340+0000","last_change":"2024-03-20T13:36:36.832461+0000","last_active":"2024-03-20T13:37:22.075340+0000","last_peered":"2024-03-20T13:37:22.075340+0000","last_clean":"2024-03-20T13:37:22.075340+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:37:22.075340+0000","last_undegraded":"2024-03-20T13:37:22.075340+0000","last_fullsized":"2024-03-20T13:37:22.075340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.051377+0000","last_change":"2024-03-20T13:36:38.843593+0000","last_active":"2024-03-20T13:38:11.051377+0000","last_peered":"2024-03-20T13:38:11.051377+0000","last_clean":"2024-03-20T13:38:11.051377+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:11.051377+0000","last_undegraded":"2024-03-20T13:38:11.051377+0000","last_fullsized":"2024-03-20T13:38:11.051377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348008+0000","last_change":"2024-03-20T13:36:36.818443+0000","last_active":"2024-03-20T13:37:17.348008+0000","last_peered":"2024-03-20T13:37:17.348008+0000","last_clean":"2024-03-20T13:37:17.348008+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:37:17.348008+0000","last_undegraded":"2024-03-20T13:37:17.348008+0000","last_fullsized":"2024-03-20T13:37:17.348008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.371366+0000","last_change":"2024-03-20T13:36:38.831759+0000","last_active":"2024-03-20T13:38:05.371366+0000","last_peered":"2024-03-20T13:38:05.371366+0000","last_clean":"2024-03-20T13:38:05.371366+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:05.371366+0000","last_undegraded":"2024-03-20T13:38:05.371366+0000","last_fullsized":"2024-03-20T13:38:05.371366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353887+0000","last_change":"2024-03-20T13:36:36.840606+0000","last_active":"2024-03-20T13:37:17.353887+0000","last_peered":"2024-03-20T13:37:17.353887+0000","last_clean":"2024-03-20T13:37:17.353887+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:37:17.353887+0000","last_undegraded":"2024-03-20T13:37:17.353887+0000","last_fullsized":"2024-03-20T13:37:17.353887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048497+0000","last_change":"2024-03-20T13:36:38.828329+0000","last_active":"2024-03-20T13:38:11.048497+0000","last_peered":"2024-03-20T13:38:11.048497+0000","last_clean":"2024-03-20T13:38:11.048497+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:11.048497+0000","last_undegraded":"2024-03-20T13:38:11.048497+0000","last_fullsized":"2024-03-20T13:38:11.048497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.093402+0000","last_change":"2024-03-20T13:36:36.826166+0000","last_active":"2024-03-20T13:37:22.093402+0000","last_peered":"2024-03-20T13:37:22.093402+0000","last_clean":"2024-03-20T13:37:22.093402+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:37:22.093402+0000","last_undegraded":"2024-03-20T13:37:22.093402+0000","last_fullsized":"2024-03-20T13:37:22.093402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.345515+0000","last_change":"2024-03-20T13:36:38.825590+0000","last_active":"2024-03-20T13:37:21.345515+0000","last_peered":"2024-03-20T13:37:21.345515+0000","last_clean":"2024-03-20T13:37:21.345515+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:37:21.345515+0000","last_undegraded":"2024-03-20T13:37:21.345515+0000","last_fullsized":"2024-03-20T13:37:21.345515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355801+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:37:17.355801+0000","last_peered":"2024-03-20T13:37:17.355801+0000","last_clean":"2024-03-20T13:37:17.355801+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:37:17.355801+0000","last_undegraded":"2024-03-20T13:37:17.355801+0000","last_fullsized":"2024-03-20T13:37:17.355801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.345907+0000","last_change":"2024-03-20T13:36:38.836549+0000","last_active":"2024-03-20T13:37:21.345907+0000","last_peered":"2024-03-20T13:37:21.345907+0000","last_clean":"2024-03-20T13:37:21.345907+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:37:21.345907+0000","last_undegraded":"2024-03-20T13:37:21.345907+0000","last_fullsized":"2024-03-20T13:37:21.345907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.357171+0000","last_change":"2024-03-20T13:36:36.848317+0000","last_active":"2024-03-20T13:37:17.357171+0000","last_peered":"2024-03-20T13:37:17.357171+0000","last_clean":"2024-03-20T13:37:17.357171+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:37:17.357171+0000","last_undegraded":"2024-03-20T13:37:17.357171+0000","last_fullsized":"2024-03-20T13:37:17.357171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.066668+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:11.066668+0000","last_peered":"2024-03-20T13:38:11.066668+0000","last_clean":"2024-03-20T13:38:11.066668+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:11.066668+0000","last_undegraded":"2024-03-20T13:38:11.066668+0000","last_fullsized":"2024-03-20T13:38:11.066668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.371030+0000","last_change":"2024-03-20T13:36:38.833120+0000","last_active":"2024-03-20T13:38:05.371030+0000","last_peered":"2024-03-20T13:38:05.371030+0000","last_clean":"2024-03-20T13:38:05.371030+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:05.371030+0000","last_undegraded":"2024-03-20T13:38:05.371030+0000","last_fullsized":"2024-03-20T13:38:05.371030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350126+0000","last_change":"2024-03-20T13:36:36.847955+0000","last_active":"2024-03-20T13:37:17.350126+0000","last_peered":"2024-03-20T13:37:17.350126+0000","last_clean":"2024-03-20T13:37:17.350126+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:37:17.350126+0000","last_undegraded":"2024-03-20T13:37:17.350126+0000","last_fullsized":"2024-03-20T13:37:17.350126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.359360+0000","last_change":"2024-03-20T13:36:40.850195+0000","last_active":"2024-03-20T13:37:17.359360+0000","last_peered":"2024-03-20T13:37:17.359360+0000","last_clean":"2024-03-20T13:37:17.359360+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:37:17.359360+0000","last_undegraded":"2024-03-20T13:37:17.359360+0000","last_fullsized":"2024-03-20T13:37:17.359360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.636287+0000","last_change":"2024-03-20T13:38:27.636370+0000","last_active":"2024-03-20T13:38:27.636287+0000","last_peered":"2024-03-20T13:38:27.636287+0000","last_clean":"2024-03-20T13:38:27.636287+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:27.636287+0000","last_undegraded":"2024-03-20T13:38:27.636287+0000","last_fullsized":"2024-03-20T13:38:27.636287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.636107+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:56.436080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351181+0000","last_change":"2024-03-20T13:36:44.870120+0000","last_active":"2024-03-20T13:37:17.351181+0000","last_peered":"2024-03-20T13:37:17.351181+0000","last_clean":"2024-03-20T13:37:17.351181+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:37:17.351181+0000","last_undegraded":"2024-03-20T13:37:17.351181+0000","last_fullsized":"2024-03-20T13:37:17.351181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.111775+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:38:05.111775+0000","last_peered":"2024-03-20T13:38:05.111775+0000","last_clean":"2024-03-20T13:38:05.111775+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:38:05.111775+0000","last_undegraded":"2024-03-20T13:38:05.111775+0000","last_fullsized":"2024-03-20T13:38:05.111775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.108670+0000","last_change":"2024-03-20T13:36:38.822857+0000","last_active":"2024-03-20T13:37:22.108670+0000","last_peered":"2024-03-20T13:37:22.108670+0000","last_clean":"2024-03-20T13:37:22.108670+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:37:22.108670+0000","last_undegraded":"2024-03-20T13:37:22.108670+0000","last_fullsized":"2024-03-20T13:37:22.108670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.337768+0000","last_change":"2024-03-20T13:36:36.815979+0000","last_active":"2024-03-20T13:37:17.337768+0000","last_peered":"2024-03-20T13:37:17.337768+0000","last_clean":"2024-03-20T13:37:17.337768+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:37:17.337768+0000","last_undegraded":"2024-03-20T13:37:17.337768+0000","last_fullsized":"2024-03-20T13:37:17.337768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.609749+0000","last_change":"2024-03-20T13:38:28.609801+0000","last_active":"2024-03-20T13:38:28.609749+0000","last_peered":"2024-03-20T13:38:28.609749+0000","last_clean":"2024-03-20T13:38:28.609749+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:38:28.609749+0000","last_undegraded":"2024-03-20T13:38:28.609749+0000","last_fullsized":"2024-03-20T13:38:28.609749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.609546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.417547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.498201+0000","last_change":"2024-03-20T13:38:32.498376+0000","last_active":"2024-03-20T13:38:32.498201+0000","last_peered":"2024-03-20T13:38:32.498201+0000","last_clean":"2024-03-20T13:38:32.498201+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:38:32.498201+0000","last_undegraded":"2024-03-20T13:38:32.498201+0000","last_fullsized":"2024-03-20T13:38:32.498201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.497987+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:26.085583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353094+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:37:17.353094+0000","last_peered":"2024-03-20T13:37:17.353094+0000","last_clean":"2024-03-20T13:37:17.353094+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:37:17.353094+0000","last_undegraded":"2024-03-20T13:37:17.353094+0000","last_fullsized":"2024-03-20T13:37:17.353094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355788+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:37:17.355788+0000","last_peered":"2024-03-20T13:37:17.355788+0000","last_clean":"2024-03-20T13:37:17.355788+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:37:17.355788+0000","last_undegraded":"2024-03-20T13:37:17.355788+0000","last_fullsized":"2024-03-20T13:37:17.355788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.050255+0000","last_change":"2024-03-20T13:37:17.351202+0000","last_active":"2024-03-20T13:38:11.050255+0000","last_peered":"2024-03-20T13:38:11.050255+0000","last_clean":"2024-03-20T13:38:11.050255+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:38:11.050255+0000","last_undegraded":"2024-03-20T13:38:11.050255+0000","last_fullsized":"2024-03-20T13:38:11.050255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347670+0000","last_change":"2024-03-20T13:36:36.825659+0000","last_active":"2024-03-20T13:37:17.347670+0000","last_peered":"2024-03-20T13:37:17.347670+0000","last_clean":"2024-03-20T13:37:17.347670+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:37:17.347670+0000","last_undegraded":"2024-03-20T13:37:17.347670+0000","last_fullsized":"2024-03-20T13:37:17.347670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.622295+0000","last_change":"2024-03-20T13:38:32.622403+0000","last_active":"2024-03-20T13:38:32.622295+0000","last_peered":"2024-03-20T13:38:32.622295+0000","last_clean":"2024-03-20T13:38:32.622295+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:38:32.622295+0000","last_undegraded":"2024-03-20T13:38:32.622295+0000","last_fullsized":"2024-03-20T13:38:32.622295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.622043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:44.229800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.562126+0000","last_change":"2024-03-20T13:38:35.562204+0000","last_active":"2024-03-20T13:38:35.562126+0000","last_peered":"2024-03-20T13:38:35.562126+0000","last_clean":"2024-03-20T13:38:35.562126+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:38:35.562126+0000","last_undegraded":"2024-03-20T13:38:35.562126+0000","last_fullsized":"2024-03-20T13:38:35.562126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.561937+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:38:29.683966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'243","reported_seq":309,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.123431+0000","last_change":"2024-03-20T13:36:44.878389+0000","last_active":"2024-03-20T13:38:19.123431+0000","last_peered":"2024-03-20T13:38:19.123431+0000","last_clean":"2024-03-20T13:38:19.123431+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:38:19.123431+0000","last_undegraded":"2024-03-20T13:38:19.123431+0000","last_fullsized":"2024-03-20T13:38:19.123431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.559471+0000","last_change":"2024-03-20T13:38:26.559533+0000","last_active":"2024-03-20T13:38:26.559471+0000","last_peered":"2024-03-20T13:38:26.559471+0000","last_clean":"2024-03-20T13:38:26.559471+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:38:26.559471+0000","last_undegraded":"2024-03-20T13:38:26.559471+0000","last_fullsized":"2024-03-20T13:38:26.559471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.559287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:27.493448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.813042+0000","last_change":"2024-03-20T13:36:38.835366+0000","last_active":"2024-03-20T13:37:22.813042+0000","last_peered":"2024-03-20T13:37:22.813042+0000","last_clean":"2024-03-20T13:37:22.813042+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:37:22.813042+0000","last_undegraded":"2024-03-20T13:37:22.813042+0000","last_fullsized":"2024-03-20T13:37:22.813042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347123+0000","last_change":"2024-03-20T13:36:36.838074+0000","last_active":"2024-03-20T13:37:17.347123+0000","last_peered":"2024-03-20T13:37:17.347123+0000","last_clean":"2024-03-20T13:37:17.347123+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:37:17.347123+0000","last_undegraded":"2024-03-20T13:37:17.347123+0000","last_fullsized":"2024-03-20T13:37:17.347123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.432974+0000","last_change":"2024-03-20T13:38:25.433031+0000","last_active":"2024-03-20T13:38:25.432974+0000","last_peered":"2024-03-20T13:38:25.432974+0000","last_clean":"2024-03-20T13:38:25.432974+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:38:25.432974+0000","last_undegraded":"2024-03-20T13:38:25.432974+0000","last_fullsized":"2024-03-20T13:38:25.432974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.432781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:35.180635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'31","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.066168+0000","last_change":"2024-03-20T13:36:42.860645+0000","last_active":"2024-03-20T13:38:19.066168+0000","last_peered":"2024-03-20T13:38:19.066168+0000","last_clean":"2024-03-20T13:38:19.066168+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:19.066168+0000","last_undegraded":"2024-03-20T13:38:19.066168+0000","last_fullsized":"2024-03-20T13:38:19.066168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'243","reported_seq":331,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.606070+0000","last_change":"2024-03-20T13:38:39.606212+0000","last_active":"2024-03-20T13:38:39.606070+0000","last_peered":"2024-03-20T13:38:39.606070+0000","last_clean":"2024-03-20T13:38:39.606070+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:39.606070+0000","last_undegraded":"2024-03-20T13:38:39.606070+0000","last_fullsized":"2024-03-20T13:38:39.606070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.605847+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:06:01.030174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.317008+0000","last_change":"2024-03-20T13:37:17.356166+0000","last_active":"2024-03-20T13:37:21.317008+0000","last_peered":"2024-03-20T13:37:21.317008+0000","last_clean":"2024-03-20T13:37:21.317008+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:37:21.317008+0000","last_undegraded":"2024-03-20T13:37:21.317008+0000","last_fullsized":"2024-03-20T13:37:21.317008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.534318+0000","last_change":"2024-03-20T13:36:36.834443+0000","last_active":"2024-03-20T13:37:20.534318+0000","last_peered":"2024-03-20T13:37:20.534318+0000","last_clean":"2024-03-20T13:37:20.534318+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:37:20.534318+0000","last_undegraded":"2024-03-20T13:37:20.534318+0000","last_fullsized":"2024-03-20T13:37:20.534318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.529749+0000","last_change":"2024-03-20T13:38:33.529826+0000","last_active":"2024-03-20T13:38:33.529749+0000","last_peered":"2024-03-20T13:38:33.529749+0000","last_clean":"2024-03-20T13:38:33.529749+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:38:33.529749+0000","last_undegraded":"2024-03-20T13:38:33.529749+0000","last_fullsized":"2024-03-20T13:38:33.529749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.529572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:40.945003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.281094+0000","last_change":"2024-03-20T13:38:39.281180+0000","last_active":"2024-03-20T13:38:39.281094+0000","last_peered":"2024-03-20T13:38:39.281094+0000","last_clean":"2024-03-20T13:38:39.281094+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:39.281094+0000","last_undegraded":"2024-03-20T13:38:39.281094+0000","last_fullsized":"2024-03-20T13:38:39.281094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.281001+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:54.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.650470+0000","last_change":"2024-03-20T13:38:24.650522+0000","last_active":"2024-03-20T13:38:24.650470+0000","last_peered":"2024-03-20T13:38:24.650470+0000","last_clean":"2024-03-20T13:38:24.650470+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:38:24.650470+0000","last_undegraded":"2024-03-20T13:38:24.650470+0000","last_fullsized":"2024-03-20T13:38:24.650470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.650271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:30:43.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.539189+0000","last_change":"2024-03-20T13:38:34.539249+0000","last_active":"2024-03-20T13:38:34.539189+0000","last_peered":"2024-03-20T13:38:34.539189+0000","last_clean":"2024-03-20T13:38:34.539189+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:34.539189+0000","last_undegraded":"2024-03-20T13:38:34.539189+0000","last_fullsized":"2024-03-20T13:38:34.539189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.539008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:16:31.372326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345298+0000","last_change":"2024-03-20T13:36:38.831983+0000","last_active":"2024-03-20T13:37:17.345298+0000","last_peered":"2024-03-20T13:37:17.345298+0000","last_clean":"2024-03-20T13:37:17.345298+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:37:17.345298+0000","last_undegraded":"2024-03-20T13:37:17.345298+0000","last_fullsized":"2024-03-20T13:37:17.345298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353957+0000","last_change":"2024-03-20T13:36:36.839624+0000","last_active":"2024-03-20T13:37:17.353957+0000","last_peered":"2024-03-20T13:37:17.353957+0000","last_clean":"2024-03-20T13:37:17.353957+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:37:17.353957+0000","last_undegraded":"2024-03-20T13:37:17.353957+0000","last_fullsized":"2024-03-20T13:37:17.353957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.584912+0000","last_change":"2024-03-20T13:38:37.584967+0000","last_active":"2024-03-20T13:38:37.584912+0000","last_peered":"2024-03-20T13:38:37.584912+0000","last_clean":"2024-03-20T13:38:37.584912+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:38:37.584912+0000","last_undegraded":"2024-03-20T13:38:37.584912+0000","last_fullsized":"2024-03-20T13:38:37.584912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.584698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:47:36.547057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.690313+0000","last_change":"2024-03-20T13:38:24.690450+0000","last_active":"2024-03-20T13:38:24.690313+0000","last_peered":"2024-03-20T13:38:24.690313+0000","last_clean":"2024-03-20T13:38:24.690313+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:24.690313+0000","last_undegraded":"2024-03-20T13:38:24.690313+0000","last_fullsized":"2024-03-20T13:38:24.690313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.690100+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:03.686066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.585558+0000","last_change":"2024-03-20T13:38:34.585659+0000","last_active":"2024-03-20T13:38:34.585558+0000","last_peered":"2024-03-20T13:38:34.585558+0000","last_clean":"2024-03-20T13:38:34.585558+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:38:34.585558+0000","last_undegraded":"2024-03-20T13:38:34.585558+0000","last_fullsized":"2024-03-20T13:38:34.585558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.585283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.364588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:59.503352+0000","last_change":"2024-03-20T13:36:46.873147+0000","last_active":"2024-03-20T13:37:59.503352+0000","last_peered":"2024-03-20T13:37:59.503352+0000","last_clean":"2024-03-20T13:37:59.503352+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:37:59.503352+0000","last_undegraded":"2024-03-20T13:37:59.503352+0000","last_fullsized":"2024-03-20T13:37:59.503352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350690+0000","last_change":"2024-03-20T13:36:38.827772+0000","last_active":"2024-03-20T13:37:17.350690+0000","last_peered":"2024-03-20T13:37:17.350690+0000","last_clean":"2024-03-20T13:37:17.350690+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:37:17.350690+0000","last_undegraded":"2024-03-20T13:37:17.350690+0000","last_fullsized":"2024-03-20T13:37:17.350690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355890+0000","last_change":"2024-03-20T13:36:36.826408+0000","last_active":"2024-03-20T13:37:17.355890+0000","last_peered":"2024-03-20T13:37:17.355890+0000","last_clean":"2024-03-20T13:37:17.355890+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:37:17.355890+0000","last_undegraded":"2024-03-20T13:37:17.355890+0000","last_fullsized":"2024-03-20T13:37:17.355890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338884+0000","last_change":"2024-03-20T13:36:40.846177+0000","last_active":"2024-03-20T13:37:17.338884+0000","last_peered":"2024-03-20T13:37:17.338884+0000","last_clean":"2024-03-20T13:37:17.338884+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:37:17.338884+0000","last_undegraded":"2024-03-20T13:37:17.338884+0000","last_fullsized":"2024-03-20T13:37:17.338884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'43","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.435159+0000","last_change":"2024-03-20T13:38:27.435258+0000","last_active":"2024-03-20T13:38:27.435159+0000","last_peered":"2024-03-20T13:38:27.435159+0000","last_clean":"2024-03-20T13:38:27.435159+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:27.435159+0000","last_undegraded":"2024-03-20T13:38:27.435159+0000","last_fullsized":"2024-03-20T13:38:27.435159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.434963+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:19.183364+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'243","reported_seq":296,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.518816+0000","last_change":"2024-03-20T13:38:24.518877+0000","last_active":"2024-03-20T13:38:24.518816+0000","last_peered":"2024-03-20T13:38:24.518816+0000","last_clean":"2024-03-20T13:38:24.518816+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:24.518816+0000","last_undegraded":"2024-03-20T13:38:24.518816+0000","last_fullsized":"2024-03-20T13:38:24.518816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.518629+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:39.808004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351129+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:37:17.351129+0000","last_peered":"2024-03-20T13:37:17.351129+0000","last_clean":"2024-03-20T13:37:17.351129+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:37:17.351129+0000","last_undegraded":"2024-03-20T13:37:17.351129+0000","last_fullsized":"2024-03-20T13:37:17.351129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.371445+0000","last_change":"2024-03-20T13:36:38.840955+0000","last_active":"2024-03-20T13:38:05.371445+0000","last_peered":"2024-03-20T13:38:05.371445+0000","last_clean":"2024-03-20T13:38:05.371445+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:05.371445+0000","last_undegraded":"2024-03-20T13:38:05.371445+0000","last_fullsized":"2024-03-20T13:38:05.371445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350561+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:37:17.350561+0000","last_peered":"2024-03-20T13:37:17.350561+0000","last_clean":"2024-03-20T13:37:17.350561+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:37:17.350561+0000","last_undegraded":"2024-03-20T13:37:17.350561+0000","last_fullsized":"2024-03-20T13:37:17.350561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343312+0000","last_change":"2024-03-20T13:36:40.845768+0000","last_active":"2024-03-20T13:37:17.343312+0000","last_peered":"2024-03-20T13:37:17.343312+0000","last_clean":"2024-03-20T13:37:17.343312+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:37:17.343312+0000","last_undegraded":"2024-03-20T13:37:17.343312+0000","last_fullsized":"2024-03-20T13:37:17.343312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'59","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.623295+0000","last_change":"2024-03-20T13:38:38.623377+0000","last_active":"2024-03-20T13:38:38.623295+0000","last_peered":"2024-03-20T13:38:38.623295+0000","last_clean":"2024-03-20T13:38:38.623295+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:38.623295+0000","last_undegraded":"2024-03-20T13:38:38.623295+0000","last_fullsized":"2024-03-20T13:38:38.623295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.623108+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:30.447395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.535612+0000","last_change":"2024-03-20T13:38:31.535665+0000","last_active":"2024-03-20T13:38:31.535612+0000","last_peered":"2024-03-20T13:38:31.535612+0000","last_clean":"2024-03-20T13:38:31.535612+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:38:31.535612+0000","last_undegraded":"2024-03-20T13:38:31.535612+0000","last_fullsized":"2024-03-20T13:38:31.535612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.535387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:13.731269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.057726+0000","last_change":"2024-03-20T13:36:46.886740+0000","last_active":"2024-03-20T13:38:11.057726+0000","last_peered":"2024-03-20T13:38:11.057726+0000","last_clean":"2024-03-20T13:38:11.057726+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:38:11.057726+0000","last_undegraded":"2024-03-20T13:38:11.057726+0000","last_fullsized":"2024-03-20T13:38:11.057726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370782+0000","last_change":"2024-03-20T13:36:38.832987+0000","last_active":"2024-03-20T13:38:05.370782+0000","last_peered":"2024-03-20T13:38:05.370782+0000","last_clean":"2024-03-20T13:38:05.370782+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:38:05.370782+0000","last_undegraded":"2024-03-20T13:38:05.370782+0000","last_fullsized":"2024-03-20T13:38:05.370782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.069648+0000","last_change":"2024-03-20T13:36:36.846257+0000","last_active":"2024-03-20T13:37:22.069648+0000","last_peered":"2024-03-20T13:37:22.069648+0000","last_clean":"2024-03-20T13:37:22.069648+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:37:22.069648+0000","last_undegraded":"2024-03-20T13:37:22.069648+0000","last_fullsized":"2024-03-20T13:37:22.069648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343938+0000","last_change":"2024-03-20T13:36:40.839225+0000","last_active":"2024-03-20T13:37:17.343938+0000","last_peered":"2024-03-20T13:37:17.343938+0000","last_clean":"2024-03-20T13:37:17.343938+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:37:17.343938+0000","last_undegraded":"2024-03-20T13:37:17.343938+0000","last_fullsized":"2024-03-20T13:37:17.343938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.306828+0000","last_change":"2024-03-20T13:38:38.306918+0000","last_active":"2024-03-20T13:38:38.306828+0000","last_peered":"2024-03-20T13:38:38.306828+0000","last_clean":"2024-03-20T13:38:38.306828+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:38.306828+0000","last_undegraded":"2024-03-20T13:38:38.306828+0000","last_fullsized":"2024-03-20T13:38:38.306828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.306607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:10:18.381390+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360699+0000","last_change":"2024-03-20T13:36:44.899145+0000","last_active":"2024-03-20T13:37:17.360699+0000","last_peered":"2024-03-20T13:37:17.360699+0000","last_clean":"2024-03-20T13:37:17.360699+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:37:17.360699+0000","last_undegraded":"2024-03-20T13:37:17.360699+0000","last_fullsized":"2024-03-20T13:37:17.360699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.338153+0000","last_change":"2024-03-20T13:36:46.875764+0000","last_active":"2024-03-20T13:37:17.338153+0000","last_peered":"2024-03-20T13:37:17.338153+0000","last_clean":"2024-03-20T13:37:17.338153+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:37:17.338153+0000","last_undegraded":"2024-03-20T13:37:17.338153+0000","last_fullsized":"2024-03-20T13:37:17.338153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356226+0000","last_change":"2024-03-20T13:36:38.831920+0000","last_active":"2024-03-20T13:37:17.356226+0000","last_peered":"2024-03-20T13:37:17.356226+0000","last_clean":"2024-03-20T13:37:17.356226+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:37:17.356226+0000","last_undegraded":"2024-03-20T13:37:17.356226+0000","last_fullsized":"2024-03-20T13:37:17.356226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.087226+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:37:22.087226+0000","last_peered":"2024-03-20T13:37:22.087226+0000","last_clean":"2024-03-20T13:37:22.087226+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:37:22.087226+0000","last_undegraded":"2024-03-20T13:37:22.087226+0000","last_fullsized":"2024-03-20T13:37:22.087226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.615247+0000","last_change":"2024-03-20T13:38:40.615334+0000","last_active":"2024-03-20T13:38:40.615247+0000","last_peered":"2024-03-20T13:38:40.615247+0000","last_clean":"2024-03-20T13:38:40.615247+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:38:40.615247+0000","last_undegraded":"2024-03-20T13:38:40.615247+0000","last_fullsized":"2024-03-20T13:38:40.615247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.614954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:28:08.933992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'43","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.605906+0000","last_change":"2024-03-20T13:38:36.605992+0000","last_active":"2024-03-20T13:38:36.605906+0000","last_peered":"2024-03-20T13:38:36.605906+0000","last_clean":"2024-03-20T13:38:36.605906+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:36.605906+0000","last_undegraded":"2024-03-20T13:38:36.605906+0000","last_fullsized":"2024-03-20T13:38:36.605906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.605713+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:07:49.073403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'243","reported_seq":333,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.527214+0000","last_change":"2024-03-20T13:38:25.527288+0000","last_active":"2024-03-20T13:38:25.527214+0000","last_peered":"2024-03-20T13:38:25.527214+0000","last_clean":"2024-03-20T13:38:25.527214+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:25.527214+0000","last_undegraded":"2024-03-20T13:38:25.527214+0000","last_fullsized":"2024-03-20T13:38:25.527214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.527025+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:50.329674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.381323+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:05.381323+0000","last_peered":"2024-03-20T13:38:05.381323+0000","last_clean":"2024-03-20T13:38:05.381323+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:05.381323+0000","last_undegraded":"2024-03-20T13:38:05.381323+0000","last_fullsized":"2024-03-20T13:38:05.381323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346011+0000","last_change":"2024-03-20T13:36:38.825748+0000","last_active":"2024-03-20T13:37:17.346011+0000","last_peered":"2024-03-20T13:37:17.346011+0000","last_clean":"2024-03-20T13:37:17.346011+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:37:17.346011+0000","last_undegraded":"2024-03-20T13:37:17.346011+0000","last_fullsized":"2024-03-20T13:37:17.346011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.905426+0000","last_change":"2024-03-20T13:36:36.846954+0000","last_active":"2024-03-20T13:38:04.905426+0000","last_peered":"2024-03-20T13:38:04.905426+0000","last_clean":"2024-03-20T13:38:04.905426+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:38:04.905426+0000","last_undegraded":"2024-03-20T13:38:04.905426+0000","last_fullsized":"2024-03-20T13:38:04.905426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.451525+0000","last_change":"2024-03-20T13:38:24.451601+0000","last_active":"2024-03-20T13:38:24.451525+0000","last_peered":"2024-03-20T13:38:24.451525+0000","last_clean":"2024-03-20T13:38:24.451525+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:24.451525+0000","last_undegraded":"2024-03-20T13:38:24.451525+0000","last_fullsized":"2024-03-20T13:38:24.451525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.451322+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:19.284619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.664813+0000","last_change":"2024-03-20T13:38:26.664886+0000","last_active":"2024-03-20T13:38:26.664813+0000","last_peered":"2024-03-20T13:38:26.664813+0000","last_clean":"2024-03-20T13:38:26.664813+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:38:26.664813+0000","last_undegraded":"2024-03-20T13:38:26.664813+0000","last_fullsized":"2024-03-20T13:38:26.664813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.664636+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:08.014180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'243","reported_seq":356,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.127819+0000","last_change":"2024-03-20T13:36:44.878660+0000","last_active":"2024-03-20T13:38:19.127819+0000","last_peered":"2024-03-20T13:38:19.127819+0000","last_clean":"2024-03-20T13:38:19.127819+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:38:19.127819+0000","last_undegraded":"2024-03-20T13:38:19.127819+0000","last_fullsized":"2024-03-20T13:38:19.127819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.335405+0000","last_change":"2024-03-20T13:36:46.894365+0000","last_active":"2024-03-20T13:37:17.335405+0000","last_peered":"2024-03-20T13:37:17.335405+0000","last_clean":"2024-03-20T13:37:17.335405+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:37:17.335405+0000","last_undegraded":"2024-03-20T13:37:17.335405+0000","last_fullsized":"2024-03-20T13:37:17.335405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'7","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370796+0000","last_change":"2024-03-20T13:36:38.827417+0000","last_active":"2024-03-20T13:38:05.370796+0000","last_peered":"2024-03-20T13:38:05.370796+0000","last_clean":"2024-03-20T13:38:05.370796+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:05.370796+0000","last_undegraded":"2024-03-20T13:38:05.370796+0000","last_fullsized":"2024-03-20T13:38:05.370796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.530394+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:37:20.530394+0000","last_peered":"2024-03-20T13:37:20.530394+0000","last_clean":"2024-03-20T13:37:20.530394+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:37:20.530394+0000","last_undegraded":"2024-03-20T13:37:20.530394+0000","last_fullsized":"2024-03-20T13:37:20.530394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.362534+0000","last_change":"2024-03-20T13:36:40.850087+0000","last_active":"2024-03-20T13:37:17.362534+0000","last_peered":"2024-03-20T13:37:17.362534+0000","last_clean":"2024-03-20T13:37:17.362534+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:37:17.362534+0000","last_undegraded":"2024-03-20T13:37:17.362534+0000","last_fullsized":"2024-03-20T13:37:17.362534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.347905+0000","last_change":"2024-03-20T13:38:36.347995+0000","last_active":"2024-03-20T13:38:36.347905+0000","last_peered":"2024-03-20T13:38:36.347905+0000","last_clean":"2024-03-20T13:38:36.347905+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:36.347905+0000","last_undegraded":"2024-03-20T13:38:36.347905+0000","last_fullsized":"2024-03-20T13:38:36.347905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.347716+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:02.799858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356308+0000","last_change":"2024-03-20T13:36:44.871091+0000","last_active":"2024-03-20T13:37:17.356308+0000","last_peered":"2024-03-20T13:37:17.356308+0000","last_clean":"2024-03-20T13:37:17.356308+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:37:17.356308+0000","last_undegraded":"2024-03-20T13:37:17.356308+0000","last_fullsized":"2024-03-20T13:37:17.356308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.060964+0000","last_change":"2024-03-20T13:36:46.872197+0000","last_active":"2024-03-20T13:38:11.060964+0000","last_peered":"2024-03-20T13:38:11.060964+0000","last_clean":"2024-03-20T13:38:11.060964+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:38:11.060964+0000","last_undegraded":"2024-03-20T13:38:11.060964+0000","last_fullsized":"2024-03-20T13:38:11.060964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354633+0000","last_change":"2024-03-20T13:36:38.845564+0000","last_active":"2024-03-20T13:37:17.354633+0000","last_peered":"2024-03-20T13:37:17.354633+0000","last_clean":"2024-03-20T13:37:17.354633+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:37:17.354633+0000","last_undegraded":"2024-03-20T13:37:17.354633+0000","last_fullsized":"2024-03-20T13:37:17.354633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609093+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:38:22.609093+0000","last_peered":"2024-03-20T13:38:22.609093+0000","last_clean":"2024-03-20T13:38:22.609093+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:38:22.609093+0000","last_undegraded":"2024-03-20T13:38:22.609093+0000","last_fullsized":"2024-03-20T13:38:22.609093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158644+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:38:22.158644+0000","last_peered":"2024-03-20T13:38:22.158644+0000","last_clean":"2024-03-20T13:38:22.158644+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:38:22.158644+0000","last_undegraded":"2024-03-20T13:38:22.158644+0000","last_fullsized":"2024-03-20T13:38:22.158644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541872+0000","last_change":"2024-03-20T13:36:36.849187+0000","last_active":"2024-03-20T13:38:23.541872+0000","last_peered":"2024-03-20T13:38:23.541872+0000","last_clean":"2024-03-20T13:38:23.541872+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:38:23.541872+0000","last_undegraded":"2024-03-20T13:38:23.541872+0000","last_fullsized":"2024-03-20T13:38:23.541872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.568731+0000","last_change":"2024-03-20T13:38:39.568862+0000","last_active":"2024-03-20T13:38:39.568731+0000","last_peered":"2024-03-20T13:38:39.568731+0000","last_clean":"2024-03-20T13:38:39.568731+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:38:39.568731+0000","last_undegraded":"2024-03-20T13:38:39.568731+0000","last_fullsized":"2024-03-20T13:38:39.568731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.568507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:20.535216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'79","reported_seq":160,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.093470+0000","last_change":"2024-03-20T13:36:42.846779+0000","last_active":"2024-03-20T13:38:19.093470+0000","last_peered":"2024-03-20T13:38:19.093470+0000","last_clean":"2024-03-20T13:38:19.093470+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:19.093470+0000","last_undegraded":"2024-03-20T13:38:19.093470+0000","last_fullsized":"2024-03-20T13:38:19.093470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360574+0000","last_change":"2024-03-20T13:36:44.899269+0000","last_active":"2024-03-20T13:37:17.360574+0000","last_peered":"2024-03-20T13:37:17.360574+0000","last_clean":"2024-03-20T13:37:17.360574+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:37:17.360574+0000","last_undegraded":"2024-03-20T13:37:17.360574+0000","last_fullsized":"2024-03-20T13:37:17.360574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'51","reported_seq":115,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.063385+0000","last_change":"2024-03-20T13:36:46.893348+0000","last_active":"2024-03-20T13:38:11.063385+0000","last_peered":"2024-03-20T13:38:11.063385+0000","last_clean":"2024-03-20T13:38:11.063385+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:38:11.063385+0000","last_undegraded":"2024-03-20T13:38:11.063385+0000","last_fullsized":"2024-03-20T13:38:11.063385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.813159+0000","last_change":"2024-03-20T13:36:38.835115+0000","last_active":"2024-03-20T13:37:22.813159+0000","last_peered":"2024-03-20T13:37:22.813159+0000","last_clean":"2024-03-20T13:37:22.813159+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:37:22.813159+0000","last_undegraded":"2024-03-20T13:37:22.813159+0000","last_fullsized":"2024-03-20T13:37:22.813159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158556+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:38:22.158556+0000","last_peered":"2024-03-20T13:38:22.158556+0000","last_clean":"2024-03-20T13:38:22.158556+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:38:22.158556+0000","last_undegraded":"2024-03-20T13:38:22.158556+0000","last_fullsized":"2024-03-20T13:38:22.158556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609196+0000","last_change":"2024-03-20T13:36:36.833258+0000","last_active":"2024-03-20T13:38:22.609196+0000","last_peered":"2024-03-20T13:38:22.609196+0000","last_clean":"2024-03-20T13:38:22.609196+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:38:22.609196+0000","last_undegraded":"2024-03-20T13:38:22.609196+0000","last_fullsized":"2024-03-20T13:38:22.609196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.404930+0000","last_change":"2024-03-20T13:38:31.404985+0000","last_active":"2024-03-20T13:38:31.404930+0000","last_peered":"2024-03-20T13:38:31.404930+0000","last_clean":"2024-03-20T13:38:31.404930+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:38:31.404930+0000","last_undegraded":"2024-03-20T13:38:31.404930+0000","last_fullsized":"2024-03-20T13:38:31.404930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.404736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:36.082582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'256","reported_seq":447,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.594036+0000","last_change":"2024-03-20T13:38:27.594117+0000","last_active":"2024-03-20T13:38:27.594036+0000","last_peered":"2024-03-20T13:38:27.594036+0000","last_clean":"2024-03-20T13:38:27.594036+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:27.594036+0000","last_undegraded":"2024-03-20T13:38:27.594036+0000","last_fullsized":"2024-03-20T13:38:27.594036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'256","last_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_deep_scrub":"34'256","last_deep_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.593856+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:15.732896+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351484+0000","last_change":"2024-03-20T13:36:44.897832+0000","last_active":"2024-03-20T13:37:17.351484+0000","last_peered":"2024-03-20T13:37:17.351484+0000","last_clean":"2024-03-20T13:37:17.351484+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:37:17.351484+0000","last_undegraded":"2024-03-20T13:37:17.351484+0000","last_fullsized":"2024-03-20T13:37:17.351484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.108237+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:38:05.108237+0000","last_peered":"2024-03-20T13:38:05.108237+0000","last_clean":"2024-03-20T13:38:05.108237+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:38:05.108237+0000","last_undegraded":"2024-03-20T13:38:05.108237+0000","last_fullsized":"2024-03-20T13:38:05.108237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.370991+0000","last_change":"2024-03-20T13:36:38.832205+0000","last_active":"2024-03-20T13:38:05.370991+0000","last_peered":"2024-03-20T13:38:05.370991+0000","last_clean":"2024-03-20T13:38:05.370991+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:38:05.370991+0000","last_undegraded":"2024-03-20T13:38:05.370991+0000","last_fullsized":"2024-03-20T13:38:05.370991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.080947+0000","last_change":"2024-03-20T13:36:29.119176+0000","last_active":"2024-03-20T13:38:23.080947+0000","last_peered":"2024-03-20T13:38:23.080947+0000","last_clean":"2024-03-20T13:38:23.080947+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:38:23.080947+0000","last_undegraded":"2024-03-20T13:38:23.080947+0000","last_fullsized":"2024-03-20T13:38:23.080947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609155+0000","last_change":"2024-03-20T13:36:36.836293+0000","last_active":"2024-03-20T13:38:22.609155+0000","last_peered":"2024-03-20T13:38:22.609155+0000","last_clean":"2024-03-20T13:38:22.609155+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:38:22.609155+0000","last_undegraded":"2024-03-20T13:38:22.609155+0000","last_fullsized":"2024-03-20T13:38:22.609155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349178+0000","last_change":"2024-03-20T13:36:40.842771+0000","last_active":"2024-03-20T13:37:17.349178+0000","last_peered":"2024-03-20T13:37:17.349178+0000","last_clean":"2024-03-20T13:37:17.349178+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:37:17.349178+0000","last_undegraded":"2024-03-20T13:37:17.349178+0000","last_fullsized":"2024-03-20T13:37:17.349178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.434842+0000","last_change":"2024-03-20T13:38:29.434925+0000","last_active":"2024-03-20T13:38:29.434842+0000","last_peered":"2024-03-20T13:38:29.434842+0000","last_clean":"2024-03-20T13:38:29.434842+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:29.434842+0000","last_undegraded":"2024-03-20T13:38:29.434842+0000","last_fullsized":"2024-03-20T13:38:29.434842+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.434642+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.312836+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.577791+0000","last_change":"2024-03-20T13:38:26.577902+0000","last_active":"2024-03-20T13:38:26.577791+0000","last_peered":"2024-03-20T13:38:26.577791+0000","last_clean":"2024-03-20T13:38:26.577791+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:38:26.577791+0000","last_undegraded":"2024-03-20T13:38:26.577791+0000","last_fullsized":"2024-03-20T13:38:26.577791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.577544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:31.374045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347514+0000","last_change":"2024-03-20T13:36:46.874361+0000","last_active":"2024-03-20T13:37:17.347514+0000","last_peered":"2024-03-20T13:37:17.347514+0000","last_clean":"2024-03-20T13:37:17.347514+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:37:17.347514+0000","last_undegraded":"2024-03-20T13:37:17.347514+0000","last_fullsized":"2024-03-20T13:37:17.347514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.050047+0000","last_change":"2024-03-20T13:36:38.839568+0000","last_active":"2024-03-20T13:38:11.050047+0000","last_peered":"2024-03-20T13:38:11.050047+0000","last_clean":"2024-03-20T13:38:11.050047+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:11.050047+0000","last_undegraded":"2024-03-20T13:38:11.050047+0000","last_fullsized":"2024-03-20T13:38:11.050047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158551+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:38:22.158551+0000","last_peered":"2024-03-20T13:38:22.158551+0000","last_clean":"2024-03-20T13:38:22.158551+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:38:22.158551+0000","last_undegraded":"2024-03-20T13:38:22.158551+0000","last_fullsized":"2024-03-20T13:38:22.158551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350299+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:37:17.350299+0000","last_peered":"2024-03-20T13:37:17.350299+0000","last_clean":"2024-03-20T13:37:17.350299+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:37:17.350299+0000","last_undegraded":"2024-03-20T13:37:17.350299+0000","last_fullsized":"2024-03-20T13:37:17.350299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353414+0000","last_change":"2024-03-20T13:36:40.846094+0000","last_active":"2024-03-20T13:37:17.353414+0000","last_peered":"2024-03-20T13:37:17.353414+0000","last_clean":"2024-03-20T13:37:17.353414+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:37:17.353414+0000","last_undegraded":"2024-03-20T13:37:17.353414+0000","last_fullsized":"2024-03-20T13:37:17.353414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.665016+0000","last_change":"2024-03-20T13:38:31.665096+0000","last_active":"2024-03-20T13:38:31.665016+0000","last_peered":"2024-03-20T13:38:31.665016+0000","last_clean":"2024-03-20T13:38:31.665016+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:31.665016+0000","last_undegraded":"2024-03-20T13:38:31.665016+0000","last_fullsized":"2024-03-20T13:38:31.665016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.664843+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:03:43.219513+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361533+0000","last_change":"2024-03-20T13:36:44.900807+0000","last_active":"2024-03-20T13:37:17.361533+0000","last_peered":"2024-03-20T13:37:17.361533+0000","last_clean":"2024-03-20T13:37:17.361533+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:37:17.361533+0000","last_undegraded":"2024-03-20T13:37:17.361533+0000","last_fullsized":"2024-03-20T13:37:17.361533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341381+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:37:17.341381+0000","last_peered":"2024-03-20T13:37:17.341381+0000","last_clean":"2024-03-20T13:37:17.341381+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:37:17.341381+0000","last_undegraded":"2024-03-20T13:37:17.341381+0000","last_fullsized":"2024-03-20T13:37:17.341381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902539+0000","last_change":"2024-03-20T13:36:38.835114+0000","last_active":"2024-03-20T13:38:04.902539+0000","last_peered":"2024-03-20T13:38:04.902539+0000","last_clean":"2024-03-20T13:38:04.902539+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:38:04.902539+0000","last_undegraded":"2024-03-20T13:38:04.902539+0000","last_fullsized":"2024-03-20T13:38:04.902539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356227+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:37:17.356227+0000","last_peered":"2024-03-20T13:37:17.356227+0000","last_clean":"2024-03-20T13:37:17.356227+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:37:17.356227+0000","last_undegraded":"2024-03-20T13:37:17.356227+0000","last_fullsized":"2024-03-20T13:37:17.356227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609093+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:38:22.609093+0000","last_peered":"2024-03-20T13:38:22.609093+0000","last_clean":"2024-03-20T13:38:22.609093+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:38:22.609093+0000","last_undegraded":"2024-03-20T13:38:22.609093+0000","last_fullsized":"2024-03-20T13:38:22.609093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.595420+0000","last_change":"2024-03-20T13:38:39.595471+0000","last_active":"2024-03-20T13:38:39.595420+0000","last_peered":"2024-03-20T13:38:39.595420+0000","last_clean":"2024-03-20T13:38:39.595420+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:38:39.595420+0000","last_undegraded":"2024-03-20T13:38:39.595420+0000","last_fullsized":"2024-03-20T13:38:39.595420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.595226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:34.240122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'68","reported_seq":143,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.532529+0000","last_change":"2024-03-20T13:38:31.532606+0000","last_active":"2024-03-20T13:38:31.532529+0000","last_peered":"2024-03-20T13:38:31.532529+0000","last_clean":"2024-03-20T13:38:31.532529+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:31.532529+0000","last_undegraded":"2024-03-20T13:38:31.532529+0000","last_fullsized":"2024-03-20T13:38:31.532529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'68","last_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_deep_scrub":"34'68","last_deep_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.532334+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:30:24.833392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347337+0000","last_change":"2024-03-20T13:36:44.869776+0000","last_active":"2024-03-20T13:37:17.347337+0000","last_peered":"2024-03-20T13:37:17.347337+0000","last_clean":"2024-03-20T13:37:17.347337+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:37:17.347337+0000","last_undegraded":"2024-03-20T13:37:17.347337+0000","last_fullsized":"2024-03-20T13:37:17.347337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.559862+0000","last_change":"2024-03-20T13:38:30.559920+0000","last_active":"2024-03-20T13:38:30.559862+0000","last_peered":"2024-03-20T13:38:30.559862+0000","last_clean":"2024-03-20T13:38:30.559862+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:30.559862+0000","last_undegraded":"2024-03-20T13:38:30.559862+0000","last_fullsized":"2024-03-20T13:38:30.559862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.559669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:18:34.421204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.813551+0000","last_change":"2024-03-20T13:36:38.827949+0000","last_active":"2024-03-20T13:37:22.813551+0000","last_peered":"2024-03-20T13:37:22.813551+0000","last_clean":"2024-03-20T13:37:22.813551+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:37:22.813551+0000","last_undegraded":"2024-03-20T13:37:22.813551+0000","last_fullsized":"2024-03-20T13:37:22.813551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609226+0000","last_change":"2024-03-20T13:36:36.830990+0000","last_active":"2024-03-20T13:38:22.609226+0000","last_peered":"2024-03-20T13:38:22.609226+0000","last_clean":"2024-03-20T13:38:22.609226+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:38:22.609226+0000","last_undegraded":"2024-03-20T13:38:22.609226+0000","last_fullsized":"2024-03-20T13:38:22.609226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158672+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:38:22.158672+0000","last_peered":"2024-03-20T13:38:22.158672+0000","last_clean":"2024-03-20T13:38:22.158672+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:38:22.158672+0000","last_undegraded":"2024-03-20T13:38:22.158672+0000","last_fullsized":"2024-03-20T13:38:22.158672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.395973+0000","last_change":"2024-03-20T13:38:30.396031+0000","last_active":"2024-03-20T13:38:30.395973+0000","last_peered":"2024-03-20T13:38:30.395973+0000","last_clean":"2024-03-20T13:38:30.395973+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:38:30.395973+0000","last_undegraded":"2024-03-20T13:38:30.395973+0000","last_fullsized":"2024-03-20T13:38:30.395973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.395743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:19.841036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.620602+0000","last_change":"2024-03-20T13:38:25.620785+0000","last_active":"2024-03-20T13:38:25.620602+0000","last_peered":"2024-03-20T13:38:25.620602+0000","last_clean":"2024-03-20T13:38:25.620602+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:38:25.620602+0000","last_undegraded":"2024-03-20T13:38:25.620602+0000","last_fullsized":"2024-03-20T13:38:25.620602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.620381+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:16.685474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'243","reported_seq":330,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.526742+0000","last_change":"2024-03-20T13:38:30.526805+0000","last_active":"2024-03-20T13:38:30.526742+0000","last_peered":"2024-03-20T13:38:30.526742+0000","last_clean":"2024-03-20T13:38:30.526742+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:30.526742+0000","last_undegraded":"2024-03-20T13:38:30.526742+0000","last_fullsized":"2024-03-20T13:38:30.526742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.526556+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:46.021855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358781+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:37:17.358781+0000","last_peered":"2024-03-20T13:37:17.358781+0000","last_clean":"2024-03-20T13:37:17.358781+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:37:17.358781+0000","last_undegraded":"2024-03-20T13:37:17.358781+0000","last_fullsized":"2024-03-20T13:37:17.358781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542775+0000","last_change":"2024-03-20T13:36:38.813661+0000","last_active":"2024-03-20T13:38:23.542775+0000","last_peered":"2024-03-20T13:38:23.542775+0000","last_clean":"2024-03-20T13:38:23.542775+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:38:23.542775+0000","last_undegraded":"2024-03-20T13:38:23.542775+0000","last_fullsized":"2024-03-20T13:38:23.542775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.363033+0000","last_change":"2024-03-20T13:36:36.847617+0000","last_active":"2024-03-20T13:37:17.363033+0000","last_peered":"2024-03-20T13:37:17.363033+0000","last_clean":"2024-03-20T13:37:17.363033+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:37:17.363033+0000","last_undegraded":"2024-03-20T13:37:17.363033+0000","last_fullsized":"2024-03-20T13:37:17.363033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609099+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:38:22.609099+0000","last_peered":"2024-03-20T13:38:22.609099+0000","last_clean":"2024-03-20T13:38:22.609099+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:38:22.609099+0000","last_undegraded":"2024-03-20T13:38:22.609099+0000","last_fullsized":"2024-03-20T13:38:22.609099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.425580+0000","last_change":"2024-03-20T13:38:23.425602+0000","last_active":"2024-03-20T13:38:23.425580+0000","last_peered":"2024-03-20T13:38:23.425580+0000","last_clean":"2024-03-20T13:38:23.425580+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:38:23.425580+0000","last_undegraded":"2024-03-20T13:38:23.425580+0000","last_fullsized":"2024-03-20T13:38:23.425580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.425487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:03.433420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.054129+0000","last_change":"2024-03-20T13:36:42.855371+0000","last_active":"2024-03-20T13:38:11.054129+0000","last_peered":"2024-03-20T13:38:11.054129+0000","last_clean":"2024-03-20T13:38:11.054129+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:38:11.054129+0000","last_undegraded":"2024-03-20T13:38:11.054129+0000","last_fullsized":"2024-03-20T13:38:11.054129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'243","reported_seq":328,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.624449+0000","last_change":"2024-03-20T13:38:33.624509+0000","last_active":"2024-03-20T13:38:33.624449+0000","last_peered":"2024-03-20T13:38:33.624449+0000","last_clean":"2024-03-20T13:38:33.624449+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:33.624449+0000","last_undegraded":"2024-03-20T13:38:33.624449+0000","last_fullsized":"2024-03-20T13:38:33.624449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.624254+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:31:42.470838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.785926+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:37:21.785926+0000","last_peered":"2024-03-20T13:37:21.785926+0000","last_clean":"2024-03-20T13:37:21.785926+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:37:21.785926+0000","last_undegraded":"2024-03-20T13:37:21.785926+0000","last_fullsized":"2024-03-20T13:37:21.785926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.109710+0000","last_change":"2024-03-20T13:36:38.825848+0000","last_active":"2024-03-20T13:37:22.109710+0000","last_peered":"2024-03-20T13:37:22.109710+0000","last_clean":"2024-03-20T13:37:22.109710+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:37:22.109710+0000","last_undegraded":"2024-03-20T13:37:22.109710+0000","last_fullsized":"2024-03-20T13:37:22.109710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358827+0000","last_change":"2024-03-20T13:36:36.831337+0000","last_active":"2024-03-20T13:37:17.358827+0000","last_peered":"2024-03-20T13:37:17.358827+0000","last_clean":"2024-03-20T13:37:17.358827+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:37:17.358827+0000","last_undegraded":"2024-03-20T13:37:17.358827+0000","last_fullsized":"2024-03-20T13:37:17.358827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158673+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:38:22.158673+0000","last_peered":"2024-03-20T13:38:22.158673+0000","last_clean":"2024-03-20T13:38:22.158673+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:38:22.158673+0000","last_undegraded":"2024-03-20T13:38:22.158673+0000","last_fullsized":"2024-03-20T13:38:22.158673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.640338+0000","last_change":"2024-03-20T13:38:30.640338+0000","last_active":"2024-03-20T13:38:30.640338+0000","last_peered":"2024-03-20T13:38:30.640338+0000","last_clean":"2024-03-20T13:38:30.640338+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:38:30.640338+0000","last_undegraded":"2024-03-20T13:38:30.640338+0000","last_fullsized":"2024-03-20T13:38:30.640338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.640055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:20.085347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":183,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.393938+0000","last_change":"2024-03-20T13:38:33.394015+0000","last_active":"2024-03-20T13:38:33.393938+0000","last_peered":"2024-03-20T13:38:33.393938+0000","last_clean":"2024-03-20T13:38:33.393938+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:33.393938+0000","last_undegraded":"2024-03-20T13:38:33.393938+0000","last_fullsized":"2024-03-20T13:38:33.393938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.393752+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:13.108218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.607236+0000","last_change":"2024-03-20T13:38:35.607288+0000","last_active":"2024-03-20T13:38:35.607236+0000","last_peered":"2024-03-20T13:38:35.607236+0000","last_clean":"2024-03-20T13:38:35.607236+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:38:35.607236+0000","last_undegraded":"2024-03-20T13:38:35.607236+0000","last_fullsized":"2024-03-20T13:38:35.607236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.607032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:55:24.977582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.511700+0000","last_change":"2024-03-20T13:38:23.511758+0000","last_active":"2024-03-20T13:38:23.511700+0000","last_peered":"2024-03-20T13:38:23.511700+0000","last_clean":"2024-03-20T13:38:23.511700+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:38:23.511700+0000","last_undegraded":"2024-03-20T13:38:23.511700+0000","last_fullsized":"2024-03-20T13:38:23.511700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.511495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:10.006144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.608822+0000","last_change":"2024-03-20T13:38:38.608882+0000","last_active":"2024-03-20T13:38:38.608822+0000","last_peered":"2024-03-20T13:38:38.608822+0000","last_clean":"2024-03-20T13:38:38.608822+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:38:38.608822+0000","last_undegraded":"2024-03-20T13:38:38.608822+0000","last_fullsized":"2024-03-20T13:38:38.608822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.608632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:09.360540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.049235+0000","last_change":"2024-03-20T13:36:38.826974+0000","last_active":"2024-03-20T13:38:11.049235+0000","last_peered":"2024-03-20T13:38:11.049235+0000","last_clean":"2024-03-20T13:38:11.049235+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:11.049235+0000","last_undegraded":"2024-03-20T13:38:11.049235+0000","last_fullsized":"2024-03-20T13:38:11.049235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353079+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:37:17.353079+0000","last_peered":"2024-03-20T13:37:17.353079+0000","last_clean":"2024-03-20T13:37:17.353079+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:37:17.353079+0000","last_undegraded":"2024-03-20T13:37:17.353079+0000","last_fullsized":"2024-03-20T13:37:17.353079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347076+0000","last_change":"2024-03-20T13:36:40.845473+0000","last_active":"2024-03-20T13:37:17.347076+0000","last_peered":"2024-03-20T13:37:17.347076+0000","last_clean":"2024-03-20T13:37:17.347076+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:37:17.347076+0000","last_undegraded":"2024-03-20T13:37:17.347076+0000","last_fullsized":"2024-03-20T13:37:17.347076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.893159+0000","last_change":"2024-03-20T13:36:42.865392+0000","last_active":"2024-03-20T13:38:18.893159+0000","last_peered":"2024-03-20T13:38:18.893159+0000","last_clean":"2024-03-20T13:38:18.893159+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:18.893159+0000","last_undegraded":"2024-03-20T13:38:18.893159+0000","last_fullsized":"2024-03-20T13:38:18.893159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.610716+0000","last_change":"2024-03-20T13:38:36.610771+0000","last_active":"2024-03-20T13:38:36.610716+0000","last_peered":"2024-03-20T13:38:36.610716+0000","last_clean":"2024-03-20T13:38:36.610716+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:38:36.610716+0000","last_undegraded":"2024-03-20T13:38:36.610716+0000","last_fullsized":"2024-03-20T13:38:36.610716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.610516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:03.062657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361198+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:37:17.361198+0000","last_peered":"2024-03-20T13:37:17.361198+0000","last_clean":"2024-03-20T13:37:17.361198+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:37:17.361198+0000","last_undegraded":"2024-03-20T13:37:17.361198+0000","last_fullsized":"2024-03-20T13:37:17.361198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.110276+0000","last_change":"2024-03-20T13:36:38.835372+0000","last_active":"2024-03-20T13:37:22.110276+0000","last_peered":"2024-03-20T13:37:22.110276+0000","last_clean":"2024-03-20T13:37:22.110276+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:37:22.110276+0000","last_undegraded":"2024-03-20T13:37:22.110276+0000","last_fullsized":"2024-03-20T13:37:22.110276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340513+0000","last_change":"2024-03-20T13:36:36.812213+0000","last_active":"2024-03-20T13:37:17.340513+0000","last_peered":"2024-03-20T13:37:17.340513+0000","last_clean":"2024-03-20T13:37:17.340513+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:37:17.340513+0000","last_undegraded":"2024-03-20T13:37:17.340513+0000","last_fullsized":"2024-03-20T13:37:17.340513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348814+0000","last_change":"2024-03-20T13:36:40.849295+0000","last_active":"2024-03-20T13:37:17.348814+0000","last_peered":"2024-03-20T13:37:17.348814+0000","last_clean":"2024-03-20T13:37:17.348814+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:37:17.348814+0000","last_undegraded":"2024-03-20T13:37:17.348814+0000","last_fullsized":"2024-03-20T13:37:17.348814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.579986+0000","last_change":"2024-03-20T13:38:29.580058+0000","last_active":"2024-03-20T13:38:29.579986+0000","last_peered":"2024-03-20T13:38:29.579986+0000","last_clean":"2024-03-20T13:38:29.579986+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:38:29.579986+0000","last_undegraded":"2024-03-20T13:38:29.579986+0000","last_fullsized":"2024-03-20T13:38:29.579986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.579791+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:56.167406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.591444+0000","last_change":"2024-03-20T13:38:29.591499+0000","last_active":"2024-03-20T13:38:29.591444+0000","last_peered":"2024-03-20T13:38:29.591444+0000","last_clean":"2024-03-20T13:38:29.591444+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:38:29.591444+0000","last_undegraded":"2024-03-20T13:38:29.591444+0000","last_fullsized":"2024-03-20T13:38:29.591444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.591251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:46.103619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.368001+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:05.368001+0000","last_peered":"2024-03-20T13:38:05.368001+0000","last_clean":"2024-03-20T13:38:05.368001+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:05.368001+0000","last_undegraded":"2024-03-20T13:38:05.368001+0000","last_fullsized":"2024-03-20T13:38:05.368001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347664+0000","last_change":"2024-03-20T13:36:38.830562+0000","last_active":"2024-03-20T13:37:17.347664+0000","last_peered":"2024-03-20T13:37:17.347664+0000","last_clean":"2024-03-20T13:37:17.347664+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:37:17.347664+0000","last_undegraded":"2024-03-20T13:37:17.347664+0000","last_fullsized":"2024-03-20T13:37:17.347664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354229+0000","last_change":"2024-03-20T13:36:36.836705+0000","last_active":"2024-03-20T13:37:17.354229+0000","last_peered":"2024-03-20T13:37:17.354229+0000","last_clean":"2024-03-20T13:37:17.354229+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:37:17.354229+0000","last_undegraded":"2024-03-20T13:37:17.354229+0000","last_fullsized":"2024-03-20T13:37:17.354229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.440900+0000","last_change":"2024-03-20T13:38:26.440960+0000","last_active":"2024-03-20T13:38:26.440900+0000","last_peered":"2024-03-20T13:38:26.440900+0000","last_clean":"2024-03-20T13:38:26.440900+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:38:26.440900+0000","last_undegraded":"2024-03-20T13:38:26.440900+0000","last_fullsized":"2024-03-20T13:38:26.440900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.440701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:34.910452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'42","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.605084+0000","last_change":"2024-03-20T13:38:40.605165+0000","last_active":"2024-03-20T13:38:40.605084+0000","last_peered":"2024-03-20T13:38:40.605084+0000","last_clean":"2024-03-20T13:38:40.605084+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:40.605084+0000","last_undegraded":"2024-03-20T13:38:40.605084+0000","last_fullsized":"2024-03-20T13:38:40.605084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'42","last_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_deep_scrub":"34'42","last_deep_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.604871+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:50:04.270564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345477+0000","last_change":"2024-03-20T13:36:44.888584+0000","last_active":"2024-03-20T13:37:17.345477+0000","last_peered":"2024-03-20T13:37:17.345477+0000","last_clean":"2024-03-20T13:37:17.345477+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:37:17.345477+0000","last_undegraded":"2024-03-20T13:37:17.345477+0000","last_fullsized":"2024-03-20T13:37:17.345477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356216+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:37:17.356216+0000","last_peered":"2024-03-20T13:37:17.356216+0000","last_clean":"2024-03-20T13:37:17.356216+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:37:17.356216+0000","last_undegraded":"2024-03-20T13:37:17.356216+0000","last_fullsized":"2024-03-20T13:37:17.356216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.371082+0000","last_change":"2024-03-20T13:36:38.834173+0000","last_active":"2024-03-20T13:38:05.371082+0000","last_peered":"2024-03-20T13:38:05.371082+0000","last_clean":"2024-03-20T13:38:05.371082+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:05.371082+0000","last_undegraded":"2024-03-20T13:38:05.371082+0000","last_fullsized":"2024-03-20T13:38:05.371082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353901+0000","last_change":"2024-03-20T13:36:36.829532+0000","last_active":"2024-03-20T13:37:17.353901+0000","last_peered":"2024-03-20T13:37:17.353901+0000","last_clean":"2024-03-20T13:37:17.353901+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:37:17.353901+0000","last_undegraded":"2024-03-20T13:37:17.353901+0000","last_fullsized":"2024-03-20T13:37:17.353901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.618027+0000","last_change":"2024-03-20T13:38:29.618082+0000","last_active":"2024-03-20T13:38:29.618027+0000","last_peered":"2024-03-20T13:38:29.618027+0000","last_clean":"2024-03-20T13:38:29.618027+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:38:29.618027+0000","last_undegraded":"2024-03-20T13:38:29.618027+0000","last_fullsized":"2024-03-20T13:38:29.618027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.617842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.496036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.027197+0000","last_change":"2024-03-20T13:36:42.860451+0000","last_active":"2024-03-20T13:38:19.027197+0000","last_peered":"2024-03-20T13:38:19.027197+0000","last_clean":"2024-03-20T13:38:19.027197+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:19.027197+0000","last_undegraded":"2024-03-20T13:38:19.027197+0000","last_fullsized":"2024-03-20T13:38:19.027197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.530106+0000","last_change":"2024-03-20T13:38:32.530157+0000","last_active":"2024-03-20T13:38:32.530106+0000","last_peered":"2024-03-20T13:38:32.530106+0000","last_clean":"2024-03-20T13:38:32.530106+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:38:32.530106+0000","last_undegraded":"2024-03-20T13:38:32.530106+0000","last_fullsized":"2024-03-20T13:38:32.530106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.529912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:23:06.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.114038+0000","last_change":"2024-03-20T13:36:38.832438+0000","last_active":"2024-03-20T13:37:22.114038+0000","last_peered":"2024-03-20T13:37:22.114038+0000","last_clean":"2024-03-20T13:37:22.114038+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:37:22.114038+0000","last_undegraded":"2024-03-20T13:37:22.114038+0000","last_fullsized":"2024-03-20T13:37:22.114038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.339548+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:37:17.339548+0000","last_peered":"2024-03-20T13:37:17.339548+0000","last_clean":"2024-03-20T13:37:17.339548+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:37:17.339548+0000","last_undegraded":"2024-03-20T13:37:17.339548+0000","last_fullsized":"2024-03-20T13:37:17.339548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.624003+0000","last_change":"2024-03-20T13:38:23.624003+0000","last_active":"2024-03-20T13:38:23.624003+0000","last_peered":"2024-03-20T13:38:23.624003+0000","last_clean":"2024-03-20T13:38:23.624003+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:38:23.624003+0000","last_undegraded":"2024-03-20T13:38:23.624003+0000","last_fullsized":"2024-03-20T13:38:23.624003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.623665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:46.378711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'59","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.583891+0000","last_change":"2024-03-20T13:38:28.584099+0000","last_active":"2024-03-20T13:38:28.583891+0000","last_peered":"2024-03-20T13:38:28.583891+0000","last_clean":"2024-03-20T13:38:28.583891+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:28.583891+0000","last_undegraded":"2024-03-20T13:38:28.583891+0000","last_fullsized":"2024-03-20T13:38:28.583891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.583677+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:50:25.438865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.554852+0000","last_change":"2024-03-20T13:38:28.554904+0000","last_active":"2024-03-20T13:38:28.554852+0000","last_peered":"2024-03-20T13:38:28.554852+0000","last_clean":"2024-03-20T13:38:28.554852+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:38:28.554852+0000","last_undegraded":"2024-03-20T13:38:28.554852+0000","last_fullsized":"2024-03-20T13:38:28.554852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.554662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:18.277488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.379354+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:05.379354+0000","last_peered":"2024-03-20T13:38:05.379354+0000","last_clean":"2024-03-20T13:38:05.379354+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:05.379354+0000","last_undegraded":"2024-03-20T13:38:05.379354+0000","last_fullsized":"2024-03-20T13:38:05.379354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.610014+0000","last_change":"2024-03-20T13:36:38.834011+0000","last_active":"2024-03-20T13:38:22.610014+0000","last_peered":"2024-03-20T13:38:22.610014+0000","last_clean":"2024-03-20T13:38:22.610014+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:38:22.610014+0000","last_undegraded":"2024-03-20T13:38:22.610014+0000","last_fullsized":"2024-03-20T13:38:22.610014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342912+0000","last_change":"2024-03-20T13:36:36.833334+0000","last_active":"2024-03-20T13:37:17.342912+0000","last_peered":"2024-03-20T13:37:17.342912+0000","last_clean":"2024-03-20T13:37:17.342912+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:37:17.342912+0000","last_undegraded":"2024-03-20T13:37:17.342912+0000","last_fullsized":"2024-03-20T13:37:17.342912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.382512+0000","last_change":"2024-03-20T13:38:32.382567+0000","last_active":"2024-03-20T13:38:32.382512+0000","last_peered":"2024-03-20T13:38:32.382512+0000","last_clean":"2024-03-20T13:38:32.382512+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:38:32.382512+0000","last_undegraded":"2024-03-20T13:38:32.382512+0000","last_fullsized":"2024-03-20T13:38:32.382512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.382310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:43.990067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'43","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.283060+0000","last_change":"2024-03-20T13:38:40.283141+0000","last_active":"2024-03-20T13:38:40.283060+0000","last_peered":"2024-03-20T13:38:40.283060+0000","last_clean":"2024-03-20T13:38:40.283060+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:40.283060+0000","last_undegraded":"2024-03-20T13:38:40.283060+0000","last_fullsized":"2024-03-20T13:38:40.283060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.282858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:43:36.602180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.518451+0000","last_change":"2024-03-20T13:38:34.518505+0000","last_active":"2024-03-20T13:38:34.518451+0000","last_peered":"2024-03-20T13:38:34.518451+0000","last_clean":"2024-03-20T13:38:34.518451+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:38:34.518451+0000","last_undegraded":"2024-03-20T13:38:34.518451+0000","last_fullsized":"2024-03-20T13:38:34.518451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:09.209953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.347002+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:37:21.347002+0000","last_peered":"2024-03-20T13:37:21.347002+0000","last_clean":"2024-03-20T13:37:21.347002+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:37:21.347002+0000","last_undegraded":"2024-03-20T13:37:21.347002+0000","last_fullsized":"2024-03-20T13:37:21.347002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.358483+0000","last_change":"2024-03-20T13:36:38.839355+0000","last_active":"2024-03-20T13:37:17.358483+0000","last_peered":"2024-03-20T13:37:17.358483+0000","last_clean":"2024-03-20T13:37:17.358483+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:37:17.358483+0000","last_undegraded":"2024-03-20T13:37:17.358483+0000","last_fullsized":"2024-03-20T13:37:17.358483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349379+0000","last_change":"2024-03-20T13:36:36.835178+0000","last_active":"2024-03-20T13:37:17.349379+0000","last_peered":"2024-03-20T13:37:17.349379+0000","last_clean":"2024-03-20T13:37:17.349379+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:37:17.349379+0000","last_undegraded":"2024-03-20T13:37:17.349379+0000","last_fullsized":"2024-03-20T13:37:17.349379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.419751+0000","last_change":"2024-03-20T13:38:22.419777+0000","last_active":"2024-03-20T13:38:22.419751+0000","last_peered":"2024-03-20T13:38:22.419751+0000","last_clean":"2024-03-20T13:38:22.419751+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:38:22.419751+0000","last_undegraded":"2024-03-20T13:38:22.419751+0000","last_fullsized":"2024-03-20T13:38:22.419751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_clean_scrub_stamp":"2024-03-20T13:38:22.419651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:45.953043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.917034+0000","last_change":"2024-03-20T13:36:42.853208+0000","last_active":"2024-03-20T13:38:18.917034+0000","last_peered":"2024-03-20T13:38:18.917034+0000","last_clean":"2024-03-20T13:38:18.917034+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:18.917034+0000","last_undegraded":"2024-03-20T13:38:18.917034+0000","last_fullsized":"2024-03-20T13:38:18.917034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.540327+0000","last_change":"2024-03-20T13:38:38.540382+0000","last_active":"2024-03-20T13:38:38.540327+0000","last_peered":"2024-03-20T13:38:38.540327+0000","last_clean":"2024-03-20T13:38:38.540327+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:38:38.540327+0000","last_undegraded":"2024-03-20T13:38:38.540327+0000","last_fullsized":"2024-03-20T13:38:38.540327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.540096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:29:14.710303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346957+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:37:17.346957+0000","last_peered":"2024-03-20T13:37:17.346957+0000","last_clean":"2024-03-20T13:37:17.346957+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:37:17.346957+0000","last_undegraded":"2024-03-20T13:37:17.346957+0000","last_fullsized":"2024-03-20T13:37:17.346957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340315+0000","last_change":"2024-03-20T13:36:38.841841+0000","last_active":"2024-03-20T13:37:17.340315+0000","last_peered":"2024-03-20T13:37:17.340315+0000","last_clean":"2024-03-20T13:37:17.340315+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:37:17.340315+0000","last_undegraded":"2024-03-20T13:37:17.340315+0000","last_fullsized":"2024-03-20T13:37:17.340315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.529925+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:37:20.529925+0000","last_peered":"2024-03-20T13:37:20.529925+0000","last_clean":"2024-03-20T13:37:20.529925+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:37:20.529925+0000","last_undegraded":"2024-03-20T13:37:20.529925+0000","last_fullsized":"2024-03-20T13:37:20.529925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352014+0000","last_change":"2024-03-20T13:36:40.847481+0000","last_active":"2024-03-20T13:37:17.352014+0000","last_peered":"2024-03-20T13:37:17.352014+0000","last_clean":"2024-03-20T13:37:17.352014+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:37:17.352014+0000","last_undegraded":"2024-03-20T13:37:17.352014+0000","last_fullsized":"2024-03-20T13:37:17.352014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.687689+0000","last_change":"2024-03-20T13:38:25.687890+0000","last_active":"2024-03-20T13:38:25.687689+0000","last_peered":"2024-03-20T13:38:25.687689+0000","last_clean":"2024-03-20T13:38:25.687689+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:38:25.687689+0000","last_undegraded":"2024-03-20T13:38:25.687689+0000","last_fullsized":"2024-03-20T13:38:25.687689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.687477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.537657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'243","reported_seq":308,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.118889+0000","last_change":"2024-03-20T13:36:44.870739+0000","last_active":"2024-03-20T13:38:19.118889+0000","last_peered":"2024-03-20T13:38:19.118889+0000","last_clean":"2024-03-20T13:38:19.118889+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:19.118889+0000","last_undegraded":"2024-03-20T13:38:19.118889+0000","last_fullsized":"2024-03-20T13:38:19.118889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346793+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:37:17.346793+0000","last_peered":"2024-03-20T13:37:17.346793+0000","last_clean":"2024-03-20T13:37:17.346793+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:37:17.346793+0000","last_undegraded":"2024-03-20T13:37:17.346793+0000","last_fullsized":"2024-03-20T13:37:17.346793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.782640+0000","last_change":"2024-03-20T13:36:38.838732+0000","last_active":"2024-03-20T13:37:21.782640+0000","last_peered":"2024-03-20T13:37:21.782640+0000","last_clean":"2024-03-20T13:37:21.782640+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:37:21.782640+0000","last_undegraded":"2024-03-20T13:37:21.782640+0000","last_fullsized":"2024-03-20T13:37:21.782640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352540+0000","last_change":"2024-03-20T13:36:36.847653+0000","last_active":"2024-03-20T13:37:17.352540+0000","last_peered":"2024-03-20T13:37:17.352540+0000","last_clean":"2024-03-20T13:37:17.352540+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:37:17.352540+0000","last_undegraded":"2024-03-20T13:37:17.352540+0000","last_fullsized":"2024-03-20T13:37:17.352540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.525409+0000","last_change":"2024-03-20T13:38:36.525470+0000","last_active":"2024-03-20T13:38:36.525409+0000","last_peered":"2024-03-20T13:38:36.525409+0000","last_clean":"2024-03-20T13:38:36.525409+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:36.525409+0000","last_undegraded":"2024-03-20T13:38:36.525409+0000","last_fullsized":"2024-03-20T13:38:36.525409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.525211+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:48:52.542790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'43","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.359239+0000","last_change":"2024-03-20T13:38:35.359327+0000","last_active":"2024-03-20T13:38:35.359239+0000","last_peered":"2024-03-20T13:38:35.359239+0000","last_clean":"2024-03-20T13:38:35.359239+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:35.359239+0000","last_undegraded":"2024-03-20T13:38:35.359239+0000","last_fullsized":"2024-03-20T13:38:35.359239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.359044+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:38.277772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.612931+0000","last_change":"2024-03-20T13:38:37.612986+0000","last_active":"2024-03-20T13:38:37.612931+0000","last_peered":"2024-03-20T13:38:37.612931+0000","last_clean":"2024-03-20T13:38:37.612931+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:38:37.612931+0000","last_undegraded":"2024-03-20T13:38:37.612931+0000","last_fullsized":"2024-03-20T13:38:37.612931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.612746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:43.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355954+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:37:17.355954+0000","last_peered":"2024-03-20T13:37:17.355954+0000","last_clean":"2024-03-20T13:37:17.355954+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:37:17.355954+0000","last_undegraded":"2024-03-20T13:37:17.355954+0000","last_fullsized":"2024-03-20T13:37:17.355954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350764+0000","last_change":"2024-03-20T13:36:38.827830+0000","last_active":"2024-03-20T13:37:17.350764+0000","last_peered":"2024-03-20T13:37:17.350764+0000","last_clean":"2024-03-20T13:37:17.350764+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:37:17.350764+0000","last_undegraded":"2024-03-20T13:37:17.350764+0000","last_fullsized":"2024-03-20T13:37:17.350764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353613+0000","last_change":"2024-03-20T13:36:36.837596+0000","last_active":"2024-03-20T13:37:17.353613+0000","last_peered":"2024-03-20T13:37:17.353613+0000","last_clean":"2024-03-20T13:37:17.353613+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:37:17.353613+0000","last_undegraded":"2024-03-20T13:37:17.353613+0000","last_fullsized":"2024-03-20T13:37:17.353613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":210,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.392480+0000","last_change":"2024-03-20T13:38:28.392546+0000","last_active":"2024-03-20T13:38:28.392480+0000","last_peered":"2024-03-20T13:38:28.392480+0000","last_clean":"2024-03-20T13:38:28.392480+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:28.392480+0000","last_undegraded":"2024-03-20T13:38:28.392480+0000","last_fullsized":"2024-03-20T13:38:28.392480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.392293+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.200294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.510621+0000","last_change":"2024-03-20T13:38:33.510699+0000","last_active":"2024-03-20T13:38:33.510621+0000","last_peered":"2024-03-20T13:38:33.510621+0000","last_clean":"2024-03-20T13:38:33.510621+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:33.510621+0000","last_undegraded":"2024-03-20T13:38:33.510621+0000","last_fullsized":"2024-03-20T13:38:33.510621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.510425+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:36.604731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.298207+0000","last_change":"2024-03-20T13:38:37.298312+0000","last_active":"2024-03-20T13:38:37.298207+0000","last_peered":"2024-03-20T13:38:37.298207+0000","last_clean":"2024-03-20T13:38:37.298207+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:38:37.298207+0000","last_undegraded":"2024-03-20T13:38:37.298207+0000","last_fullsized":"2024-03-20T13:38:37.298207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.297989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:19.272096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.045775+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:11.045775+0000","last_peered":"2024-03-20T13:38:11.045775+0000","last_clean":"2024-03-20T13:38:11.045775+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:11.045775+0000","last_undegraded":"2024-03-20T13:38:11.045775+0000","last_fullsized":"2024-03-20T13:38:11.045775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902479+0000","last_change":"2024-03-20T13:36:38.826048+0000","last_active":"2024-03-20T13:38:04.902479+0000","last_peered":"2024-03-20T13:38:04.902479+0000","last_clean":"2024-03-20T13:38:04.902479+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:38:04.902479+0000","last_undegraded":"2024-03-20T13:38:04.902479+0000","last_fullsized":"2024-03-20T13:38:04.902479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542063+0000","last_change":"2024-03-20T13:36:36.848516+0000","last_active":"2024-03-20T13:38:23.542063+0000","last_peered":"2024-03-20T13:38:23.542063+0000","last_clean":"2024-03-20T13:38:23.542063+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:38:23.542063+0000","last_undegraded":"2024-03-20T13:38:23.542063+0000","last_fullsized":"2024-03-20T13:38:23.542063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.568443+0000","last_change":"2024-03-20T13:38:37.568554+0000","last_active":"2024-03-20T13:38:37.568443+0000","last_peered":"2024-03-20T13:38:37.568443+0000","last_clean":"2024-03-20T13:38:37.568443+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:38:37.568443+0000","last_undegraded":"2024-03-20T13:38:37.568443+0000","last_fullsized":"2024-03-20T13:38:37.568443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.568192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:02:40.953434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.672588+0000","last_change":"2024-03-20T13:38:23.672659+0000","last_active":"2024-03-20T13:38:23.672588+0000","last_peered":"2024-03-20T13:38:23.672588+0000","last_clean":"2024-03-20T13:38:23.672588+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:23.672588+0000","last_undegraded":"2024-03-20T13:38:23.672588+0000","last_fullsized":"2024-03-20T13:38:23.672588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.672372+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:19.543310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348536+0000","last_change":"2024-03-20T13:36:44.871360+0000","last_active":"2024-03-20T13:37:17.348536+0000","last_peered":"2024-03-20T13:37:17.348536+0000","last_clean":"2024-03-20T13:37:17.348536+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:37:17.348536+0000","last_undegraded":"2024-03-20T13:37:17.348536+0000","last_fullsized":"2024-03-20T13:37:17.348536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.105904+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:37:22.105904+0000","last_peered":"2024-03-20T13:37:22.105904+0000","last_clean":"2024-03-20T13:37:22.105904+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:37:22.105904+0000","last_undegraded":"2024-03-20T13:37:22.105904+0000","last_fullsized":"2024-03-20T13:37:22.105904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.114361+0000","last_change":"2024-03-20T13:36:38.844162+0000","last_active":"2024-03-20T13:37:22.114361+0000","last_peered":"2024-03-20T13:37:22.114361+0000","last_clean":"2024-03-20T13:37:22.114361+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:37:22.114361+0000","last_undegraded":"2024-03-20T13:37:22.114361+0000","last_fullsized":"2024-03-20T13:37:22.114361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609343+0000","last_change":"2024-03-20T13:36:36.832558+0000","last_active":"2024-03-20T13:38:22.609343+0000","last_peered":"2024-03-20T13:38:22.609343+0000","last_clean":"2024-03-20T13:38:22.609343+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:38:22.609343+0000","last_undegraded":"2024-03-20T13:38:22.609343+0000","last_fullsized":"2024-03-20T13:38:22.609343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.505299+0000","last_change":"2024-03-20T13:38:35.505456+0000","last_active":"2024-03-20T13:38:35.505299+0000","last_peered":"2024-03-20T13:38:35.505299+0000","last_clean":"2024-03-20T13:38:35.505299+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:38:35.505299+0000","last_undegraded":"2024-03-20T13:38:35.505299+0000","last_fullsized":"2024-03-20T13:38:35.505299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.505077+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:06.593833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:18.925865+0000","last_change":"2024-03-20T13:36:42.860634+0000","last_active":"2024-03-20T13:38:18.925865+0000","last_peered":"2024-03-20T13:38:18.925865+0000","last_clean":"2024-03-20T13:38:18.925865+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:18.925865+0000","last_undegraded":"2024-03-20T13:38:18.925865+0000","last_fullsized":"2024-03-20T13:38:18.925865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.818064+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.818064+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.579371+0000","last_change":"2024-03-20T13:38:27.579425+0000","last_active":"2024-03-20T13:38:27.579371+0000","last_peered":"2024-03-20T13:38:27.579371+0000","last_clean":"2024-03-20T13:38:27.579371+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:38:27.579371+0000","last_undegraded":"2024-03-20T13:38:27.579371+0000","last_fullsized":"2024-03-20T13:38:27.579371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.579191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:01.136809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354663+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:37:17.354663+0000","last_peered":"2024-03-20T13:37:17.354663+0000","last_clean":"2024-03-20T13:37:17.354663+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:37:17.354663+0000","last_undegraded":"2024-03-20T13:37:17.354663+0000","last_fullsized":"2024-03-20T13:37:17.354663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.371203+0000","last_change":"2024-03-20T13:36:38.834433+0000","last_active":"2024-03-20T13:38:05.371203+0000","last_peered":"2024-03-20T13:38:05.371203+0000","last_clean":"2024-03-20T13:38:05.371203+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:38:05.371203+0000","last_undegraded":"2024-03-20T13:38:05.371203+0000","last_fullsized":"2024-03-20T13:38:05.371203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.081026+0000","last_change":"2024-03-20T13:36:36.812837+0000","last_active":"2024-03-20T13:38:23.081026+0000","last_peered":"2024-03-20T13:38:23.081026+0000","last_clean":"2024-03-20T13:38:23.081026+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:38:23.081026+0000","last_undegraded":"2024-03-20T13:38:23.081026+0000","last_fullsized":"2024-03-20T13:38:23.081026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.344925+0000","last_change":"2024-03-20T13:36:38.839230+0000","last_active":"2024-03-20T13:37:21.344925+0000","last_peered":"2024-03-20T13:37:21.344925+0000","last_clean":"2024-03-20T13:37:21.344925+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:37:21.344925+0000","last_undegraded":"2024-03-20T13:37:21.344925+0000","last_fullsized":"2024-03-20T13:37:21.344925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.081048+0000","last_change":"2024-03-20T13:36:36.814746+0000","last_active":"2024-03-20T13:38:23.081048+0000","last_peered":"2024-03-20T13:38:23.081048+0000","last_clean":"2024-03-20T13:38:23.081048+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:38:23.081048+0000","last_undegraded":"2024-03-20T13:38:23.081048+0000","last_fullsized":"2024-03-20T13:38:23.081048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353493+0000","last_change":"2024-03-20T13:36:38.837487+0000","last_active":"2024-03-20T13:37:17.353493+0000","last_peered":"2024-03-20T13:37:17.353493+0000","last_clean":"2024-03-20T13:37:17.353493+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:37:17.353493+0000","last_undegraded":"2024-03-20T13:37:17.353493+0000","last_fullsized":"2024-03-20T13:37:17.353493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542220+0000","last_change":"2024-03-20T13:36:36.851159+0000","last_active":"2024-03-20T13:38:23.542220+0000","last_peered":"2024-03-20T13:38:23.542220+0000","last_clean":"2024-03-20T13:38:23.542220+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:38:23.542220+0000","last_undegraded":"2024-03-20T13:38:23.542220+0000","last_fullsized":"2024-03-20T13:38:23.542220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.352895+0000","last_change":"2024-03-20T13:36:38.839750+0000","last_active":"2024-03-20T13:37:17.352895+0000","last_peered":"2024-03-20T13:37:17.352895+0000","last_clean":"2024-03-20T13:37:17.352895+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:37:17.352895+0000","last_undegraded":"2024-03-20T13:37:17.352895+0000","last_fullsized":"2024-03-20T13:37:17.352895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.081057+0000","last_change":"2024-03-20T13:36:36.811977+0000","last_active":"2024-03-20T13:38:23.081057+0000","last_peered":"2024-03-20T13:38:23.081057+0000","last_clean":"2024-03-20T13:38:23.081057+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:23.081057+0000","last_undegraded":"2024-03-20T13:38:23.081057+0000","last_fullsized":"2024-03-20T13:38:23.081057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902584+0000","last_change":"2024-03-20T13:37:17.364712+0000","last_active":"2024-03-20T13:38:04.902584+0000","last_peered":"2024-03-20T13:38:04.902584+0000","last_clean":"2024-03-20T13:38:04.902584+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:38:04.902584+0000","last_undegraded":"2024-03-20T13:38:04.902584+0000","last_fullsized":"2024-03-20T13:38:04.902584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348847+0000","last_change":"2024-03-20T13:36:36.846100+0000","last_active":"2024-03-20T13:37:17.348847+0000","last_peered":"2024-03-20T13:37:17.348847+0000","last_clean":"2024-03-20T13:37:17.348847+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:37:17.348847+0000","last_undegraded":"2024-03-20T13:37:17.348847+0000","last_fullsized":"2024-03-20T13:37:17.348847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348678+0000","last_change":"2024-03-20T13:36:38.837474+0000","last_active":"2024-03-20T13:37:17.348678+0000","last_peered":"2024-03-20T13:37:17.348678+0000","last_clean":"2024-03-20T13:37:17.348678+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:37:17.348678+0000","last_undegraded":"2024-03-20T13:37:17.348678+0000","last_fullsized":"2024-03-20T13:37:17.348678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350701+0000","last_change":"2024-03-20T13:36:36.831139+0000","last_active":"2024-03-20T13:37:17.350701+0000","last_peered":"2024-03-20T13:37:17.350701+0000","last_clean":"2024-03-20T13:37:17.350701+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:37:17.350701+0000","last_undegraded":"2024-03-20T13:37:17.350701+0000","last_fullsized":"2024-03-20T13:37:17.350701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.050286+0000","last_change":"2024-03-20T13:36:38.836423+0000","last_active":"2024-03-20T13:38:11.050286+0000","last_peered":"2024-03-20T13:38:11.050286+0000","last_clean":"2024-03-20T13:38:11.050286+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:11.050286+0000","last_undegraded":"2024-03-20T13:38:11.050286+0000","last_fullsized":"2024-03-20T13:38:11.050286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.345782+0000","last_change":"2024-03-20T13:36:36.818776+0000","last_active":"2024-03-20T13:37:17.345782+0000","last_peered":"2024-03-20T13:37:17.345782+0000","last_clean":"2024-03-20T13:37:17.345782+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:37:17.345782+0000","last_undegraded":"2024-03-20T13:37:17.345782+0000","last_fullsized":"2024-03-20T13:37:17.345782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349961+0000","last_change":"2024-03-20T13:36:38.831672+0000","last_active":"2024-03-20T13:37:17.349961+0000","last_peered":"2024-03-20T13:37:17.349961+0000","last_clean":"2024-03-20T13:37:17.349961+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:37:17.349961+0000","last_undegraded":"2024-03-20T13:37:17.349961+0000","last_fullsized":"2024-03-20T13:37:17.349961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.360926+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:37:17.360926+0000","last_peered":"2024-03-20T13:37:17.360926+0000","last_clean":"2024-03-20T13:37:17.360926+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:37:17.360926+0000","last_undegraded":"2024-03-20T13:37:17.360926+0000","last_fullsized":"2024-03-20T13:37:17.360926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.048843+0000","last_change":"2024-03-20T13:36:38.839448+0000","last_active":"2024-03-20T13:38:11.048843+0000","last_peered":"2024-03-20T13:38:11.048843+0000","last_clean":"2024-03-20T13:38:11.048843+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:11.048843+0000","last_undegraded":"2024-03-20T13:38:11.048843+0000","last_fullsized":"2024-03-20T13:38:11.048843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.340051+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:37:17.340051+0000","last_peered":"2024-03-20T13:37:17.340051+0000","last_clean":"2024-03-20T13:37:17.340051+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:37:17.340051+0000","last_undegraded":"2024-03-20T13:37:17.340051+0000","last_fullsized":"2024-03-20T13:37:17.340051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.361929+0000","last_change":"2024-03-20T13:36:38.828492+0000","last_active":"2024-03-20T13:37:17.361929+0000","last_peered":"2024-03-20T13:37:17.361929+0000","last_clean":"2024-03-20T13:37:17.361929+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:37:17.361929+0000","last_undegraded":"2024-03-20T13:37:17.361929+0000","last_fullsized":"2024-03-20T13:37:17.361929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.341299+0000","last_change":"2024-03-20T13:36:36.848972+0000","last_active":"2024-03-20T13:37:17.341299+0000","last_peered":"2024-03-20T13:37:17.341299+0000","last_clean":"2024-03-20T13:37:17.341299+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:37:17.341299+0000","last_undegraded":"2024-03-20T13:37:17.341299+0000","last_fullsized":"2024-03-20T13:37:17.341299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.619446+0000","last_change":"2024-03-20T13:38:40.619511+0000","last_active":"2024-03-20T13:38:40.619446+0000","last_peered":"2024-03-20T13:38:40.619446+0000","last_clean":"2024-03-20T13:38:40.619446+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:40.619446+0000","last_undegraded":"2024-03-20T13:38:40.619446+0000","last_fullsized":"2024-03-20T13:38:40.619446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.619249+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:28.069678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.099512+0000","last_change":"2024-03-20T13:36:36.830049+0000","last_active":"2024-03-20T13:37:22.099512+0000","last_peered":"2024-03-20T13:37:22.099512+0000","last_clean":"2024-03-20T13:37:22.099512+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:37:22.099512+0000","last_undegraded":"2024-03-20T13:37:22.099512+0000","last_fullsized":"2024-03-20T13:37:22.099512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.317141+0000","last_change":"2024-03-20T13:37:17.369630+0000","last_active":"2024-03-20T13:37:21.317141+0000","last_peered":"2024-03-20T13:37:21.317141+0000","last_clean":"2024-03-20T13:37:21.317141+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:37:21.317141+0000","last_undegraded":"2024-03-20T13:37:21.317141+0000","last_fullsized":"2024-03-20T13:37:21.317141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.348199+0000","last_change":"2024-03-20T13:36:36.831557+0000","last_active":"2024-03-20T13:37:17.348199+0000","last_peered":"2024-03-20T13:37:17.348199+0000","last_clean":"2024-03-20T13:37:17.348199+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:37:17.348199+0000","last_undegraded":"2024-03-20T13:37:17.348199+0000","last_fullsized":"2024-03-20T13:37:17.348199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.903931+0000","last_change":"2024-03-20T13:36:38.829272+0000","last_active":"2024-03-20T13:38:04.903931+0000","last_peered":"2024-03-20T13:38:04.903931+0000","last_clean":"2024-03-20T13:38:04.903931+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:38:04.903931+0000","last_undegraded":"2024-03-20T13:38:04.903931+0000","last_fullsized":"2024-03-20T13:38:04.903931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349109+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:37:17.349109+0000","last_peered":"2024-03-20T13:37:17.349109+0000","last_clean":"2024-03-20T13:37:17.349109+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:37:17.349109+0000","last_undegraded":"2024-03-20T13:37:17.349109+0000","last_fullsized":"2024-03-20T13:37:17.349109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.783804+0000","last_change":"2024-03-20T13:37:17.354371+0000","last_active":"2024-03-20T13:37:21.783804+0000","last_peered":"2024-03-20T13:37:21.783804+0000","last_clean":"2024-03-20T13:37:21.783804+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:37:21.783804+0000","last_undegraded":"2024-03-20T13:37:21.783804+0000","last_fullsized":"2024-03-20T13:37:21.783804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.351898+0000","last_change":"2024-03-20T13:36:36.848902+0000","last_active":"2024-03-20T13:37:17.351898+0000","last_peered":"2024-03-20T13:37:17.351898+0000","last_clean":"2024-03-20T13:37:17.351898+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:37:17.351898+0000","last_undegraded":"2024-03-20T13:37:17.351898+0000","last_fullsized":"2024-03-20T13:37:17.351898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347400+0000","last_change":"2024-03-20T13:36:38.836588+0000","last_active":"2024-03-20T13:37:17.347400+0000","last_peered":"2024-03-20T13:37:17.347400+0000","last_clean":"2024-03-20T13:37:17.347400+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:37:17.347400+0000","last_undegraded":"2024-03-20T13:37:17.347400+0000","last_fullsized":"2024-03-20T13:37:17.347400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346392+0000","last_change":"2024-03-20T13:36:36.818507+0000","last_active":"2024-03-20T13:37:17.346392+0000","last_peered":"2024-03-20T13:37:17.346392+0000","last_clean":"2024-03-20T13:37:17.346392+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:37:17.346392+0000","last_undegraded":"2024-03-20T13:37:17.346392+0000","last_fullsized":"2024-03-20T13:37:17.346392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.114124+0000","last_change":"2024-03-20T13:36:38.828728+0000","last_active":"2024-03-20T13:37:22.114124+0000","last_peered":"2024-03-20T13:37:22.114124+0000","last_clean":"2024-03-20T13:37:22.114124+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:37:22.114124+0000","last_undegraded":"2024-03-20T13:37:22.114124+0000","last_fullsized":"2024-03-20T13:37:22.114124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.315286+0000","last_change":"2024-03-20T13:36:36.846419+0000","last_active":"2024-03-20T13:37:21.315286+0000","last_peered":"2024-03-20T13:37:21.315286+0000","last_clean":"2024-03-20T13:37:21.315286+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:37:21.315286+0000","last_undegraded":"2024-03-20T13:37:21.315286+0000","last_fullsized":"2024-03-20T13:37:21.315286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.347791+0000","last_change":"2024-03-20T13:36:36.834343+0000","last_active":"2024-03-20T13:37:17.347791+0000","last_peered":"2024-03-20T13:37:17.347791+0000","last_clean":"2024-03-20T13:37:17.347791+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:37:17.347791+0000","last_undegraded":"2024-03-20T13:37:17.347791+0000","last_fullsized":"2024-03-20T13:37:17.347791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.108832+0000","last_change":"2024-03-20T13:36:38.830650+0000","last_active":"2024-03-20T13:37:22.108832+0000","last_peered":"2024-03-20T13:37:22.108832+0000","last_clean":"2024-03-20T13:37:22.108832+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:37:22.108832+0000","last_undegraded":"2024-03-20T13:37:22.108832+0000","last_fullsized":"2024-03-20T13:37:22.108832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.343200+0000","last_change":"2024-03-20T13:36:36.833552+0000","last_active":"2024-03-20T13:37:17.343200+0000","last_peered":"2024-03-20T13:37:17.343200+0000","last_clean":"2024-03-20T13:37:17.343200+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:37:17.343200+0000","last_undegraded":"2024-03-20T13:37:17.343200+0000","last_fullsized":"2024-03-20T13:37:17.343200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.108061+0000","last_change":"2024-03-20T13:36:38.827748+0000","last_active":"2024-03-20T13:37:22.108061+0000","last_peered":"2024-03-20T13:37:22.108061+0000","last_clean":"2024-03-20T13:37:22.108061+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:37:22.108061+0000","last_undegraded":"2024-03-20T13:37:22.108061+0000","last_fullsized":"2024-03-20T13:37:22.108061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":600,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1391,"ondisk_log_size":1391,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672992,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38200000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67300000000000004}]},{"osd":1,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.77300000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.89200000000000002,"5min":1.04,"15min":1.04},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71999999999999997,"5min":1.216,"15min":1.216},"last":0.63300000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672993,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81100000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69299999999999995}]},{"osd":1,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.224,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.25600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.746,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.75,"5min":1.145,"15min":1.145},"last":0.498},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.315,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77500000000000002,"5min":1,"15min":1},"last":0.63100000000000001}]}]},{"osd":1,"up_from":10,"seq":42949672991,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.49099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79500000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63300000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.71299999999999997,"5min":1.411,"15min":1.411},"last":0.503}]},{"osd":3,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.38500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85099999999999998,"5min":1.117,"15min":1.117},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69699999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84499999999999997}]},{"osd":2,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91500000000000004,"5min":1.161,"15min":1.161},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90600000000000003,"5min":1.052,"15min":1.052},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:38:44.333 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.333 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.334 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.334 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.334 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.334 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.334 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.335 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.335 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.335 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.335 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.335 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.335 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.336 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.336 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.336 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.336 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.336 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.337 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.337 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.337 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.337 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.337 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.337 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.338 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.338 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.338 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.338 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.338 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.338 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.339 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.339 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.339 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.339 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.339 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.340 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.340 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.340 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.340 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.340 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.341 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.341 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.341 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.341 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.341 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.341 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.342 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.342 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.342 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.342 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.342 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.343 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.343 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.343 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.343 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.343 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.344 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.344 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.344 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.344 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.344 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.345 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.345 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.345 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.345 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.345 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.345 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.346 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.346 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.346 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.346 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.346 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.347 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.347 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.347 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-20T13:36:22.715062+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=22, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.347 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.347 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.347 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.348 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.348 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.348 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.348 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.348 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.349 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.349 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.349 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.349 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.349 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.349 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.350 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.350 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.350 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.350 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.350 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.351 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.351 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.351 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.351 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.351 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.351 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.352 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.352 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.352 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.352 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.352 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.352 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.353 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.353 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.353 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.353 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.353 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.354 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.354 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.354 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.354 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.354 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.355 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.356 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.356 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.356 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.356 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.356 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.357 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.357 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.357 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.357 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.357 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.358 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.358 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.358 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.358 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.358 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.358 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.359 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.359 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.359 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.359 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.359 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.359 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.360 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.360 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.360 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.360 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.360 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.361 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.361 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.361 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.361 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.361 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.361 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-20T13:36:41.818064+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=41, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.362 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.362 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.362 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.362 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.362 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.363 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.363 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.363 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.363 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.363 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.363 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.364 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.364 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.364 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.364 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.364 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.364 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.365 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.365 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.365 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.365 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.365 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.365 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.366 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.366 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.366 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.366 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.366 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.367 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.368 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:38:44.368 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:39:04.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:39:04.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.495+0000 7f6512096640 1 Processor -- start 2024-03-20T13:39:04.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.495+0000 7f6512096640 1 -- start start 2024-03-20T13:39:04.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.495+0000 7f6512096640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f650c12b000 0x7f650c12b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:04.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.495+0000 7f6512096640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c072390 con 0x7f650c06c3f0 2024-03-20T13:39:04.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.495+0000 7f6512096640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c09c1e0 con 0x7f650c12b000 2024-03-20T13:39:04.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f650c12b000 0x7f650c12b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:04.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f650c06c3f0 0x7f650c1210b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37628/0 (socket says 172.21.15.89:37628) 2024-03-20T13:39:04.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650affd640 1 -- 172.21.15.89:0/1593461641 learned_addr learned my addr 172.21.15.89:0/1593461641 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:39:04.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650b7fe640 1 -- 172.21.15.89:0/1593461641 >> v1:172.21.15.89:6789/0 conn(0x7f650c06c3f0 legacy=0x7f650c1210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:04.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650a7fc640 1 -- 172.21.15.89:0/1593461641 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116427440 0 0) 0x7f650c072390 con 0x7f650c06c3f0 2024-03-20T13:39:04.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650b7fe640 1 -- 172.21.15.89:0/1593461641 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c06d030 con 0x7f650c12b000 2024-03-20T13:39:04.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650b7fe640 1 --2- 172.21.15.89:0/1593461641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c12b000 0x7f650c12b3e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6504009740 tx=0x7f650401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b66513a2726834c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:04.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650a7fc640 1 -- 172.21.15.89:0/1593461641 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65040ab530 con 0x7f650c12b000 2024-03-20T13:39:04.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650a7fc640 1 -- 172.21.15.89:0/1593461641 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040a7050 con 0x7f650c12b000 2024-03-20T13:39:04.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f650a7fc640 1 -- 172.21.15.89:0/1593461641 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65040ab7e0 con 0x7f650c12b000 2024-03-20T13:39:04.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f6512096640 1 -- 172.21.15.89:0/1593461641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c12b000 msgr2=0x7f650c12b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:04.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.499+0000 7f6512096640 1 --2- 172.21.15.89:0/1593461641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c12b000 0x7f650c12b3e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6504009740 tx=0x7f650401c370 comp rx=0 tx=0).stop 2024-03-20T13:39:04.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1593461641 shutdown_connections 2024-03-20T13:39:04.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 --2- 172.21.15.89:0/1593461641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c12b000 0x7f650c12b3e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:04.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1593461641 >> 172.21.15.89:0/1593461641 conn(0x7f650c09a2f0 msgr2=0x7f650c09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:04.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1593461641 shutdown_connections 2024-03-20T13:39:04.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1593461641 wait complete. 2024-03-20T13:39:04.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 Processor -- start 2024-03-20T13:39:04.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- start start 2024-03-20T13:39:04.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 0x7f650c1222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:04.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c124290 con 0x7f650c06c3f0 2024-03-20T13:39:04.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f650b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 0x7f650c1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:04.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f650b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 0x7f650c1222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36016/0 (socket says 172.21.15.89:36016) 2024-03-20T13:39:04.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f650b7fe640 1 -- 172.21.15.89:0/1831338568 learned_addr learned my addr 172.21.15.89:0/1831338568 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f650b7fe640 1 -- 172.21.15.89:0/1831338568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009420 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f650b7fe640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 0x7f650c1222d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6504018f80 tx=0x7f650401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65040b7660 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040b77e0 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c12edd0 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65040b7ac0 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c071a00 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65040b7c20 con 0x7f650c06c3f0 2024-03-20T13:39:04.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6503fff640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64ec035a10 0x7f64ec037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:04.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c067e00 con 0x7f650c06c3f0 2024-03-20T13:39:04.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.503+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f65040e3300 con 0x7f650c06c3f0 2024-03-20T13:39:04.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.507+0000 7f650affd640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64ec035a10 0x7f64ec037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:04.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.507+0000 7f650affd640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64ec035a10 0x7f64ec037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f64f4007fd0 tx=0x7f64f4007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:04.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.511+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f65040bb020 con 0x7f650c06c3f0 2024-03-20T13:39:04.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.659+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f650c12ebf0 con 0x7f64ec035a10 2024-03-20T13:39:04.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.703+0000 7f6503fff640 1 -- 172.21.15.89:0/1831338568 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669815 (secure 0 0 0) 0x7f650c12ebf0 con 0x7f64ec035a10 2024-03-20T13:39:04.712 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:39:04.721 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:39:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64ec035a10 msgr2=0x7f64ec037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64ec035a10 0x7f64ec037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f64f4007fd0 tx=0x7f64f4007920 comp rx=0 tx=0).stop 2024-03-20T13:39:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 msgr2=0x7f650c1222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 0x7f650c1222d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6504018f80 tx=0x7f650401abb0 comp rx=0 tx=0).stop 2024-03-20T13:39:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 shutdown_connections 2024-03-20T13:39:04.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f64ec035a10 0x7f64ec037ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 --2- 172.21.15.89:0/1831338568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f650c06c3f0 0x7f650c1222d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 >> 172.21.15.89:0/1831338568 conn(0x7f650c09a2f0 msgr2=0x7f650c094180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 shutdown_connections 2024-03-20T13:39:04.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:04.715+0000 7f6512096640 1 -- 172.21.15.89:0/1831338568 wait complete. 2024-03-20T13:39:04.732 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-03-20T13:39:04.346416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3999,"num_read_kb":3645,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1669,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3954,"ondisk_log_size":3954,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006813"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159167+0000","last_change":"2024-03-20T13:36:36.834585+0000","last_active":"2024-03-20T13:38:22.159167+0000","last_peered":"2024-03-20T13:38:22.159167+0000","last_clean":"2024-03-20T13:38:22.159167+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:38:22.159167+0000","last_undegraded":"2024-03-20T13:38:22.159167+0000","last_fullsized":"2024-03-20T13:38:22.159167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.364141+0000","last_change":"2024-03-20T13:38:54.364209+0000","last_active":"2024-03-20T13:38:54.364141+0000","last_peered":"2024-03-20T13:38:54.364141+0000","last_clean":"2024-03-20T13:38:54.364141+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:38:54.364141+0000","last_undegraded":"2024-03-20T13:38:54.364141+0000","last_fullsized":"2024-03-20T13:38:54.364141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:54.363935+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:54.363935+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.363935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:52.089220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.643293+0000","last_change":"2024-03-20T13:38:57.643357+0000","last_active":"2024-03-20T13:38:57.643293+0000","last_peered":"2024-03-20T13:38:57.643293+0000","last_clean":"2024-03-20T13:38:57.643293+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:38:57.643293+0000","last_undegraded":"2024-03-20T13:38:57.643293+0000","last_fullsized":"2024-03-20T13:38:57.643293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:57.643105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:57.643105+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.643105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:47:16.939195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.049052+0000","last_change":"2024-03-20T13:36:38.817960+0000","last_active":"2024-03-20T13:38:11.049052+0000","last_peered":"2024-03-20T13:38:11.049052+0000","last_clean":"2024-03-20T13:38:11.049052+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:38:11.049052+0000","last_undegraded":"2024-03-20T13:38:11.049052+0000","last_fullsized":"2024-03-20T13:38:11.049052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542682+0000","last_change":"2024-03-20T13:36:36.848291+0000","last_active":"2024-03-20T13:38:23.542682+0000","last_peered":"2024-03-20T13:38:23.542682+0000","last_clean":"2024-03-20T13:38:23.542682+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:38:23.542682+0000","last_undegraded":"2024-03-20T13:38:23.542682+0000","last_fullsized":"2024-03-20T13:38:23.542682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902495+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:04.902495+0000","last_peered":"2024-03-20T13:38:04.902495+0000","last_clean":"2024-03-20T13:38:04.902495+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:04.902495+0000","last_undegraded":"2024-03-20T13:38:04.902495+0000","last_fullsized":"2024-03-20T13:38:04.902495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.643201+0000","last_change":"2024-03-20T13:39:00.643262+0000","last_active":"2024-03-20T13:39:00.643201+0000","last_peered":"2024-03-20T13:39:00.643201+0000","last_clean":"2024-03-20T13:39:00.643201+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:39:00.643201+0000","last_undegraded":"2024-03-20T13:39:00.643201+0000","last_fullsized":"2024-03-20T13:39:00.643201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.643010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.643010+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.643010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:32:09.489594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.346499+0000","last_change":"2024-03-20T13:36:38.821653+0000","last_active":"2024-03-20T13:37:21.346499+0000","last_peered":"2024-03-20T13:37:21.346499+0000","last_clean":"2024-03-20T13:37:21.346499+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:37:21.346499+0000","last_undegraded":"2024-03-20T13:37:21.346499+0000","last_fullsized":"2024-03-20T13:37:21.346499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.035487+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:11.035487+0000","last_peered":"2024-03-20T13:38:11.035487+0000","last_clean":"2024-03-20T13:38:11.035487+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:11.035487+0000","last_undegraded":"2024-03-20T13:38:11.035487+0000","last_fullsized":"2024-03-20T13:38:11.035487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.630024+0000","last_change":"2024-03-20T13:38:45.630090+0000","last_active":"2024-03-20T13:38:45.630024+0000","last_peered":"2024-03-20T13:38:45.630024+0000","last_clean":"2024-03-20T13:38:45.630024+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:45.630024+0000","last_undegraded":"2024-03-20T13:38:45.630024+0000","last_fullsized":"2024-03-20T13:38:45.630024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:45.629830+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:45.629830+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.629830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:36.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349963+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:37:17.349963+0000","last_peered":"2024-03-20T13:37:17.349963+0000","last_clean":"2024-03-20T13:37:17.349963+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:37:17.349963+0000","last_undegraded":"2024-03-20T13:37:17.349963+0000","last_fullsized":"2024-03-20T13:37:17.349963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.360390+0000","last_change":"2024-03-20T13:38:34.360390+0000","last_active":"2024-03-20T13:38:34.360390+0000","last_peered":"2024-03-20T13:38:34.360390+0000","last_clean":"2024-03-20T13:38:34.360390+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:38:34.360390+0000","last_undegraded":"2024-03-20T13:38:34.360390+0000","last_fullsized":"2024-03-20T13:38:34.360390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.360106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:40.327388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.342569+0000","last_change":"2024-03-20T13:36:36.844496+0000","last_active":"2024-03-20T13:37:17.342569+0000","last_peered":"2024-03-20T13:37:17.342569+0000","last_clean":"2024-03-20T13:37:17.342569+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:37:17.342569+0000","last_undegraded":"2024-03-20T13:37:17.342569+0000","last_fullsized":"2024-03-20T13:37:17.342569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.360463+0000","last_change":"2024-03-20T13:38:50.360616+0000","last_active":"2024-03-20T13:38:50.360463+0000","last_peered":"2024-03-20T13:38:50.360463+0000","last_clean":"2024-03-20T13:38:50.360463+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:38:50.360463+0000","last_undegraded":"2024-03-20T13:38:50.360463+0000","last_fullsized":"2024-03-20T13:38:50.360463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:50.360249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:50.360249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.360249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:27:20.207773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.532450+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:37:20.532450+0000","last_peered":"2024-03-20T13:37:20.532450+0000","last_clean":"2024-03-20T13:37:20.532450+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:37:20.532450+0000","last_undegraded":"2024-03-20T13:37:20.532450+0000","last_fullsized":"2024-03-20T13:37:20.532450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.671921+0000","last_change":"2024-03-20T13:38:42.671921+0000","last_active":"2024-03-20T13:38:42.671921+0000","last_peered":"2024-03-20T13:38:42.671921+0000","last_clean":"2024-03-20T13:38:42.671921+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:42.671921+0000","last_undegraded":"2024-03-20T13:38:42.671921+0000","last_fullsized":"2024-03-20T13:38:42.671921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:42.671660+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:42.671660+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.671660+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:41.237314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.372430+0000","last_change":"2024-03-20T13:38:55.372430+0000","last_active":"2024-03-20T13:38:55.372430+0000","last_peered":"2024-03-20T13:38:55.372430+0000","last_clean":"2024-03-20T13:38:55.372430+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:38:55.372430+0000","last_undegraded":"2024-03-20T13:38:55.372430+0000","last_fullsized":"2024-03-20T13:38:55.372430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:55.372162+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:55.372162+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.372162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:52:41.165170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609625+0000","last_change":"2024-03-20T13:36:36.832461+0000","last_active":"2024-03-20T13:38:22.609625+0000","last_peered":"2024-03-20T13:38:22.609625+0000","last_clean":"2024-03-20T13:38:22.609625+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:38:22.609625+0000","last_undegraded":"2024-03-20T13:38:22.609625+0000","last_fullsized":"2024-03-20T13:38:22.609625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.356156+0000","last_change":"2024-03-20T13:38:51.356156+0000","last_active":"2024-03-20T13:38:51.356156+0000","last_peered":"2024-03-20T13:38:51.356156+0000","last_clean":"2024-03-20T13:38:51.356156+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:51.356156+0000","last_undegraded":"2024-03-20T13:38:51.356156+0000","last_fullsized":"2024-03-20T13:38:51.356156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-03-20T13:38:51.355757+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-03-20T13:38:51.355757+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.355757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:23:00.937432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.081395+0000","last_change":"2024-03-20T13:36:36.818443+0000","last_active":"2024-03-20T13:38:23.081395+0000","last_peered":"2024-03-20T13:38:23.081395+0000","last_clean":"2024-03-20T13:38:23.081395+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:38:23.081395+0000","last_undegraded":"2024-03-20T13:38:23.081395+0000","last_fullsized":"2024-03-20T13:38:23.081395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.340213+0000","last_change":"2024-03-20T13:38:59.340213+0000","last_active":"2024-03-20T13:38:59.340213+0000","last_peered":"2024-03-20T13:38:59.340213+0000","last_clean":"2024-03-20T13:38:59.340213+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:59.340213+0000","last_undegraded":"2024-03-20T13:38:59.340213+0000","last_fullsized":"2024-03-20T13:38:59.340213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:59.339924+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:59.339924+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.339924+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:35.663825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353887+0000","last_change":"2024-03-20T13:36:36.840606+0000","last_active":"2024-03-20T13:37:17.353887+0000","last_peered":"2024-03-20T13:37:17.353887+0000","last_clean":"2024-03-20T13:37:17.353887+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:37:17.353887+0000","last_undegraded":"2024-03-20T13:37:17.353887+0000","last_fullsized":"2024-03-20T13:37:17.353887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.705823+0000","last_change":"2024-03-20T13:38:43.705994+0000","last_active":"2024-03-20T13:38:43.705823+0000","last_peered":"2024-03-20T13:38:43.705823+0000","last_clean":"2024-03-20T13:38:43.705823+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:43.705823+0000","last_undegraded":"2024-03-20T13:38:43.705823+0000","last_fullsized":"2024-03-20T13:38:43.705823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:43.705585+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:43.705585+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.705585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:47.485233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.093402+0000","last_change":"2024-03-20T13:36:36.826166+0000","last_active":"2024-03-20T13:37:22.093402+0000","last_peered":"2024-03-20T13:37:22.093402+0000","last_clean":"2024-03-20T13:37:22.093402+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:37:22.093402+0000","last_undegraded":"2024-03-20T13:37:22.093402+0000","last_fullsized":"2024-03-20T13:37:22.093402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.807990+0000","last_change":"2024-03-20T13:38:51.808048+0000","last_active":"2024-03-20T13:38:51.807990+0000","last_peered":"2024-03-20T13:38:51.807990+0000","last_clean":"2024-03-20T13:38:51.807990+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:38:51.807990+0000","last_undegraded":"2024-03-20T13:38:51.807990+0000","last_fullsized":"2024-03-20T13:38:51.807990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:51.807795+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:51.807795+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.807795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:46.641091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542593+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:38:23.542593+0000","last_peered":"2024-03-20T13:38:23.542593+0000","last_clean":"2024-03-20T13:38:23.542593+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:38:23.542593+0000","last_undegraded":"2024-03-20T13:38:23.542593+0000","last_fullsized":"2024-03-20T13:38:23.542593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.639457+0000","last_change":"2024-03-20T13:38:53.639520+0000","last_active":"2024-03-20T13:38:53.639457+0000","last_peered":"2024-03-20T13:38:53.639457+0000","last_clean":"2024-03-20T13:38:53.639457+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:38:53.639457+0000","last_undegraded":"2024-03-20T13:38:53.639457+0000","last_fullsized":"2024-03-20T13:38:53.639457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:53.639272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:53.639272+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.639272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:06:35.620794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542406+0000","last_change":"2024-03-20T13:36:36.848317+0000","last_active":"2024-03-20T13:38:23.542406+0000","last_peered":"2024-03-20T13:38:23.542406+0000","last_clean":"2024-03-20T13:38:23.542406+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:38:23.542406+0000","last_undegraded":"2024-03-20T13:38:23.542406+0000","last_fullsized":"2024-03-20T13:38:23.542406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.066668+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:11.066668+0000","last_peered":"2024-03-20T13:38:11.066668+0000","last_clean":"2024-03-20T13:38:11.066668+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:11.066668+0000","last_undegraded":"2024-03-20T13:38:11.066668+0000","last_fullsized":"2024-03-20T13:38:11.066668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.524991+0000","last_change":"2024-03-20T13:38:57.524991+0000","last_active":"2024-03-20T13:38:57.524991+0000","last_peered":"2024-03-20T13:38:57.524991+0000","last_clean":"2024-03-20T13:38:57.524991+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:57.524991+0000","last_undegraded":"2024-03-20T13:38:57.524991+0000","last_fullsized":"2024-03-20T13:38:57.524991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:57.524736+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:57.524736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.524736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:02:53.826364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542083+0000","last_change":"2024-03-20T13:36:36.847955+0000","last_active":"2024-03-20T13:38:23.542083+0000","last_peered":"2024-03-20T13:38:23.542083+0000","last_clean":"2024-03-20T13:38:23.542083+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:38:23.542083+0000","last_undegraded":"2024-03-20T13:38:23.542083+0000","last_fullsized":"2024-03-20T13:38:23.542083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.524436+0000","last_change":"2024-03-20T13:38:45.524488+0000","last_active":"2024-03-20T13:38:45.524436+0000","last_peered":"2024-03-20T13:38:45.524436+0000","last_clean":"2024-03-20T13:38:45.524436+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:38:45.524436+0000","last_undegraded":"2024-03-20T13:38:45.524436+0000","last_fullsized":"2024-03-20T13:38:45.524436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:45.524251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:45.524251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.524251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:26:46.932589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.636287+0000","last_change":"2024-03-20T13:38:27.636370+0000","last_active":"2024-03-20T13:38:27.636287+0000","last_peered":"2024-03-20T13:38:27.636287+0000","last_clean":"2024-03-20T13:38:27.636287+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:27.636287+0000","last_undegraded":"2024-03-20T13:38:27.636287+0000","last_fullsized":"2024-03-20T13:38:27.636287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.636107+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:56.436080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.395209+0000","last_change":"2024-03-20T13:38:45.395264+0000","last_active":"2024-03-20T13:38:45.395209+0000","last_peered":"2024-03-20T13:38:45.395209+0000","last_clean":"2024-03-20T13:38:45.395209+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:38:45.395209+0000","last_undegraded":"2024-03-20T13:38:45.395209+0000","last_fullsized":"2024-03-20T13:38:45.395209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:45.395019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:45.395019+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.395019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:25.417312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.111775+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:38:05.111775+0000","last_peered":"2024-03-20T13:38:05.111775+0000","last_clean":"2024-03-20T13:38:05.111775+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:38:05.111775+0000","last_undegraded":"2024-03-20T13:38:05.111775+0000","last_fullsized":"2024-03-20T13:38:05.111775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.108670+0000","last_change":"2024-03-20T13:36:38.822857+0000","last_active":"2024-03-20T13:37:22.108670+0000","last_peered":"2024-03-20T13:37:22.108670+0000","last_clean":"2024-03-20T13:37:22.108670+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:37:22.108670+0000","last_undegraded":"2024-03-20T13:37:22.108670+0000","last_fullsized":"2024-03-20T13:37:22.108670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.080996+0000","last_change":"2024-03-20T13:36:36.815979+0000","last_active":"2024-03-20T13:38:23.080996+0000","last_peered":"2024-03-20T13:38:23.080996+0000","last_clean":"2024-03-20T13:38:23.080996+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:38:23.080996+0000","last_undegraded":"2024-03-20T13:38:23.080996+0000","last_fullsized":"2024-03-20T13:38:23.080996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.609801+0000","last_change":"2024-03-20T13:38:28.609801+0000","last_active":"2024-03-20T13:38:28.609801+0000","last_peered":"2024-03-20T13:38:28.609801+0000","last_clean":"2024-03-20T13:38:28.609801+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:38:28.609801+0000","last_undegraded":"2024-03-20T13:38:28.609801+0000","last_fullsized":"2024-03-20T13:38:28.609801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.609546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.417547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.498201+0000","last_change":"2024-03-20T13:38:32.498376+0000","last_active":"2024-03-20T13:38:32.498201+0000","last_peered":"2024-03-20T13:38:32.498201+0000","last_clean":"2024-03-20T13:38:32.498201+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:38:32.498201+0000","last_undegraded":"2024-03-20T13:38:32.498201+0000","last_fullsized":"2024-03-20T13:38:32.498201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.497987+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:26.085583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353094+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:37:17.353094+0000","last_peered":"2024-03-20T13:37:17.353094+0000","last_clean":"2024-03-20T13:37:17.353094+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:37:17.353094+0000","last_undegraded":"2024-03-20T13:37:17.353094+0000","last_fullsized":"2024-03-20T13:37:17.353094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355788+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:37:17.355788+0000","last_peered":"2024-03-20T13:37:17.355788+0000","last_clean":"2024-03-20T13:37:17.355788+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:37:17.355788+0000","last_undegraded":"2024-03-20T13:37:17.355788+0000","last_fullsized":"2024-03-20T13:37:17.355788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.050255+0000","last_change":"2024-03-20T13:37:17.351202+0000","last_active":"2024-03-20T13:38:11.050255+0000","last_peered":"2024-03-20T13:38:11.050255+0000","last_clean":"2024-03-20T13:38:11.050255+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:38:11.050255+0000","last_undegraded":"2024-03-20T13:38:11.050255+0000","last_fullsized":"2024-03-20T13:38:11.050255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158902+0000","last_change":"2024-03-20T13:36:36.825659+0000","last_active":"2024-03-20T13:38:22.158902+0000","last_peered":"2024-03-20T13:38:22.158902+0000","last_clean":"2024-03-20T13:38:22.158902+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:38:22.158902+0000","last_undegraded":"2024-03-20T13:38:22.158902+0000","last_fullsized":"2024-03-20T13:38:22.158902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.622295+0000","last_change":"2024-03-20T13:38:32.622403+0000","last_active":"2024-03-20T13:38:32.622295+0000","last_peered":"2024-03-20T13:38:32.622295+0000","last_clean":"2024-03-20T13:38:32.622295+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:38:32.622295+0000","last_undegraded":"2024-03-20T13:38:32.622295+0000","last_fullsized":"2024-03-20T13:38:32.622295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.622043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:44.229800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.562126+0000","last_change":"2024-03-20T13:38:35.562204+0000","last_active":"2024-03-20T13:38:35.562126+0000","last_peered":"2024-03-20T13:38:35.562126+0000","last_clean":"2024-03-20T13:38:35.562126+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:38:35.562126+0000","last_undegraded":"2024-03-20T13:38:35.562126+0000","last_fullsized":"2024-03-20T13:38:35.562126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.561937+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:38:29.683966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'243","reported_seq":309,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:19.123431+0000","last_change":"2024-03-20T13:36:44.878389+0000","last_active":"2024-03-20T13:38:19.123431+0000","last_peered":"2024-03-20T13:38:19.123431+0000","last_clean":"2024-03-20T13:38:19.123431+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:38:19.123431+0000","last_undegraded":"2024-03-20T13:38:19.123431+0000","last_fullsized":"2024-03-20T13:38:19.123431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.559471+0000","last_change":"2024-03-20T13:38:26.559533+0000","last_active":"2024-03-20T13:38:26.559471+0000","last_peered":"2024-03-20T13:38:26.559471+0000","last_clean":"2024-03-20T13:38:26.559471+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:38:26.559471+0000","last_undegraded":"2024-03-20T13:38:26.559471+0000","last_fullsized":"2024-03-20T13:38:26.559471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.559287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:27.493448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.465499+0000","last_change":"2024-03-20T13:38:53.465561+0000","last_active":"2024-03-20T13:38:53.465499+0000","last_peered":"2024-03-20T13:38:53.465499+0000","last_clean":"2024-03-20T13:38:53.465499+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:38:53.465499+0000","last_undegraded":"2024-03-20T13:38:53.465499+0000","last_fullsized":"2024-03-20T13:38:53.465499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:53.465309+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:53.465309+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.465309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:44.165890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158821+0000","last_change":"2024-03-20T13:36:36.838074+0000","last_active":"2024-03-20T13:38:22.158821+0000","last_peered":"2024-03-20T13:38:22.158821+0000","last_clean":"2024-03-20T13:38:22.158821+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:38:22.158821+0000","last_undegraded":"2024-03-20T13:38:22.158821+0000","last_fullsized":"2024-03-20T13:38:22.158821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.432974+0000","last_change":"2024-03-20T13:38:25.433031+0000","last_active":"2024-03-20T13:38:25.432974+0000","last_peered":"2024-03-20T13:38:25.432974+0000","last_clean":"2024-03-20T13:38:25.432974+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:38:25.432974+0000","last_undegraded":"2024-03-20T13:38:25.432974+0000","last_fullsized":"2024-03-20T13:38:25.432974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.432781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:35.180635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.346154+0000","last_change":"2024-03-20T13:38:42.346225+0000","last_active":"2024-03-20T13:38:42.346154+0000","last_peered":"2024-03-20T13:38:42.346154+0000","last_clean":"2024-03-20T13:38:42.346154+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:42.346154+0000","last_undegraded":"2024-03-20T13:38:42.346154+0000","last_fullsized":"2024-03-20T13:38:42.346154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:42.345943+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:42.345943+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.345943+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:35:22.378243+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'243","reported_seq":331,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.606070+0000","last_change":"2024-03-20T13:38:39.606212+0000","last_active":"2024-03-20T13:38:39.606070+0000","last_peered":"2024-03-20T13:38:39.606070+0000","last_clean":"2024-03-20T13:38:39.606070+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:39.606070+0000","last_undegraded":"2024-03-20T13:38:39.606070+0000","last_fullsized":"2024-03-20T13:38:39.606070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.605847+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:06:01.030174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.317008+0000","last_change":"2024-03-20T13:37:17.356166+0000","last_active":"2024-03-20T13:37:21.317008+0000","last_peered":"2024-03-20T13:37:21.317008+0000","last_clean":"2024-03-20T13:37:21.317008+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:37:21.317008+0000","last_undegraded":"2024-03-20T13:37:21.317008+0000","last_fullsized":"2024-03-20T13:37:21.317008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158816+0000","last_change":"2024-03-20T13:36:36.834443+0000","last_active":"2024-03-20T13:38:22.158816+0000","last_peered":"2024-03-20T13:38:22.158816+0000","last_clean":"2024-03-20T13:38:22.158816+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:38:22.158816+0000","last_undegraded":"2024-03-20T13:38:22.158816+0000","last_fullsized":"2024-03-20T13:38:22.158816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.529826+0000","last_change":"2024-03-20T13:38:33.529826+0000","last_active":"2024-03-20T13:38:33.529826+0000","last_peered":"2024-03-20T13:38:33.529826+0000","last_clean":"2024-03-20T13:38:33.529826+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:38:33.529826+0000","last_undegraded":"2024-03-20T13:38:33.529826+0000","last_fullsized":"2024-03-20T13:38:33.529826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.529572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:40.945003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.281180+0000","last_change":"2024-03-20T13:38:39.281180+0000","last_active":"2024-03-20T13:38:39.281180+0000","last_peered":"2024-03-20T13:38:39.281180+0000","last_clean":"2024-03-20T13:38:39.281180+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:39.281180+0000","last_undegraded":"2024-03-20T13:38:39.281180+0000","last_fullsized":"2024-03-20T13:38:39.281180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.281001+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:54.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.650522+0000","last_change":"2024-03-20T13:38:24.650522+0000","last_active":"2024-03-20T13:38:24.650522+0000","last_peered":"2024-03-20T13:38:24.650522+0000","last_clean":"2024-03-20T13:38:24.650522+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:38:24.650522+0000","last_undegraded":"2024-03-20T13:38:24.650522+0000","last_fullsized":"2024-03-20T13:38:24.650522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.650271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:30:43.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.539249+0000","last_change":"2024-03-20T13:38:34.539249+0000","last_active":"2024-03-20T13:38:34.539249+0000","last_peered":"2024-03-20T13:38:34.539249+0000","last_clean":"2024-03-20T13:38:34.539249+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:34.539249+0000","last_undegraded":"2024-03-20T13:38:34.539249+0000","last_fullsized":"2024-03-20T13:38:34.539249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.539008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:16:31.372326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609775+0000","last_change":"2024-03-20T13:36:38.831983+0000","last_active":"2024-03-20T13:38:22.609775+0000","last_peered":"2024-03-20T13:38:22.609775+0000","last_clean":"2024-03-20T13:38:22.609775+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:38:22.609775+0000","last_undegraded":"2024-03-20T13:38:22.609775+0000","last_fullsized":"2024-03-20T13:38:22.609775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158817+0000","last_change":"2024-03-20T13:36:36.839624+0000","last_active":"2024-03-20T13:38:22.158817+0000","last_peered":"2024-03-20T13:38:22.158817+0000","last_clean":"2024-03-20T13:38:22.158817+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:38:22.158817+0000","last_undegraded":"2024-03-20T13:38:22.158817+0000","last_fullsized":"2024-03-20T13:38:22.158817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.584967+0000","last_change":"2024-03-20T13:38:37.584967+0000","last_active":"2024-03-20T13:38:37.584967+0000","last_peered":"2024-03-20T13:38:37.584967+0000","last_clean":"2024-03-20T13:38:37.584967+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:38:37.584967+0000","last_undegraded":"2024-03-20T13:38:37.584967+0000","last_fullsized":"2024-03-20T13:38:37.584967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.584698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:47:36.547057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.690450+0000","last_change":"2024-03-20T13:38:24.690450+0000","last_active":"2024-03-20T13:38:24.690450+0000","last_peered":"2024-03-20T13:38:24.690450+0000","last_clean":"2024-03-20T13:38:24.690450+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:24.690450+0000","last_undegraded":"2024-03-20T13:38:24.690450+0000","last_fullsized":"2024-03-20T13:38:24.690450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.690100+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:03.686066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.585659+0000","last_change":"2024-03-20T13:38:34.585659+0000","last_active":"2024-03-20T13:38:34.585659+0000","last_peered":"2024-03-20T13:38:34.585659+0000","last_clean":"2024-03-20T13:38:34.585659+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:38:34.585659+0000","last_undegraded":"2024-03-20T13:38:34.585659+0000","last_fullsized":"2024-03-20T13:38:34.585659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.585283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.364588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.588729+0000","last_change":"2024-03-20T13:38:50.588729+0000","last_active":"2024-03-20T13:38:50.588729+0000","last_peered":"2024-03-20T13:38:50.588729+0000","last_clean":"2024-03-20T13:38:50.588729+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:38:50.588729+0000","last_undegraded":"2024-03-20T13:38:50.588729+0000","last_fullsized":"2024-03-20T13:38:50.588729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:50.588446+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:50.588446+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.588446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:39.899285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159488+0000","last_change":"2024-03-20T13:36:38.827772+0000","last_active":"2024-03-20T13:38:22.159488+0000","last_peered":"2024-03-20T13:38:22.159488+0000","last_clean":"2024-03-20T13:38:22.159488+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:38:22.159488+0000","last_undegraded":"2024-03-20T13:38:22.159488+0000","last_fullsized":"2024-03-20T13:38:22.159488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158971+0000","last_change":"2024-03-20T13:36:36.826408+0000","last_active":"2024-03-20T13:38:22.158971+0000","last_peered":"2024-03-20T13:38:22.158971+0000","last_clean":"2024-03-20T13:38:22.158971+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:38:22.158971+0000","last_undegraded":"2024-03-20T13:38:22.158971+0000","last_fullsized":"2024-03-20T13:38:22.158971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.082125+0000","last_change":"2024-03-20T13:36:40.846177+0000","last_active":"2024-03-20T13:38:23.082125+0000","last_peered":"2024-03-20T13:38:23.082125+0000","last_clean":"2024-03-20T13:38:23.082125+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:38:23.082125+0000","last_undegraded":"2024-03-20T13:38:23.082125+0000","last_fullsized":"2024-03-20T13:38:23.082125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.802470+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.802470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.435258+0000","last_change":"2024-03-20T13:38:27.435258+0000","last_active":"2024-03-20T13:38:27.435258+0000","last_peered":"2024-03-20T13:38:27.435258+0000","last_clean":"2024-03-20T13:38:27.435258+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:27.435258+0000","last_undegraded":"2024-03-20T13:38:27.435258+0000","last_fullsized":"2024-03-20T13:38:27.435258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.434963+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:19.183364+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'243","reported_seq":297,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.518877+0000","last_change":"2024-03-20T13:38:24.518877+0000","last_active":"2024-03-20T13:38:24.518877+0000","last_peered":"2024-03-20T13:38:24.518877+0000","last_clean":"2024-03-20T13:38:24.518877+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:24.518877+0000","last_undegraded":"2024-03-20T13:38:24.518877+0000","last_fullsized":"2024-03-20T13:38:24.518877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.518629+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:39.808004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611264+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:38:22.611264+0000","last_peered":"2024-03-20T13:38:22.611264+0000","last_clean":"2024-03-20T13:38:22.611264+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:38:22.611264+0000","last_undegraded":"2024-03-20T13:38:22.611264+0000","last_fullsized":"2024-03-20T13:38:22.611264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.772126+0000","last_change":"2024-03-20T13:38:46.772126+0000","last_active":"2024-03-20T13:38:46.772126+0000","last_peered":"2024-03-20T13:38:46.772126+0000","last_clean":"2024-03-20T13:38:46.772126+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:46.772126+0000","last_undegraded":"2024-03-20T13:38:46.772126+0000","last_fullsized":"2024-03-20T13:38:46.772126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:46.771877+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:46.771877+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.771877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:57:20.852991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158887+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:38:22.158887+0000","last_peered":"2024-03-20T13:38:22.158887+0000","last_clean":"2024-03-20T13:38:22.158887+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:38:22.158887+0000","last_undegraded":"2024-03-20T13:38:22.158887+0000","last_fullsized":"2024-03-20T13:38:22.158887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.698820+0000","last_change":"2024-03-20T13:38:54.698871+0000","last_active":"2024-03-20T13:38:54.698820+0000","last_peered":"2024-03-20T13:38:54.698820+0000","last_clean":"2024-03-20T13:38:54.698820+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:38:54.698820+0000","last_undegraded":"2024-03-20T13:38:54.698820+0000","last_fullsized":"2024-03-20T13:38:54.698820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:54.698621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:54.698621+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.698621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:12:23.498595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'59","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.623377+0000","last_change":"2024-03-20T13:38:38.623377+0000","last_active":"2024-03-20T13:38:38.623377+0000","last_peered":"2024-03-20T13:38:38.623377+0000","last_clean":"2024-03-20T13:38:38.623377+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:38.623377+0000","last_undegraded":"2024-03-20T13:38:38.623377+0000","last_fullsized":"2024-03-20T13:38:38.623377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.623108+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:30.447395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.535665+0000","last_change":"2024-03-20T13:38:31.535665+0000","last_active":"2024-03-20T13:38:31.535665+0000","last_peered":"2024-03-20T13:38:31.535665+0000","last_clean":"2024-03-20T13:38:31.535665+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:38:31.535665+0000","last_undegraded":"2024-03-20T13:38:31.535665+0000","last_fullsized":"2024-03-20T13:38:31.535665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.535387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:13.731269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.610801+0000","last_change":"2024-03-20T13:38:54.610801+0000","last_active":"2024-03-20T13:38:54.610801+0000","last_peered":"2024-03-20T13:38:54.610801+0000","last_clean":"2024-03-20T13:38:54.610801+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:38:54.610801+0000","last_undegraded":"2024-03-20T13:38:54.610801+0000","last_fullsized":"2024-03-20T13:38:54.610801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:54.610460+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:54.610460+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.610460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:43.240773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609894+0000","last_change":"2024-03-20T13:36:38.832987+0000","last_active":"2024-03-20T13:38:22.609894+0000","last_peered":"2024-03-20T13:38:22.609894+0000","last_clean":"2024-03-20T13:38:22.609894+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:38:22.609894+0000","last_undegraded":"2024-03-20T13:38:22.609894+0000","last_fullsized":"2024-03-20T13:38:22.609894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541941+0000","last_change":"2024-03-20T13:36:36.846257+0000","last_active":"2024-03-20T13:38:23.541941+0000","last_peered":"2024-03-20T13:38:23.541941+0000","last_clean":"2024-03-20T13:38:23.541941+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:38:23.541941+0000","last_undegraded":"2024-03-20T13:38:23.541941+0000","last_fullsized":"2024-03-20T13:38:23.541941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.835816+0000","last_change":"2024-03-20T13:38:50.835816+0000","last_active":"2024-03-20T13:38:50.835816+0000","last_peered":"2024-03-20T13:38:50.835816+0000","last_clean":"2024-03-20T13:38:50.835816+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:38:50.835816+0000","last_undegraded":"2024-03-20T13:38:50.835816+0000","last_fullsized":"2024-03-20T13:38:50.835816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:50.835459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:50.835459+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.835459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:30.843392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.306918+0000","last_change":"2024-03-20T13:38:38.306918+0000","last_active":"2024-03-20T13:38:38.306918+0000","last_peered":"2024-03-20T13:38:38.306918+0000","last_clean":"2024-03-20T13:38:38.306918+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:38.306918+0000","last_undegraded":"2024-03-20T13:38:38.306918+0000","last_fullsized":"2024-03-20T13:38:38.306918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.306607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:10:18.381390+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.573861+0000","last_change":"2024-03-20T13:38:47.573861+0000","last_active":"2024-03-20T13:38:47.573861+0000","last_peered":"2024-03-20T13:38:47.573861+0000","last_clean":"2024-03-20T13:38:47.573861+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:38:47.573861+0000","last_undegraded":"2024-03-20T13:38:47.573861+0000","last_fullsized":"2024-03-20T13:38:47.573861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:47.573614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:47.573614+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.573614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:27:48.050248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544710+0000","last_change":"2024-03-20T13:36:46.875764+0000","last_active":"2024-03-20T13:38:23.544710+0000","last_peered":"2024-03-20T13:38:23.544710+0000","last_clean":"2024-03-20T13:38:23.544710+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:38:23.544710+0000","last_undegraded":"2024-03-20T13:38:23.544710+0000","last_fullsized":"2024-03-20T13:38:23.544710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.365085+0000","last_change":"2024-03-20T13:38:58.365162+0000","last_active":"2024-03-20T13:38:58.365085+0000","last_peered":"2024-03-20T13:38:58.365085+0000","last_clean":"2024-03-20T13:38:58.365085+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:38:58.365085+0000","last_undegraded":"2024-03-20T13:38:58.365085+0000","last_fullsized":"2024-03-20T13:38:58.365085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:58.364894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:58.364894+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.364894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:34.419966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159013+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:38:22.159013+0000","last_peered":"2024-03-20T13:38:22.159013+0000","last_clean":"2024-03-20T13:38:22.159013+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:38:22.159013+0000","last_undegraded":"2024-03-20T13:38:22.159013+0000","last_fullsized":"2024-03-20T13:38:22.159013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.615334+0000","last_change":"2024-03-20T13:38:40.615334+0000","last_active":"2024-03-20T13:38:40.615334+0000","last_peered":"2024-03-20T13:38:40.615334+0000","last_clean":"2024-03-20T13:38:40.615334+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:38:40.615334+0000","last_undegraded":"2024-03-20T13:38:40.615334+0000","last_fullsized":"2024-03-20T13:38:40.615334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.614954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:28:08.933992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.605992+0000","last_change":"2024-03-20T13:38:36.605992+0000","last_active":"2024-03-20T13:38:36.605992+0000","last_peered":"2024-03-20T13:38:36.605992+0000","last_clean":"2024-03-20T13:38:36.605992+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:36.605992+0000","last_undegraded":"2024-03-20T13:38:36.605992+0000","last_fullsized":"2024-03-20T13:38:36.605992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.605713+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:07:49.073403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'243","reported_seq":334,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.527288+0000","last_change":"2024-03-20T13:38:25.527288+0000","last_active":"2024-03-20T13:38:25.527288+0000","last_peered":"2024-03-20T13:38:25.527288+0000","last_clean":"2024-03-20T13:38:25.527288+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:25.527288+0000","last_undegraded":"2024-03-20T13:38:25.527288+0000","last_fullsized":"2024-03-20T13:38:25.527288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.527025+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:50.329674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611214+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:22.611214+0000","last_peered":"2024-03-20T13:38:22.611214+0000","last_clean":"2024-03-20T13:38:22.611214+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:22.611214+0000","last_undegraded":"2024-03-20T13:38:22.611214+0000","last_fullsized":"2024-03-20T13:38:22.611214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.798841+0000","last_change":"2024-03-20T13:38:49.798841+0000","last_active":"2024-03-20T13:38:49.798841+0000","last_peered":"2024-03-20T13:38:49.798841+0000","last_clean":"2024-03-20T13:38:49.798841+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:38:49.798841+0000","last_undegraded":"2024-03-20T13:38:49.798841+0000","last_fullsized":"2024-03-20T13:38:49.798841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:49.798478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:49.798478+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.798478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:08:13.331871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541923+0000","last_change":"2024-03-20T13:36:36.846954+0000","last_active":"2024-03-20T13:38:23.541923+0000","last_peered":"2024-03-20T13:38:23.541923+0000","last_clean":"2024-03-20T13:38:23.541923+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:38:23.541923+0000","last_undegraded":"2024-03-20T13:38:23.541923+0000","last_fullsized":"2024-03-20T13:38:23.541923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.451601+0000","last_change":"2024-03-20T13:38:24.451601+0000","last_active":"2024-03-20T13:38:24.451601+0000","last_peered":"2024-03-20T13:38:24.451601+0000","last_clean":"2024-03-20T13:38:24.451601+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:24.451601+0000","last_undegraded":"2024-03-20T13:38:24.451601+0000","last_fullsized":"2024-03-20T13:38:24.451601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.451322+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:19.284619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.664886+0000","last_change":"2024-03-20T13:38:26.664886+0000","last_active":"2024-03-20T13:38:26.664886+0000","last_peered":"2024-03-20T13:38:26.664886+0000","last_clean":"2024-03-20T13:38:26.664886+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:38:26.664886+0000","last_undegraded":"2024-03-20T13:38:26.664886+0000","last_fullsized":"2024-03-20T13:38:26.664886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.664636+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:08.014180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'243","reported_seq":357,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160473+0000","last_change":"2024-03-20T13:36:44.878660+0000","last_active":"2024-03-20T13:38:22.160473+0000","last_peered":"2024-03-20T13:38:22.160473+0000","last_clean":"2024-03-20T13:38:22.160473+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:38:22.160473+0000","last_undegraded":"2024-03-20T13:38:22.160473+0000","last_fullsized":"2024-03-20T13:38:22.160473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.082771+0000","last_change":"2024-03-20T13:36:46.894365+0000","last_active":"2024-03-20T13:38:23.082771+0000","last_peered":"2024-03-20T13:38:23.082771+0000","last_clean":"2024-03-20T13:38:23.082771+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:38:23.082771+0000","last_undegraded":"2024-03-20T13:38:23.082771+0000","last_fullsized":"2024-03-20T13:38:23.082771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.632047+0000","last_change":"2024-03-20T13:38:56.632175+0000","last_active":"2024-03-20T13:38:56.632047+0000","last_peered":"2024-03-20T13:38:56.632047+0000","last_clean":"2024-03-20T13:38:56.632047+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:56.632047+0000","last_undegraded":"2024-03-20T13:38:56.632047+0000","last_fullsized":"2024-03-20T13:38:56.632047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:56.631839+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:56.631839+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.631839+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:18.688964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541931+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:38:23.541931+0000","last_peered":"2024-03-20T13:38:23.541931+0000","last_clean":"2024-03-20T13:38:23.541931+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:38:23.541931+0000","last_undegraded":"2024-03-20T13:38:23.541931+0000","last_fullsized":"2024-03-20T13:38:23.541931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.569151+0000","last_change":"2024-03-20T13:38:46.569151+0000","last_active":"2024-03-20T13:38:46.569151+0000","last_peered":"2024-03-20T13:38:46.569151+0000","last_clean":"2024-03-20T13:38:46.569151+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:38:46.569151+0000","last_undegraded":"2024-03-20T13:38:46.569151+0000","last_fullsized":"2024-03-20T13:38:46.569151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:46.568905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:46.568905+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.568905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:55.191076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.347995+0000","last_change":"2024-03-20T13:38:36.347995+0000","last_active":"2024-03-20T13:38:36.347995+0000","last_peered":"2024-03-20T13:38:36.347995+0000","last_clean":"2024-03-20T13:38:36.347995+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:36.347995+0000","last_undegraded":"2024-03-20T13:38:36.347995+0000","last_fullsized":"2024-03-20T13:38:36.347995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.347716+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:02.799858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.349678+0000","last_change":"2024-03-20T13:38:53.349678+0000","last_active":"2024-03-20T13:38:53.349678+0000","last_peered":"2024-03-20T13:38:53.349678+0000","last_clean":"2024-03-20T13:38:53.349678+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:38:53.349678+0000","last_undegraded":"2024-03-20T13:38:53.349678+0000","last_fullsized":"2024-03-20T13:38:53.349678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:53.349437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:53.349437+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.349437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:12:43.840969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.589381+0000","last_change":"2024-03-20T13:38:46.589381+0000","last_active":"2024-03-20T13:38:46.589381+0000","last_peered":"2024-03-20T13:38:46.589381+0000","last_clean":"2024-03-20T13:38:46.589381+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:38:46.589381+0000","last_undegraded":"2024-03-20T13:38:46.589381+0000","last_fullsized":"2024-03-20T13:38:46.589381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:46.589122+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:46.589122+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.589122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:31:03.922880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.373201+0000","last_change":"2024-03-20T13:38:47.373268+0000","last_active":"2024-03-20T13:38:47.373201+0000","last_peered":"2024-03-20T13:38:47.373201+0000","last_clean":"2024-03-20T13:38:47.373201+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:38:47.373201+0000","last_undegraded":"2024-03-20T13:38:47.373201+0000","last_fullsized":"2024-03-20T13:38:47.373201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:38:47.372986+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:38:47.372986+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.372986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:40:49.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609093+0000","last_change":"2024-03-20T13:36:24.182178+0000","last_active":"2024-03-20T13:38:22.609093+0000","last_peered":"2024-03-20T13:38:22.609093+0000","last_clean":"2024-03-20T13:38:22.609093+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:38:22.609093+0000","last_undegraded":"2024-03-20T13:38:22.609093+0000","last_fullsized":"2024-03-20T13:38:22.609093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:22.715062+0000","last_clean_scrub_stamp":"2024-03-20T13:36:22.715062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158644+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:38:22.158644+0000","last_peered":"2024-03-20T13:38:22.158644+0000","last_clean":"2024-03-20T13:38:22.158644+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:38:22.158644+0000","last_undegraded":"2024-03-20T13:38:22.158644+0000","last_fullsized":"2024-03-20T13:38:22.158644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541872+0000","last_change":"2024-03-20T13:36:36.849187+0000","last_active":"2024-03-20T13:38:23.541872+0000","last_peered":"2024-03-20T13:38:23.541872+0000","last_clean":"2024-03-20T13:38:23.541872+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:38:23.541872+0000","last_undegraded":"2024-03-20T13:38:23.541872+0000","last_fullsized":"2024-03-20T13:38:23.541872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.568862+0000","last_change":"2024-03-20T13:38:39.568862+0000","last_active":"2024-03-20T13:38:39.568862+0000","last_peered":"2024-03-20T13:38:39.568862+0000","last_clean":"2024-03-20T13:38:39.568862+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:38:39.568862+0000","last_undegraded":"2024-03-20T13:38:39.568862+0000","last_fullsized":"2024-03-20T13:38:39.568862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.568507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:20.535216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.413088+0000","last_change":"2024-03-20T13:38:46.413088+0000","last_active":"2024-03-20T13:38:46.413088+0000","last_peered":"2024-03-20T13:38:46.413088+0000","last_clean":"2024-03-20T13:38:46.413088+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:46.413088+0000","last_undegraded":"2024-03-20T13:38:46.413088+0000","last_fullsized":"2024-03-20T13:38:46.413088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-03-20T13:38:46.412823+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-03-20T13:38:46.412823+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.412823+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:08.560465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.462333+0000","last_change":"2024-03-20T13:38:51.462333+0000","last_active":"2024-03-20T13:38:51.462333+0000","last_peered":"2024-03-20T13:38:51.462333+0000","last_clean":"2024-03-20T13:38:51.462333+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:38:51.462333+0000","last_undegraded":"2024-03-20T13:38:51.462333+0000","last_fullsized":"2024-03-20T13:38:51.462333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:51.462055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:51.462055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.462055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:26.757666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'51","reported_seq":116,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.082792+0000","last_change":"2024-03-20T13:36:46.893348+0000","last_active":"2024-03-20T13:38:23.082792+0000","last_peered":"2024-03-20T13:38:23.082792+0000","last_clean":"2024-03-20T13:38:23.082792+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:38:23.082792+0000","last_undegraded":"2024-03-20T13:38:23.082792+0000","last_fullsized":"2024-03-20T13:38:23.082792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.483111+0000","last_change":"2024-03-20T13:38:54.483175+0000","last_active":"2024-03-20T13:38:54.483111+0000","last_peered":"2024-03-20T13:38:54.483111+0000","last_clean":"2024-03-20T13:38:54.483111+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:38:54.483111+0000","last_undegraded":"2024-03-20T13:38:54.483111+0000","last_fullsized":"2024-03-20T13:38:54.483111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:54.482914+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:54.482914+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.482914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:27:35.407795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158556+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:38:22.158556+0000","last_peered":"2024-03-20T13:38:22.158556+0000","last_clean":"2024-03-20T13:38:22.158556+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:38:22.158556+0000","last_undegraded":"2024-03-20T13:38:22.158556+0000","last_fullsized":"2024-03-20T13:38:22.158556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609196+0000","last_change":"2024-03-20T13:36:36.833258+0000","last_active":"2024-03-20T13:38:22.609196+0000","last_peered":"2024-03-20T13:38:22.609196+0000","last_clean":"2024-03-20T13:38:22.609196+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:38:22.609196+0000","last_undegraded":"2024-03-20T13:38:22.609196+0000","last_fullsized":"2024-03-20T13:38:22.609196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.404985+0000","last_change":"2024-03-20T13:38:31.404985+0000","last_active":"2024-03-20T13:38:31.404985+0000","last_peered":"2024-03-20T13:38:31.404985+0000","last_clean":"2024-03-20T13:38:31.404985+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:38:31.404985+0000","last_undegraded":"2024-03-20T13:38:31.404985+0000","last_fullsized":"2024-03-20T13:38:31.404985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.404736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:36.082582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'256","reported_seq":448,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.594117+0000","last_change":"2024-03-20T13:38:27.594117+0000","last_active":"2024-03-20T13:38:27.594117+0000","last_peered":"2024-03-20T13:38:27.594117+0000","last_clean":"2024-03-20T13:38:27.594117+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:27.594117+0000","last_undegraded":"2024-03-20T13:38:27.594117+0000","last_fullsized":"2024-03-20T13:38:27.594117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'256","last_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_deep_scrub":"34'256","last_deep_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.593856+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:15.732896+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.556386+0000","last_change":"2024-03-20T13:38:43.556386+0000","last_active":"2024-03-20T13:38:43.556386+0000","last_peered":"2024-03-20T13:38:43.556386+0000","last_clean":"2024-03-20T13:38:43.556386+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:38:43.556386+0000","last_undegraded":"2024-03-20T13:38:43.556386+0000","last_fullsized":"2024-03-20T13:38:43.556386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:43.556135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:43.556135+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.556135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:18.900581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611557+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:38:22.611557+0000","last_peered":"2024-03-20T13:38:22.611557+0000","last_clean":"2024-03-20T13:38:22.611557+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:38:22.611557+0000","last_undegraded":"2024-03-20T13:38:22.611557+0000","last_fullsized":"2024-03-20T13:38:22.611557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609785+0000","last_change":"2024-03-20T13:36:38.832205+0000","last_active":"2024-03-20T13:38:22.609785+0000","last_peered":"2024-03-20T13:38:22.609785+0000","last_clean":"2024-03-20T13:38:22.609785+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:38:22.609785+0000","last_undegraded":"2024-03-20T13:38:22.609785+0000","last_fullsized":"2024-03-20T13:38:22.609785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.675046+0000","last_change":"2024-03-20T13:38:56.675104+0000","last_active":"2024-03-20T13:38:56.675046+0000","last_peered":"2024-03-20T13:38:56.675046+0000","last_clean":"2024-03-20T13:38:56.675046+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:38:56.675046+0000","last_undegraded":"2024-03-20T13:38:56.675046+0000","last_fullsized":"2024-03-20T13:38:56.675046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:56.674857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:56.674857+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.674857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:59:12.553051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609155+0000","last_change":"2024-03-20T13:36:36.836293+0000","last_active":"2024-03-20T13:38:22.609155+0000","last_peered":"2024-03-20T13:38:22.609155+0000","last_clean":"2024-03-20T13:38:22.609155+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:38:22.609155+0000","last_undegraded":"2024-03-20T13:38:22.609155+0000","last_fullsized":"2024-03-20T13:38:22.609155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.785460+0000","last_change":"2024-03-20T13:38:52.785528+0000","last_active":"2024-03-20T13:38:52.785460+0000","last_peered":"2024-03-20T13:38:52.785460+0000","last_clean":"2024-03-20T13:38:52.785460+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:38:52.785460+0000","last_undegraded":"2024-03-20T13:38:52.785460+0000","last_fullsized":"2024-03-20T13:38:52.785460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:52.785272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.785272+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.785272+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:02.533126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.434925+0000","last_change":"2024-03-20T13:38:29.434925+0000","last_active":"2024-03-20T13:38:29.434925+0000","last_peered":"2024-03-20T13:38:29.434925+0000","last_clean":"2024-03-20T13:38:29.434925+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:29.434925+0000","last_undegraded":"2024-03-20T13:38:29.434925+0000","last_fullsized":"2024-03-20T13:38:29.434925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.434642+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.312836+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.577902+0000","last_change":"2024-03-20T13:38:26.577902+0000","last_active":"2024-03-20T13:38:26.577902+0000","last_peered":"2024-03-20T13:38:26.577902+0000","last_clean":"2024-03-20T13:38:26.577902+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:38:26.577902+0000","last_undegraded":"2024-03-20T13:38:26.577902+0000","last_fullsized":"2024-03-20T13:38:26.577902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.577544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:31.374045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.478081+0000","last_change":"2024-03-20T13:38:59.478081+0000","last_active":"2024-03-20T13:38:59.478081+0000","last_peered":"2024-03-20T13:38:59.478081+0000","last_clean":"2024-03-20T13:38:59.478081+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:38:59.478081+0000","last_undegraded":"2024-03-20T13:38:59.478081+0000","last_fullsized":"2024-03-20T13:38:59.478081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.477674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.477674+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.477674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:35:30.131510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.579357+0000","last_change":"2024-03-20T13:38:48.579421+0000","last_active":"2024-03-20T13:38:48.579357+0000","last_peered":"2024-03-20T13:38:48.579357+0000","last_clean":"2024-03-20T13:38:48.579357+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:48.579357+0000","last_undegraded":"2024-03-20T13:38:48.579357+0000","last_fullsized":"2024-03-20T13:38:48.579357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:48.579175+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:48.579175+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.579175+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:18.825200+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158551+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:38:22.158551+0000","last_peered":"2024-03-20T13:38:22.158551+0000","last_clean":"2024-03-20T13:38:22.158551+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:38:22.158551+0000","last_undegraded":"2024-03-20T13:38:22.158551+0000","last_fullsized":"2024-03-20T13:38:22.158551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158714+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:38:22.158714+0000","last_peered":"2024-03-20T13:38:22.158714+0000","last_clean":"2024-03-20T13:38:22.158714+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:38:22.158714+0000","last_undegraded":"2024-03-20T13:38:22.158714+0000","last_fullsized":"2024-03-20T13:38:22.158714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.643838+0000","last_change":"2024-03-20T13:38:43.643838+0000","last_active":"2024-03-20T13:38:43.643838+0000","last_peered":"2024-03-20T13:38:43.643838+0000","last_clean":"2024-03-20T13:38:43.643838+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:38:43.643838+0000","last_undegraded":"2024-03-20T13:38:43.643838+0000","last_fullsized":"2024-03-20T13:38:43.643838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:43.643583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:43.643583+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.643583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:49.867880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.665096+0000","last_change":"2024-03-20T13:38:31.665096+0000","last_active":"2024-03-20T13:38:31.665096+0000","last_peered":"2024-03-20T13:38:31.665096+0000","last_clean":"2024-03-20T13:38:31.665096+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:31.665096+0000","last_undegraded":"2024-03-20T13:38:31.665096+0000","last_fullsized":"2024-03-20T13:38:31.665096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.664843+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:03:43.219513+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.526385+0000","last_change":"2024-03-20T13:38:55.526385+0000","last_active":"2024-03-20T13:38:55.526385+0000","last_peered":"2024-03-20T13:38:55.526385+0000","last_clean":"2024-03-20T13:38:55.526385+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:38:55.526385+0000","last_undegraded":"2024-03-20T13:38:55.526385+0000","last_fullsized":"2024-03-20T13:38:55.526385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:55.526096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:55.526096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.526096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:50.661554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611506+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:38:22.611506+0000","last_peered":"2024-03-20T13:38:22.611506+0000","last_clean":"2024-03-20T13:38:22.611506+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:38:22.611506+0000","last_undegraded":"2024-03-20T13:38:22.611506+0000","last_fullsized":"2024-03-20T13:38:22.611506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'7","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609784+0000","last_change":"2024-03-20T13:36:38.835114+0000","last_active":"2024-03-20T13:38:22.609784+0000","last_peered":"2024-03-20T13:38:22.609784+0000","last_clean":"2024-03-20T13:38:22.609784+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:38:22.609784+0000","last_undegraded":"2024-03-20T13:38:22.609784+0000","last_fullsized":"2024-03-20T13:38:22.609784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158865+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:38:22.158865+0000","last_peered":"2024-03-20T13:38:22.158865+0000","last_clean":"2024-03-20T13:38:22.158865+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:38:22.158865+0000","last_undegraded":"2024-03-20T13:38:22.158865+0000","last_fullsized":"2024-03-20T13:38:22.158865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609093+0000","last_change":"2024-03-20T13:36:29.119078+0000","last_active":"2024-03-20T13:38:22.609093+0000","last_peered":"2024-03-20T13:38:22.609093+0000","last_clean":"2024-03-20T13:38:22.609093+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:38:22.609093+0000","last_undegraded":"2024-03-20T13:38:22.609093+0000","last_fullsized":"2024-03-20T13:38:22.609093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.595471+0000","last_change":"2024-03-20T13:38:39.595471+0000","last_active":"2024-03-20T13:38:39.595471+0000","last_peered":"2024-03-20T13:38:39.595471+0000","last_clean":"2024-03-20T13:38:39.595471+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:38:39.595471+0000","last_undegraded":"2024-03-20T13:38:39.595471+0000","last_fullsized":"2024-03-20T13:38:39.595471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.595226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:34.240122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'68","reported_seq":144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.532606+0000","last_change":"2024-03-20T13:38:31.532606+0000","last_active":"2024-03-20T13:38:31.532606+0000","last_peered":"2024-03-20T13:38:31.532606+0000","last_clean":"2024-03-20T13:38:31.532606+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:31.532606+0000","last_undegraded":"2024-03-20T13:38:31.532606+0000","last_fullsized":"2024-03-20T13:38:31.532606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'68","last_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_deep_scrub":"34'68","last_deep_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.532334+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:30:24.833392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.295952+0000","last_change":"2024-03-20T13:38:41.295952+0000","last_active":"2024-03-20T13:38:41.295952+0000","last_peered":"2024-03-20T13:38:41.295952+0000","last_clean":"2024-03-20T13:38:41.295952+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:38:41.295952+0000","last_undegraded":"2024-03-20T13:38:41.295952+0000","last_fullsized":"2024-03-20T13:38:41.295952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:41.295702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:41.295702+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.295702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:31.520002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.559920+0000","last_change":"2024-03-20T13:38:30.559920+0000","last_active":"2024-03-20T13:38:30.559920+0000","last_peered":"2024-03-20T13:38:30.559920+0000","last_clean":"2024-03-20T13:38:30.559920+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:30.559920+0000","last_undegraded":"2024-03-20T13:38:30.559920+0000","last_fullsized":"2024-03-20T13:38:30.559920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.559669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:18:34.421204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.719618+0000","last_change":"2024-03-20T13:39:00.719680+0000","last_active":"2024-03-20T13:39:00.719618+0000","last_peered":"2024-03-20T13:39:00.719618+0000","last_clean":"2024-03-20T13:39:00.719618+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:39:00.719618+0000","last_undegraded":"2024-03-20T13:39:00.719618+0000","last_fullsized":"2024-03-20T13:39:00.719618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:00.719427+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:00.719427+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.719427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:35:54.364275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609226+0000","last_change":"2024-03-20T13:36:36.830990+0000","last_active":"2024-03-20T13:38:22.609226+0000","last_peered":"2024-03-20T13:38:22.609226+0000","last_clean":"2024-03-20T13:38:22.609226+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:38:22.609226+0000","last_undegraded":"2024-03-20T13:38:22.609226+0000","last_fullsized":"2024-03-20T13:38:22.609226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158672+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:38:22.158672+0000","last_peered":"2024-03-20T13:38:22.158672+0000","last_clean":"2024-03-20T13:38:22.158672+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:38:22.158672+0000","last_undegraded":"2024-03-20T13:38:22.158672+0000","last_fullsized":"2024-03-20T13:38:22.158672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.396031+0000","last_change":"2024-03-20T13:38:30.396031+0000","last_active":"2024-03-20T13:38:30.396031+0000","last_peered":"2024-03-20T13:38:30.396031+0000","last_clean":"2024-03-20T13:38:30.396031+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:38:30.396031+0000","last_undegraded":"2024-03-20T13:38:30.396031+0000","last_fullsized":"2024-03-20T13:38:30.396031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.395743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:19.841036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.620785+0000","last_change":"2024-03-20T13:38:25.620785+0000","last_active":"2024-03-20T13:38:25.620785+0000","last_peered":"2024-03-20T13:38:25.620785+0000","last_clean":"2024-03-20T13:38:25.620785+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:38:25.620785+0000","last_undegraded":"2024-03-20T13:38:25.620785+0000","last_fullsized":"2024-03-20T13:38:25.620785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.620381+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:16.685474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'243","reported_seq":331,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.526805+0000","last_change":"2024-03-20T13:38:30.526805+0000","last_active":"2024-03-20T13:38:30.526805+0000","last_peered":"2024-03-20T13:38:30.526805+0000","last_clean":"2024-03-20T13:38:30.526805+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:30.526805+0000","last_undegraded":"2024-03-20T13:38:30.526805+0000","last_fullsized":"2024-03-20T13:38:30.526805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.526556+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:46.021855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544739+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:38:23.544739+0000","last_peered":"2024-03-20T13:38:23.544739+0000","last_clean":"2024-03-20T13:38:23.544739+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:38:23.544739+0000","last_undegraded":"2024-03-20T13:38:23.544739+0000","last_fullsized":"2024-03-20T13:38:23.544739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542775+0000","last_change":"2024-03-20T13:36:38.813661+0000","last_active":"2024-03-20T13:38:23.542775+0000","last_peered":"2024-03-20T13:38:23.542775+0000","last_clean":"2024-03-20T13:38:23.542775+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:38:23.542775+0000","last_undegraded":"2024-03-20T13:38:23.542775+0000","last_fullsized":"2024-03-20T13:38:23.542775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541960+0000","last_change":"2024-03-20T13:36:36.847617+0000","last_active":"2024-03-20T13:38:23.541960+0000","last_peered":"2024-03-20T13:38:23.541960+0000","last_clean":"2024-03-20T13:38:23.541960+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:38:23.541960+0000","last_undegraded":"2024-03-20T13:38:23.541960+0000","last_fullsized":"2024-03-20T13:38:23.541960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609099+0000","last_change":"2024-03-20T13:36:28.749336+0000","last_active":"2024-03-20T13:38:22.609099+0000","last_peered":"2024-03-20T13:38:22.609099+0000","last_clean":"2024-03-20T13:38:22.609099+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:38:22.609099+0000","last_undegraded":"2024-03-20T13:38:22.609099+0000","last_fullsized":"2024-03-20T13:38:22.609099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.425602+0000","last_change":"2024-03-20T13:38:23.425602+0000","last_active":"2024-03-20T13:38:23.425602+0000","last_peered":"2024-03-20T13:38:23.425602+0000","last_clean":"2024-03-20T13:38:23.425602+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:38:23.425602+0000","last_undegraded":"2024-03-20T13:38:23.425602+0000","last_fullsized":"2024-03-20T13:38:23.425602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.425487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:03.433420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.612586+0000","last_change":"2024-03-20T13:38:42.612586+0000","last_active":"2024-03-20T13:38:42.612586+0000","last_peered":"2024-03-20T13:38:42.612586+0000","last_clean":"2024-03-20T13:38:42.612586+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:38:42.612586+0000","last_undegraded":"2024-03-20T13:38:42.612586+0000","last_fullsized":"2024-03-20T13:38:42.612586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-03-20T13:38:42.612284+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-03-20T13:38:42.612284+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.612284+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:43.020680+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'243","reported_seq":329,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.624509+0000","last_change":"2024-03-20T13:38:33.624509+0000","last_active":"2024-03-20T13:38:33.624509+0000","last_peered":"2024-03-20T13:38:33.624509+0000","last_clean":"2024-03-20T13:38:33.624509+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:33.624509+0000","last_undegraded":"2024-03-20T13:38:33.624509+0000","last_fullsized":"2024-03-20T13:38:33.624509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.624254+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:31:42.470838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611572+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:38:22.611572+0000","last_peered":"2024-03-20T13:38:22.611572+0000","last_clean":"2024-03-20T13:38:22.611572+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:38:22.611572+0000","last_undegraded":"2024-03-20T13:38:22.611572+0000","last_fullsized":"2024-03-20T13:38:22.611572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.796755+0000","last_change":"2024-03-20T13:38:47.796817+0000","last_active":"2024-03-20T13:38:47.796755+0000","last_peered":"2024-03-20T13:38:47.796755+0000","last_clean":"2024-03-20T13:38:47.796755+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:38:47.796755+0000","last_undegraded":"2024-03-20T13:38:47.796755+0000","last_fullsized":"2024-03-20T13:38:47.796755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:47.796569+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:47.796569+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.796569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:46.550018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609311+0000","last_change":"2024-03-20T13:36:36.831337+0000","last_active":"2024-03-20T13:38:22.609311+0000","last_peered":"2024-03-20T13:38:22.609311+0000","last_clean":"2024-03-20T13:38:22.609311+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:38:22.609311+0000","last_undegraded":"2024-03-20T13:38:22.609311+0000","last_fullsized":"2024-03-20T13:38:22.609311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158673+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:38:22.158673+0000","last_peered":"2024-03-20T13:38:22.158673+0000","last_clean":"2024-03-20T13:38:22.158673+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:38:22.158673+0000","last_undegraded":"2024-03-20T13:38:22.158673+0000","last_fullsized":"2024-03-20T13:38:22.158673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.640338+0000","last_change":"2024-03-20T13:38:30.640338+0000","last_active":"2024-03-20T13:38:30.640338+0000","last_peered":"2024-03-20T13:38:30.640338+0000","last_clean":"2024-03-20T13:38:30.640338+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:38:30.640338+0000","last_undegraded":"2024-03-20T13:38:30.640338+0000","last_fullsized":"2024-03-20T13:38:30.640338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.640055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:20.085347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":184,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.394015+0000","last_change":"2024-03-20T13:38:33.394015+0000","last_active":"2024-03-20T13:38:33.394015+0000","last_peered":"2024-03-20T13:38:33.394015+0000","last_clean":"2024-03-20T13:38:33.394015+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:33.394015+0000","last_undegraded":"2024-03-20T13:38:33.394015+0000","last_fullsized":"2024-03-20T13:38:33.394015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.393752+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:13.108218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.607288+0000","last_change":"2024-03-20T13:38:35.607288+0000","last_active":"2024-03-20T13:38:35.607288+0000","last_peered":"2024-03-20T13:38:35.607288+0000","last_clean":"2024-03-20T13:38:35.607288+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:38:35.607288+0000","last_undegraded":"2024-03-20T13:38:35.607288+0000","last_fullsized":"2024-03-20T13:38:35.607288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.607032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:55:24.977582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.511758+0000","last_change":"2024-03-20T13:38:23.511758+0000","last_active":"2024-03-20T13:38:23.511758+0000","last_peered":"2024-03-20T13:38:23.511758+0000","last_clean":"2024-03-20T13:38:23.511758+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:38:23.511758+0000","last_undegraded":"2024-03-20T13:38:23.511758+0000","last_fullsized":"2024-03-20T13:38:23.511758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.511495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:10.006144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.608882+0000","last_change":"2024-03-20T13:38:38.608882+0000","last_active":"2024-03-20T13:38:38.608882+0000","last_peered":"2024-03-20T13:38:38.608882+0000","last_clean":"2024-03-20T13:38:38.608882+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:38:38.608882+0000","last_undegraded":"2024-03-20T13:38:38.608882+0000","last_fullsized":"2024-03-20T13:38:38.608882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.608632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:09.360540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.774095+0000","last_change":"2024-03-20T13:38:45.774095+0000","last_active":"2024-03-20T13:38:45.774095+0000","last_peered":"2024-03-20T13:38:45.774095+0000","last_clean":"2024-03-20T13:38:45.774095+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:45.774095+0000","last_undegraded":"2024-03-20T13:38:45.774095+0000","last_fullsized":"2024-03-20T13:38:45.774095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-03-20T13:38:45.773816+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-03-20T13:38:45.773816+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.773816+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:39:52.703727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159139+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:38:22.159139+0000","last_peered":"2024-03-20T13:38:22.159139+0000","last_clean":"2024-03-20T13:38:22.159139+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:38:22.159139+0000","last_undegraded":"2024-03-20T13:38:22.159139+0000","last_fullsized":"2024-03-20T13:38:22.159139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.603602+0000","last_change":"2024-03-20T13:38:44.603602+0000","last_active":"2024-03-20T13:38:44.603602+0000","last_peered":"2024-03-20T13:38:44.603602+0000","last_clean":"2024-03-20T13:38:44.603602+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:38:44.603602+0000","last_undegraded":"2024-03-20T13:38:44.603602+0000","last_fullsized":"2024-03-20T13:38:44.603602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:44.603360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:44.603360+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.603360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:50:57.154639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.581303+0000","last_change":"2024-03-20T13:38:41.581462+0000","last_active":"2024-03-20T13:38:41.581303+0000","last_peered":"2024-03-20T13:38:41.581303+0000","last_clean":"2024-03-20T13:38:41.581303+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:41.581303+0000","last_undegraded":"2024-03-20T13:38:41.581303+0000","last_fullsized":"2024-03-20T13:38:41.581303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-03-20T13:38:41.580998+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-03-20T13:38:41.580998+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.580998+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:22:22.559251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.610716+0000","last_change":"2024-03-20T13:38:36.610771+0000","last_active":"2024-03-20T13:38:36.610716+0000","last_peered":"2024-03-20T13:38:36.610716+0000","last_clean":"2024-03-20T13:38:36.610716+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:38:36.610716+0000","last_undegraded":"2024-03-20T13:38:36.610716+0000","last_fullsized":"2024-03-20T13:38:36.610716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.610516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:03.062657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544915+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:38:23.544915+0000","last_peered":"2024-03-20T13:38:23.544915+0000","last_clean":"2024-03-20T13:38:23.544915+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:38:23.544915+0000","last_undegraded":"2024-03-20T13:38:23.544915+0000","last_fullsized":"2024-03-20T13:38:23.544915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.633218+0000","last_change":"2024-03-20T13:38:55.633218+0000","last_active":"2024-03-20T13:38:55.633218+0000","last_peered":"2024-03-20T13:38:55.633218+0000","last_clean":"2024-03-20T13:38:55.633218+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:38:55.633218+0000","last_undegraded":"2024-03-20T13:38:55.633218+0000","last_fullsized":"2024-03-20T13:38:55.633218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:55.632954+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:55.632954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.632954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:05.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.683297+0000","last_change":"2024-03-20T13:38:58.683297+0000","last_active":"2024-03-20T13:38:58.683297+0000","last_peered":"2024-03-20T13:38:58.683297+0000","last_clean":"2024-03-20T13:38:58.683297+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:38:58.683297+0000","last_undegraded":"2024-03-20T13:38:58.683297+0000","last_fullsized":"2024-03-20T13:38:58.683297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:58.683054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:58.683054+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.683054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:04:10.237724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.555801+0000","last_change":"2024-03-20T13:38:48.555801+0000","last_active":"2024-03-20T13:38:48.555801+0000","last_peered":"2024-03-20T13:38:48.555801+0000","last_clean":"2024-03-20T13:38:48.555801+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:38:48.555801+0000","last_undegraded":"2024-03-20T13:38:48.555801+0000","last_fullsized":"2024-03-20T13:38:48.555801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:48.555555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:48.555555+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.555555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:14.196969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.579986+0000","last_change":"2024-03-20T13:38:29.580058+0000","last_active":"2024-03-20T13:38:29.579986+0000","last_peered":"2024-03-20T13:38:29.579986+0000","last_clean":"2024-03-20T13:38:29.579986+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:38:29.579986+0000","last_undegraded":"2024-03-20T13:38:29.579986+0000","last_fullsized":"2024-03-20T13:38:29.579986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.579791+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:56.167406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.591444+0000","last_change":"2024-03-20T13:38:29.591499+0000","last_active":"2024-03-20T13:38:29.591444+0000","last_peered":"2024-03-20T13:38:29.591444+0000","last_clean":"2024-03-20T13:38:29.591444+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:38:29.591444+0000","last_undegraded":"2024-03-20T13:38:29.591444+0000","last_fullsized":"2024-03-20T13:38:29.591444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.591251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:46.103619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.368001+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:05.368001+0000","last_peered":"2024-03-20T13:38:05.368001+0000","last_clean":"2024-03-20T13:38:05.368001+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:05.368001+0000","last_undegraded":"2024-03-20T13:38:05.368001+0000","last_fullsized":"2024-03-20T13:38:05.368001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.477948+0000","last_change":"2024-03-20T13:38:58.477948+0000","last_active":"2024-03-20T13:38:58.477948+0000","last_peered":"2024-03-20T13:38:58.477948+0000","last_clean":"2024-03-20T13:38:58.477948+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:38:58.477948+0000","last_undegraded":"2024-03-20T13:38:58.477948+0000","last_fullsized":"2024-03-20T13:38:58.477948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:38:58.477682+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:38:58.477682+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.477682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:53:06.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354229+0000","last_change":"2024-03-20T13:36:36.836705+0000","last_active":"2024-03-20T13:37:17.354229+0000","last_peered":"2024-03-20T13:37:17.354229+0000","last_clean":"2024-03-20T13:37:17.354229+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:37:17.354229+0000","last_undegraded":"2024-03-20T13:37:17.354229+0000","last_fullsized":"2024-03-20T13:37:17.354229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.440960+0000","last_change":"2024-03-20T13:38:26.440960+0000","last_active":"2024-03-20T13:38:26.440960+0000","last_peered":"2024-03-20T13:38:26.440960+0000","last_clean":"2024-03-20T13:38:26.440960+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:38:26.440960+0000","last_undegraded":"2024-03-20T13:38:26.440960+0000","last_fullsized":"2024-03-20T13:38:26.440960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.440701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:34.910452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'42","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.605084+0000","last_change":"2024-03-20T13:38:40.605165+0000","last_active":"2024-03-20T13:38:40.605084+0000","last_peered":"2024-03-20T13:38:40.605084+0000","last_clean":"2024-03-20T13:38:40.605084+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:40.605084+0000","last_undegraded":"2024-03-20T13:38:40.605084+0000","last_fullsized":"2024-03-20T13:38:40.605084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'42","last_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_deep_scrub":"34'42","last_deep_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.604871+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:50:04.270564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.630260+0000","last_change":"2024-03-20T13:38:42.630318+0000","last_active":"2024-03-20T13:38:42.630260+0000","last_peered":"2024-03-20T13:38:42.630260+0000","last_clean":"2024-03-20T13:38:42.630260+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:38:42.630260+0000","last_undegraded":"2024-03-20T13:38:42.630260+0000","last_fullsized":"2024-03-20T13:38:42.630260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:42.630032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:42.630032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.630032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:35.899389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.356216+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:37:17.356216+0000","last_peered":"2024-03-20T13:37:17.356216+0000","last_clean":"2024-03-20T13:37:17.356216+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:37:17.356216+0000","last_undegraded":"2024-03-20T13:37:17.356216+0000","last_fullsized":"2024-03-20T13:37:17.356216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.508391+0000","last_change":"2024-03-20T13:38:56.508391+0000","last_active":"2024-03-20T13:38:56.508391+0000","last_peered":"2024-03-20T13:38:56.508391+0000","last_clean":"2024-03-20T13:38:56.508391+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:56.508391+0000","last_undegraded":"2024-03-20T13:38:56.508391+0000","last_fullsized":"2024-03-20T13:38:56.508391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:56.508131+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:56.508131+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.508131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:42.709535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609267+0000","last_change":"2024-03-20T13:36:36.829532+0000","last_active":"2024-03-20T13:38:22.609267+0000","last_peered":"2024-03-20T13:38:22.609267+0000","last_clean":"2024-03-20T13:38:22.609267+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:38:22.609267+0000","last_undegraded":"2024-03-20T13:38:22.609267+0000","last_fullsized":"2024-03-20T13:38:22.609267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.618082+0000","last_change":"2024-03-20T13:38:29.618082+0000","last_active":"2024-03-20T13:38:29.618082+0000","last_peered":"2024-03-20T13:38:29.618082+0000","last_clean":"2024-03-20T13:38:29.618082+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:38:29.618082+0000","last_undegraded":"2024-03-20T13:38:29.618082+0000","last_fullsized":"2024-03-20T13:38:29.618082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.617842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.496036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.356998+0000","last_change":"2024-03-20T13:38:44.357181+0000","last_active":"2024-03-20T13:38:44.356998+0000","last_peered":"2024-03-20T13:38:44.356998+0000","last_clean":"2024-03-20T13:38:44.356998+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:44.356998+0000","last_undegraded":"2024-03-20T13:38:44.356998+0000","last_fullsized":"2024-03-20T13:38:44.356998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:44.356772+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:44.356772+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.356772+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:34.210460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.530106+0000","last_change":"2024-03-20T13:38:32.530157+0000","last_active":"2024-03-20T13:38:32.530106+0000","last_peered":"2024-03-20T13:38:32.530106+0000","last_clean":"2024-03-20T13:38:32.530106+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:38:32.530106+0000","last_undegraded":"2024-03-20T13:38:32.530106+0000","last_fullsized":"2024-03-20T13:38:32.530106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.529912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:23:06.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.323124+0000","last_change":"2024-03-20T13:38:56.323183+0000","last_active":"2024-03-20T13:38:56.323124+0000","last_peered":"2024-03-20T13:38:56.323124+0000","last_clean":"2024-03-20T13:38:56.323124+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:38:56.323124+0000","last_undegraded":"2024-03-20T13:38:56.323124+0000","last_fullsized":"2024-03-20T13:38:56.323124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:56.322921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:56.322921+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.322921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:17.280083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542000+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:38:23.542000+0000","last_peered":"2024-03-20T13:38:23.542000+0000","last_clean":"2024-03-20T13:38:23.542000+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:38:23.542000+0000","last_undegraded":"2024-03-20T13:38:23.542000+0000","last_fullsized":"2024-03-20T13:38:23.542000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.624003+0000","last_change":"2024-03-20T13:38:23.624003+0000","last_active":"2024-03-20T13:38:23.624003+0000","last_peered":"2024-03-20T13:38:23.624003+0000","last_clean":"2024-03-20T13:38:23.624003+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:38:23.624003+0000","last_undegraded":"2024-03-20T13:38:23.624003+0000","last_fullsized":"2024-03-20T13:38:23.624003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.623665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:46.378711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'59","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.583891+0000","last_change":"2024-03-20T13:38:28.584099+0000","last_active":"2024-03-20T13:38:28.583891+0000","last_peered":"2024-03-20T13:38:28.583891+0000","last_clean":"2024-03-20T13:38:28.583891+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:28.583891+0000","last_undegraded":"2024-03-20T13:38:28.583891+0000","last_fullsized":"2024-03-20T13:38:28.583891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.583677+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:50:25.438865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.554852+0000","last_change":"2024-03-20T13:38:28.554904+0000","last_active":"2024-03-20T13:38:28.554852+0000","last_peered":"2024-03-20T13:38:28.554852+0000","last_clean":"2024-03-20T13:38:28.554852+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:38:28.554852+0000","last_undegraded":"2024-03-20T13:38:28.554852+0000","last_fullsized":"2024-03-20T13:38:28.554852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.554662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:18.277488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:05.379354+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:05.379354+0000","last_peered":"2024-03-20T13:38:05.379354+0000","last_clean":"2024-03-20T13:38:05.379354+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:05.379354+0000","last_undegraded":"2024-03-20T13:38:05.379354+0000","last_fullsized":"2024-03-20T13:38:05.379354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.610014+0000","last_change":"2024-03-20T13:36:38.834011+0000","last_active":"2024-03-20T13:38:22.610014+0000","last_peered":"2024-03-20T13:38:22.610014+0000","last_clean":"2024-03-20T13:38:22.610014+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:38:22.610014+0000","last_undegraded":"2024-03-20T13:38:22.610014+0000","last_fullsized":"2024-03-20T13:38:22.610014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609365+0000","last_change":"2024-03-20T13:36:36.833334+0000","last_active":"2024-03-20T13:38:22.609365+0000","last_peered":"2024-03-20T13:38:22.609365+0000","last_clean":"2024-03-20T13:38:22.609365+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:38:22.609365+0000","last_undegraded":"2024-03-20T13:38:22.609365+0000","last_fullsized":"2024-03-20T13:38:22.609365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.382567+0000","last_change":"2024-03-20T13:38:32.382567+0000","last_active":"2024-03-20T13:38:32.382567+0000","last_peered":"2024-03-20T13:38:32.382567+0000","last_clean":"2024-03-20T13:38:32.382567+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:38:32.382567+0000","last_undegraded":"2024-03-20T13:38:32.382567+0000","last_fullsized":"2024-03-20T13:38:32.382567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.382310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:43.990067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'43","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.283060+0000","last_change":"2024-03-20T13:38:40.283141+0000","last_active":"2024-03-20T13:38:40.283060+0000","last_peered":"2024-03-20T13:38:40.283060+0000","last_clean":"2024-03-20T13:38:40.283060+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:40.283060+0000","last_undegraded":"2024-03-20T13:38:40.283060+0000","last_fullsized":"2024-03-20T13:38:40.283060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.282858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:43:36.602180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.518451+0000","last_change":"2024-03-20T13:38:34.518505+0000","last_active":"2024-03-20T13:38:34.518451+0000","last_peered":"2024-03-20T13:38:34.518451+0000","last_clean":"2024-03-20T13:38:34.518451+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:38:34.518451+0000","last_undegraded":"2024-03-20T13:38:34.518451+0000","last_fullsized":"2024-03-20T13:38:34.518451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:09.209953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.347002+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:37:21.347002+0000","last_peered":"2024-03-20T13:37:21.347002+0000","last_clean":"2024-03-20T13:37:21.347002+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:37:21.347002+0000","last_undegraded":"2024-03-20T13:37:21.347002+0000","last_fullsized":"2024-03-20T13:37:21.347002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.514085+0000","last_change":"2024-03-20T13:38:49.514149+0000","last_active":"2024-03-20T13:38:49.514085+0000","last_peered":"2024-03-20T13:38:49.514085+0000","last_clean":"2024-03-20T13:38:49.514085+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:38:49.514085+0000","last_undegraded":"2024-03-20T13:38:49.514085+0000","last_fullsized":"2024-03-20T13:38:49.514085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:38:49.513894+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:38:49.513894+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.513894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:37:53.473877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.349379+0000","last_change":"2024-03-20T13:36:36.835178+0000","last_active":"2024-03-20T13:37:17.349379+0000","last_peered":"2024-03-20T13:37:17.349379+0000","last_clean":"2024-03-20T13:37:17.349379+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:37:17.349379+0000","last_undegraded":"2024-03-20T13:37:17.349379+0000","last_fullsized":"2024-03-20T13:37:17.349379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.419751+0000","last_change":"2024-03-20T13:38:22.419777+0000","last_active":"2024-03-20T13:38:22.419751+0000","last_peered":"2024-03-20T13:38:22.419751+0000","last_clean":"2024-03-20T13:38:22.419751+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:38:22.419751+0000","last_undegraded":"2024-03-20T13:38:22.419751+0000","last_fullsized":"2024-03-20T13:38:22.419751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_clean_scrub_stamp":"2024-03-20T13:38:22.419651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:45.953043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.566628+0000","last_change":"2024-03-20T13:38:44.566628+0000","last_active":"2024-03-20T13:38:44.566628+0000","last_peered":"2024-03-20T13:38:44.566628+0000","last_clean":"2024-03-20T13:38:44.566628+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:44.566628+0000","last_undegraded":"2024-03-20T13:38:44.566628+0000","last_fullsized":"2024-03-20T13:38:44.566628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-03-20T13:38:44.566362+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-03-20T13:38:44.566362+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.566362+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:01.080651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.540382+0000","last_change":"2024-03-20T13:38:38.540382+0000","last_active":"2024-03-20T13:38:38.540382+0000","last_peered":"2024-03-20T13:38:38.540382+0000","last_clean":"2024-03-20T13:38:38.540382+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:38:38.540382+0000","last_undegraded":"2024-03-20T13:38:38.540382+0000","last_fullsized":"2024-03-20T13:38:38.540382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.540096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:29:14.710303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346957+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:37:17.346957+0000","last_peered":"2024-03-20T13:37:17.346957+0000","last_clean":"2024-03-20T13:37:17.346957+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:37:17.346957+0000","last_undegraded":"2024-03-20T13:37:17.346957+0000","last_fullsized":"2024-03-20T13:37:17.346957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.833523+0000","last_change":"2024-03-20T13:38:48.833581+0000","last_active":"2024-03-20T13:38:48.833523+0000","last_peered":"2024-03-20T13:38:48.833523+0000","last_clean":"2024-03-20T13:38:48.833523+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:38:48.833523+0000","last_undegraded":"2024-03-20T13:38:48.833523+0000","last_fullsized":"2024-03-20T13:38:48.833523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:48.833308+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:48.833308+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.833308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:42.905473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.529925+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:37:20.529925+0000","last_peered":"2024-03-20T13:37:20.529925+0000","last_clean":"2024-03-20T13:37:20.529925+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:37:20.529925+0000","last_undegraded":"2024-03-20T13:37:20.529925+0000","last_fullsized":"2024-03-20T13:37:20.529925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.664336+0000","last_change":"2024-03-20T13:38:41.664389+0000","last_active":"2024-03-20T13:38:41.664336+0000","last_peered":"2024-03-20T13:38:41.664336+0000","last_clean":"2024-03-20T13:38:41.664336+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:38:41.664336+0000","last_undegraded":"2024-03-20T13:38:41.664336+0000","last_fullsized":"2024-03-20T13:38:41.664336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:41.664105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:41.664105+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.664105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:34:12.132470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.687890+0000","last_change":"2024-03-20T13:38:25.687890+0000","last_active":"2024-03-20T13:38:25.687890+0000","last_peered":"2024-03-20T13:38:25.687890+0000","last_clean":"2024-03-20T13:38:25.687890+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:38:25.687890+0000","last_undegraded":"2024-03-20T13:38:25.687890+0000","last_fullsized":"2024-03-20T13:38:25.687890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.687477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.537657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'244","reported_seq":318,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.369936+0000","last_change":"2024-03-20T13:38:49.369936+0000","last_active":"2024-03-20T13:38:49.369936+0000","last_peered":"2024-03-20T13:38:49.369936+0000","last_clean":"2024-03-20T13:38:49.369936+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:49.369936+0000","last_undegraded":"2024-03-20T13:38:49.369936+0000","last_fullsized":"2024-03-20T13:38:49.369936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:38:49.369673+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:38:49.369673+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.369673+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:42:52.765055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.346793+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:37:17.346793+0000","last_peered":"2024-03-20T13:37:17.346793+0000","last_clean":"2024-03-20T13:37:17.346793+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:37:17.346793+0000","last_undegraded":"2024-03-20T13:37:17.346793+0000","last_fullsized":"2024-03-20T13:37:17.346793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.746676+0000","last_change":"2024-03-20T13:38:44.746741+0000","last_active":"2024-03-20T13:38:44.746676+0000","last_peered":"2024-03-20T13:38:44.746676+0000","last_clean":"2024-03-20T13:38:44.746676+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:38:44.746676+0000","last_undegraded":"2024-03-20T13:38:44.746676+0000","last_fullsized":"2024-03-20T13:38:44.746676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:44.746483+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:44.746483+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.746483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:06.855881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.735484+0000","last_change":"2024-03-20T13:38:59.735541+0000","last_active":"2024-03-20T13:38:59.735484+0000","last_peered":"2024-03-20T13:38:59.735484+0000","last_clean":"2024-03-20T13:38:59.735484+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:38:59.735484+0000","last_undegraded":"2024-03-20T13:38:59.735484+0000","last_fullsized":"2024-03-20T13:38:59.735484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.735288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.735288+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.735288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:00:05.162580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.525409+0000","last_change":"2024-03-20T13:38:36.525470+0000","last_active":"2024-03-20T13:38:36.525409+0000","last_peered":"2024-03-20T13:38:36.525409+0000","last_clean":"2024-03-20T13:38:36.525409+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:36.525409+0000","last_undegraded":"2024-03-20T13:38:36.525409+0000","last_fullsized":"2024-03-20T13:38:36.525409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.525211+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:48:52.542790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'43","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.359239+0000","last_change":"2024-03-20T13:38:35.359327+0000","last_active":"2024-03-20T13:38:35.359239+0000","last_peered":"2024-03-20T13:38:35.359239+0000","last_clean":"2024-03-20T13:38:35.359239+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:35.359239+0000","last_undegraded":"2024-03-20T13:38:35.359239+0000","last_fullsized":"2024-03-20T13:38:35.359239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.359044+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:38.277772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.612931+0000","last_change":"2024-03-20T13:38:37.612986+0000","last_active":"2024-03-20T13:38:37.612931+0000","last_peered":"2024-03-20T13:38:37.612931+0000","last_clean":"2024-03-20T13:38:37.612931+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:38:37.612931+0000","last_undegraded":"2024-03-20T13:38:37.612931+0000","last_fullsized":"2024-03-20T13:38:37.612931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.612746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:43.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.355954+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:37:17.355954+0000","last_peered":"2024-03-20T13:37:17.355954+0000","last_clean":"2024-03-20T13:37:17.355954+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:37:17.355954+0000","last_undegraded":"2024-03-20T13:37:17.355954+0000","last_fullsized":"2024-03-20T13:37:17.355954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.350764+0000","last_change":"2024-03-20T13:36:38.827830+0000","last_active":"2024-03-20T13:37:17.350764+0000","last_peered":"2024-03-20T13:37:17.350764+0000","last_clean":"2024-03-20T13:37:17.350764+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:37:17.350764+0000","last_undegraded":"2024-03-20T13:37:17.350764+0000","last_fullsized":"2024-03-20T13:37:17.350764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.353613+0000","last_change":"2024-03-20T13:36:36.837596+0000","last_active":"2024-03-20T13:37:17.353613+0000","last_peered":"2024-03-20T13:37:17.353613+0000","last_clean":"2024-03-20T13:37:17.353613+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:37:17.353613+0000","last_undegraded":"2024-03-20T13:37:17.353613+0000","last_fullsized":"2024-03-20T13:37:17.353613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":210,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.392480+0000","last_change":"2024-03-20T13:38:28.392546+0000","last_active":"2024-03-20T13:38:28.392480+0000","last_peered":"2024-03-20T13:38:28.392480+0000","last_clean":"2024-03-20T13:38:28.392480+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:28.392480+0000","last_undegraded":"2024-03-20T13:38:28.392480+0000","last_fullsized":"2024-03-20T13:38:28.392480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.392293+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.200294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.510621+0000","last_change":"2024-03-20T13:38:33.510699+0000","last_active":"2024-03-20T13:38:33.510621+0000","last_peered":"2024-03-20T13:38:33.510621+0000","last_clean":"2024-03-20T13:38:33.510621+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:33.510621+0000","last_undegraded":"2024-03-20T13:38:33.510621+0000","last_fullsized":"2024-03-20T13:38:33.510621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.510425+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:36.604731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.298207+0000","last_change":"2024-03-20T13:38:37.298312+0000","last_active":"2024-03-20T13:38:37.298207+0000","last_peered":"2024-03-20T13:38:37.298207+0000","last_clean":"2024-03-20T13:38:37.298207+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:38:37.298207+0000","last_undegraded":"2024-03-20T13:38:37.298207+0000","last_fullsized":"2024-03-20T13:38:37.298207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.297989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:19.272096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:11.045775+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:11.045775+0000","last_peered":"2024-03-20T13:38:11.045775+0000","last_clean":"2024-03-20T13:38:11.045775+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:11.045775+0000","last_undegraded":"2024-03-20T13:38:11.045775+0000","last_fullsized":"2024-03-20T13:38:11.045775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902479+0000","last_change":"2024-03-20T13:36:38.826048+0000","last_active":"2024-03-20T13:38:04.902479+0000","last_peered":"2024-03-20T13:38:04.902479+0000","last_clean":"2024-03-20T13:38:04.902479+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:38:04.902479+0000","last_undegraded":"2024-03-20T13:38:04.902479+0000","last_fullsized":"2024-03-20T13:38:04.902479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542063+0000","last_change":"2024-03-20T13:36:36.848516+0000","last_active":"2024-03-20T13:38:23.542063+0000","last_peered":"2024-03-20T13:38:23.542063+0000","last_clean":"2024-03-20T13:38:23.542063+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:38:23.542063+0000","last_undegraded":"2024-03-20T13:38:23.542063+0000","last_fullsized":"2024-03-20T13:38:23.542063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.568443+0000","last_change":"2024-03-20T13:38:37.568554+0000","last_active":"2024-03-20T13:38:37.568443+0000","last_peered":"2024-03-20T13:38:37.568443+0000","last_clean":"2024-03-20T13:38:37.568443+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:38:37.568443+0000","last_undegraded":"2024-03-20T13:38:37.568443+0000","last_fullsized":"2024-03-20T13:38:37.568443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.568192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:02:40.953434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.672588+0000","last_change":"2024-03-20T13:38:23.672659+0000","last_active":"2024-03-20T13:38:23.672588+0000","last_peered":"2024-03-20T13:38:23.672588+0000","last_clean":"2024-03-20T13:38:23.672588+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:23.672588+0000","last_undegraded":"2024-03-20T13:38:23.672588+0000","last_fullsized":"2024-03-20T13:38:23.672588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.672372+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:19.543310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.372155+0000","last_change":"2024-03-20T13:38:57.372209+0000","last_active":"2024-03-20T13:38:57.372155+0000","last_peered":"2024-03-20T13:38:57.372155+0000","last_clean":"2024-03-20T13:38:57.372155+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:38:57.372155+0000","last_undegraded":"2024-03-20T13:38:57.372155+0000","last_fullsized":"2024-03-20T13:38:57.372155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:57.371958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:57.371958+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.371958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:49.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.105904+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:37:22.105904+0000","last_peered":"2024-03-20T13:37:22.105904+0000","last_clean":"2024-03-20T13:37:22.105904+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:37:22.105904+0000","last_undegraded":"2024-03-20T13:37:22.105904+0000","last_fullsized":"2024-03-20T13:37:22.105904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.374052+0000","last_change":"2024-03-20T13:38:48.374114+0000","last_active":"2024-03-20T13:38:48.374052+0000","last_peered":"2024-03-20T13:38:48.374052+0000","last_clean":"2024-03-20T13:38:48.374052+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:38:48.374052+0000","last_undegraded":"2024-03-20T13:38:48.374052+0000","last_fullsized":"2024-03-20T13:38:48.374052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-03-20T13:38:48.373835+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-03-20T13:38:48.373835+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.373835+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:21:02.963289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609343+0000","last_change":"2024-03-20T13:36:36.832558+0000","last_active":"2024-03-20T13:38:22.609343+0000","last_peered":"2024-03-20T13:38:22.609343+0000","last_clean":"2024-03-20T13:38:22.609343+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:38:22.609343+0000","last_undegraded":"2024-03-20T13:38:22.609343+0000","last_fullsized":"2024-03-20T13:38:22.609343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.505299+0000","last_change":"2024-03-20T13:38:35.505456+0000","last_active":"2024-03-20T13:38:35.505299+0000","last_peered":"2024-03-20T13:38:35.505299+0000","last_clean":"2024-03-20T13:38:35.505299+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:38:35.505299+0000","last_undegraded":"2024-03-20T13:38:35.505299+0000","last_fullsized":"2024-03-20T13:38:35.505299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.505077+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:06.593833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.336834+0000","last_change":"2024-03-20T13:38:43.336933+0000","last_active":"2024-03-20T13:38:43.336834+0000","last_peered":"2024-03-20T13:38:43.336834+0000","last_clean":"2024-03-20T13:38:43.336834+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:43.336834+0000","last_undegraded":"2024-03-20T13:38:43.336834+0000","last_fullsized":"2024-03-20T13:38:43.336834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-03-20T13:38:43.336633+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-03-20T13:38:43.336633+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.336633+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:42:40.193080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.579371+0000","last_change":"2024-03-20T13:38:27.579425+0000","last_active":"2024-03-20T13:38:27.579371+0000","last_peered":"2024-03-20T13:38:27.579371+0000","last_clean":"2024-03-20T13:38:27.579371+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:38:27.579371+0000","last_undegraded":"2024-03-20T13:38:27.579371+0000","last_fullsized":"2024-03-20T13:38:27.579371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.579191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:01.136809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.354663+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:37:17.354663+0000","last_peered":"2024-03-20T13:37:17.354663+0000","last_clean":"2024-03-20T13:37:17.354663+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:37:17.354663+0000","last_undegraded":"2024-03-20T13:37:17.354663+0000","last_fullsized":"2024-03-20T13:37:17.354663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.610158+0000","last_change":"2024-03-20T13:36:38.834433+0000","last_active":"2024-03-20T13:38:22.610158+0000","last_peered":"2024-03-20T13:38:22.610158+0000","last_clean":"2024-03-20T13:38:22.610158+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:38:22.610158+0000","last_undegraded":"2024-03-20T13:38:22.610158+0000","last_fullsized":"2024-03-20T13:38:22.610158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.643901+0000","last_change":"2024-03-20T13:38:59.643969+0000","last_active":"2024-03-20T13:38:59.643901+0000","last_peered":"2024-03-20T13:38:59.643901+0000","last_clean":"2024-03-20T13:38:59.643901+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:38:59.643901+0000","last_undegraded":"2024-03-20T13:38:59.643901+0000","last_fullsized":"2024-03-20T13:38:59.643901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.643704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.643704+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.643704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:06.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.599638+0000","last_change":"2024-03-20T13:38:51.599723+0000","last_active":"2024-03-20T13:38:51.599638+0000","last_peered":"2024-03-20T13:38:51.599638+0000","last_clean":"2024-03-20T13:38:51.599638+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:38:51.599638+0000","last_undegraded":"2024-03-20T13:38:51.599638+0000","last_fullsized":"2024-03-20T13:38:51.599638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:51.599437+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:51.599437+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.599437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:17.080484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.081048+0000","last_change":"2024-03-20T13:36:36.814746+0000","last_active":"2024-03-20T13:38:23.081048+0000","last_peered":"2024-03-20T13:38:23.081048+0000","last_clean":"2024-03-20T13:38:23.081048+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:38:23.081048+0000","last_undegraded":"2024-03-20T13:38:23.081048+0000","last_fullsized":"2024-03-20T13:38:23.081048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.344552+0000","last_change":"2024-03-20T13:38:52.344609+0000","last_active":"2024-03-20T13:38:52.344552+0000","last_peered":"2024-03-20T13:38:52.344552+0000","last_clean":"2024-03-20T13:38:52.344552+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:38:52.344552+0000","last_undegraded":"2024-03-20T13:38:52.344552+0000","last_fullsized":"2024-03-20T13:38:52.344552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:52.344358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:52.344358+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.344358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:21.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542220+0000","last_change":"2024-03-20T13:36:36.851159+0000","last_active":"2024-03-20T13:38:23.542220+0000","last_peered":"2024-03-20T13:38:23.542220+0000","last_clean":"2024-03-20T13:38:23.542220+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:38:23.542220+0000","last_undegraded":"2024-03-20T13:38:23.542220+0000","last_fullsized":"2024-03-20T13:38:23.542220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.564094+0000","last_change":"2024-03-20T13:38:47.564094+0000","last_active":"2024-03-20T13:38:47.564094+0000","last_peered":"2024-03-20T13:38:47.564094+0000","last_clean":"2024-03-20T13:38:47.564094+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:38:47.564094+0000","last_undegraded":"2024-03-20T13:38:47.564094+0000","last_fullsized":"2024-03-20T13:38:47.564094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:47.563835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:47.563835+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.563835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:59:16.361280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.663539+0000","last_change":"2024-03-20T13:38:57.663612+0000","last_active":"2024-03-20T13:38:57.663539+0000","last_peered":"2024-03-20T13:38:57.663539+0000","last_clean":"2024-03-20T13:38:57.663539+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:57.663539+0000","last_undegraded":"2024-03-20T13:38:57.663539+0000","last_fullsized":"2024-03-20T13:38:57.663539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:57.663332+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:57.663332+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.663332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:47.108625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'3","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:04.902584+0000","last_change":"2024-03-20T13:37:17.364712+0000","last_active":"2024-03-20T13:38:04.902584+0000","last_peered":"2024-03-20T13:38:04.902584+0000","last_clean":"2024-03-20T13:38:04.902584+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:38:04.902584+0000","last_undegraded":"2024-03-20T13:38:04.902584+0000","last_fullsized":"2024-03-20T13:38:04.902584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542350+0000","last_change":"2024-03-20T13:36:36.846100+0000","last_active":"2024-03-20T13:38:23.542350+0000","last_peered":"2024-03-20T13:38:23.542350+0000","last_clean":"2024-03-20T13:38:23.542350+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:38:23.542350+0000","last_undegraded":"2024-03-20T13:38:23.542350+0000","last_fullsized":"2024-03-20T13:38:23.542350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.602517+0000","last_change":"2024-03-20T13:38:52.602578+0000","last_active":"2024-03-20T13:38:52.602517+0000","last_peered":"2024-03-20T13:38:52.602517+0000","last_clean":"2024-03-20T13:38:52.602517+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:38:52.602517+0000","last_undegraded":"2024-03-20T13:38:52.602517+0000","last_fullsized":"2024-03-20T13:38:52.602517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:52.602307+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.602307+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.602307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:59:45.472743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609551+0000","last_change":"2024-03-20T13:36:36.831139+0000","last_active":"2024-03-20T13:38:22.609551+0000","last_peered":"2024-03-20T13:38:22.609551+0000","last_clean":"2024-03-20T13:38:22.609551+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:38:22.609551+0000","last_undegraded":"2024-03-20T13:38:22.609551+0000","last_fullsized":"2024-03-20T13:38:22.609551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.433351+0000","last_change":"2024-03-20T13:38:52.433522+0000","last_active":"2024-03-20T13:38:52.433351+0000","last_peered":"2024-03-20T13:38:52.433351+0000","last_clean":"2024-03-20T13:38:52.433351+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:52.433351+0000","last_undegraded":"2024-03-20T13:38:52.433351+0000","last_fullsized":"2024-03-20T13:38:52.433351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:52.433131+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.433131+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.433131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:53.839074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.748399+0000","last_change":"2024-03-20T13:38:53.748455+0000","last_active":"2024-03-20T13:38:53.748399+0000","last_peered":"2024-03-20T13:38:53.748399+0000","last_clean":"2024-03-20T13:38:53.748399+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:38:53.748399+0000","last_undegraded":"2024-03-20T13:38:53.748399+0000","last_fullsized":"2024-03-20T13:38:53.748399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:53.748204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:53.748204+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.748204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:12:58.243259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159377+0000","last_change":"2024-03-20T13:36:38.831672+0000","last_active":"2024-03-20T13:38:22.159377+0000","last_peered":"2024-03-20T13:38:22.159377+0000","last_clean":"2024-03-20T13:38:22.159377+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:38:22.159377+0000","last_undegraded":"2024-03-20T13:38:22.159377+0000","last_fullsized":"2024-03-20T13:38:22.159377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542278+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:38:23.542278+0000","last_peered":"2024-03-20T13:38:23.542278+0000","last_clean":"2024-03-20T13:38:23.542278+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:38:23.542278+0000","last_undegraded":"2024-03-20T13:38:23.542278+0000","last_fullsized":"2024-03-20T13:38:23.542278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.609193+0000","last_change":"2024-03-20T13:38:49.609193+0000","last_active":"2024-03-20T13:38:49.609193+0000","last_peered":"2024-03-20T13:38:49.609193+0000","last_clean":"2024-03-20T13:38:49.609193+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:49.609193+0000","last_undegraded":"2024-03-20T13:38:49.609193+0000","last_fullsized":"2024-03-20T13:38:49.609193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:49.608940+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:49.608940+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.608940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:56:54.242319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542395+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:38:23.542395+0000","last_peered":"2024-03-20T13:38:23.542395+0000","last_clean":"2024-03-20T13:38:23.542395+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:38:23.542395+0000","last_undegraded":"2024-03-20T13:38:23.542395+0000","last_fullsized":"2024-03-20T13:38:23.542395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.476851+0000","last_change":"2024-03-20T13:39:00.476851+0000","last_active":"2024-03-20T13:39:00.476851+0000","last_peered":"2024-03-20T13:39:00.476851+0000","last_clean":"2024-03-20T13:39:00.476851+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:39:00.476851+0000","last_undegraded":"2024-03-20T13:39:00.476851+0000","last_fullsized":"2024-03-20T13:39:00.476851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.476528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.476528+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.476528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:46.562110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542362+0000","last_change":"2024-03-20T13:36:36.848972+0000","last_active":"2024-03-20T13:38:23.542362+0000","last_peered":"2024-03-20T13:38:23.542362+0000","last_clean":"2024-03-20T13:38:23.542362+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:38:23.542362+0000","last_undegraded":"2024-03-20T13:38:23.542362+0000","last_fullsized":"2024-03-20T13:38:23.542362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.619511+0000","last_change":"2024-03-20T13:38:40.619511+0000","last_active":"2024-03-20T13:38:40.619511+0000","last_peered":"2024-03-20T13:38:40.619511+0000","last_clean":"2024-03-20T13:38:40.619511+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:40.619511+0000","last_undegraded":"2024-03-20T13:38:40.619511+0000","last_fullsized":"2024-03-20T13:38:40.619511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.619249+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:28.069678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159147+0000","last_change":"2024-03-20T13:36:36.830049+0000","last_active":"2024-03-20T13:38:22.159147+0000","last_peered":"2024-03-20T13:38:22.159147+0000","last_clean":"2024-03-20T13:38:22.159147+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:38:22.159147+0000","last_undegraded":"2024-03-20T13:38:22.159147+0000","last_fullsized":"2024-03-20T13:38:22.159147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.317141+0000","last_change":"2024-03-20T13:37:17.369630+0000","last_active":"2024-03-20T13:37:21.317141+0000","last_peered":"2024-03-20T13:37:21.317141+0000","last_clean":"2024-03-20T13:37:21.317141+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:37:21.317141+0000","last_undegraded":"2024-03-20T13:37:21.317141+0000","last_fullsized":"2024-03-20T13:37:21.317141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609571+0000","last_change":"2024-03-20T13:36:36.831557+0000","last_active":"2024-03-20T13:38:22.609571+0000","last_peered":"2024-03-20T13:38:22.609571+0000","last_clean":"2024-03-20T13:38:22.609571+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:38:22.609571+0000","last_undegraded":"2024-03-20T13:38:22.609571+0000","last_fullsized":"2024-03-20T13:38:22.609571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159297+0000","last_change":"2024-03-20T13:36:38.829272+0000","last_active":"2024-03-20T13:38:22.159297+0000","last_peered":"2024-03-20T13:38:22.159297+0000","last_clean":"2024-03-20T13:38:22.159297+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:38:22.159297+0000","last_undegraded":"2024-03-20T13:38:22.159297+0000","last_fullsized":"2024-03-20T13:38:22.159297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542549+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:38:23.542549+0000","last_peered":"2024-03-20T13:38:23.542549+0000","last_clean":"2024-03-20T13:38:23.542549+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:38:23.542549+0000","last_undegraded":"2024-03-20T13:38:23.542549+0000","last_fullsized":"2024-03-20T13:38:23.542549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.783804+0000","last_change":"2024-03-20T13:37:17.354371+0000","last_active":"2024-03-20T13:37:21.783804+0000","last_peered":"2024-03-20T13:37:21.783804+0000","last_clean":"2024-03-20T13:37:21.783804+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:37:21.783804+0000","last_undegraded":"2024-03-20T13:37:21.783804+0000","last_fullsized":"2024-03-20T13:37:21.783804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542421+0000","last_change":"2024-03-20T13:36:36.848902+0000","last_active":"2024-03-20T13:38:23.542421+0000","last_peered":"2024-03-20T13:38:23.542421+0000","last_clean":"2024-03-20T13:38:23.542421+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:38:23.542421+0000","last_undegraded":"2024-03-20T13:38:23.542421+0000","last_fullsized":"2024-03-20T13:38:23.542421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.492407+0000","last_change":"2024-03-20T13:38:50.492407+0000","last_active":"2024-03-20T13:38:50.492407+0000","last_peered":"2024-03-20T13:38:50.492407+0000","last_clean":"2024-03-20T13:38:50.492407+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:38:50.492407+0000","last_undegraded":"2024-03-20T13:38:50.492407+0000","last_fullsized":"2024-03-20T13:38:50.492407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:50.492146+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:50.492146+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.492146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:27:39.693616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.681515+0000","last_change":"2024-03-20T13:38:55.681515+0000","last_active":"2024-03-20T13:38:55.681515+0000","last_peered":"2024-03-20T13:38:55.681515+0000","last_clean":"2024-03-20T13:38:55.681515+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:38:55.681515+0000","last_undegraded":"2024-03-20T13:38:55.681515+0000","last_fullsized":"2024-03-20T13:38:55.681515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:55.681247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:55.681247+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.681247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:45.489248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159444+0000","last_change":"2024-03-20T13:36:38.828728+0000","last_active":"2024-03-20T13:38:22.159444+0000","last_peered":"2024-03-20T13:38:22.159444+0000","last_clean":"2024-03-20T13:38:22.159444+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:38:22.159444+0000","last_undegraded":"2024-03-20T13:38:22.159444+0000","last_fullsized":"2024-03-20T13:38:22.159444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542537+0000","last_change":"2024-03-20T13:36:36.846419+0000","last_active":"2024-03-20T13:38:23.542537+0000","last_peered":"2024-03-20T13:38:23.542537+0000","last_clean":"2024-03-20T13:38:23.542537+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:38:23.542537+0000","last_undegraded":"2024-03-20T13:38:23.542537+0000","last_fullsized":"2024-03-20T13:38:23.542537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158985+0000","last_change":"2024-03-20T13:36:36.834343+0000","last_active":"2024-03-20T13:38:22.158985+0000","last_peered":"2024-03-20T13:38:22.158985+0000","last_clean":"2024-03-20T13:38:22.158985+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:38:22.158985+0000","last_undegraded":"2024-03-20T13:38:22.158985+0000","last_fullsized":"2024-03-20T13:38:22.158985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.651608+0000","last_change":"2024-03-20T13:38:41.651777+0000","last_active":"2024-03-20T13:38:41.651608+0000","last_peered":"2024-03-20T13:38:41.651608+0000","last_clean":"2024-03-20T13:38:41.651608+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:38:41.651608+0000","last_undegraded":"2024-03-20T13:38:41.651608+0000","last_fullsized":"2024-03-20T13:38:41.651608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:41.651396+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:41.651396+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.651396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:02.659444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.609610+0000","last_change":"2024-03-20T13:36:36.833552+0000","last_active":"2024-03-20T13:38:22.609610+0000","last_peered":"2024-03-20T13:38:22.609610+0000","last_clean":"2024-03-20T13:38:22.609610+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:38:22.609610+0000","last_undegraded":"2024-03-20T13:38:22.609610+0000","last_fullsized":"2024-03-20T13:38:22.609610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.689998+0000","last_change":"2024-03-20T13:38:58.690058+0000","last_active":"2024-03-20T13:38:58.689998+0000","last_peered":"2024-03-20T13:38:58.689998+0000","last_clean":"2024-03-20T13:38:58.689998+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:38:58.689998+0000","last_undegraded":"2024-03-20T13:38:58.689998+0000","last_fullsized":"2024-03-20T13:38:58.689998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:58.689817+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:58.689817+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.689817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.319664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1416,"ondisk_log_size":1416,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672996,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38200000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64200000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.77300000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.71099999999999997}]},{"osd":2,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.89200000000000002,"5min":1.04,"15min":1.04},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71999999999999997,"5min":1.216,"15min":1.216},"last":0.51300000000000001}]}]},{"osd":2,"up_from":10,"seq":42949672997,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81100000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64100000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.224,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.25600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.746,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.75,"5min":1.145,"15min":1.145},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.315,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77500000000000002,"5min":1,"15min":1},"last":0.66400000000000003}]}]},{"osd":1,"up_from":10,"seq":42949672995,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.49099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79500000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71899999999999997}]},{"osd":2,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.71299999999999997,"5min":1.411,"15min":1.411},"last":0.60799999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.38500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85099999999999998,"5min":1.117,"15min":1.117},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.498}]}]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.77400000000000002}]},{"osd":2,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91500000000000004,"5min":1.161,"15min":1.161},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90600000000000003,"5min":1.052,"15min":1.052},"last":0.72299999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:39:04.744 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.744 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.744 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.744 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.744 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.745 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.745 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.745 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.745 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.745 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.746 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.746 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.746 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.746 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.746 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.747 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.747 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.747 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.747 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.747 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.748 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.748 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.748 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.748 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.748 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.748 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.749 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.749 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.749 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.749 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.749 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.750 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.750 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-20T13:36:39.802470+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=39, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.750 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.750 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.750 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.751 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.751 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.751 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.751 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.751 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.752 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.752 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.752 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.752 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-20T13:36:22.715062+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=22, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.752 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.753 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.753 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.753 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.753 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.753 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.754 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.754 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.754 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.754 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.754 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.755 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.755 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.755 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.755 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.755 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.756 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.756 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.756 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.756 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.756 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.756 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.757 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.757 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.757 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.757 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.757 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.758 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.758 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.758 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.758 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.759 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.759 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.759 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.759 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.759 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.760 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.760 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.760 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.760 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.760 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.761 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.761 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.761 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.761 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.761 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.761 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.762 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.762 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.762 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.762 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.762 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.763 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.763 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.763 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.763 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.763 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.764 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.764 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.764 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.764 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.764 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.764 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.765 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.765 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.765 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.765 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.765 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:04.765 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:39:24.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:39:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.894+0000 7f95701e7640 1 Processor -- start 2024-03-20T13:39:24.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.894+0000 7f95701e7640 1 -- start start 2024-03-20T13:39:24.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9568128d10 0x7f95681290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:24.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9568095ee0 con 0x7f956812bb20 2024-03-20T13:39:24.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9568095b30 con 0x7f9568128d10 2024-03-20T13:39:24.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956df83640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9568128d10 0x7f95681290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:24.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956d782640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f956812bb20 0x7f956812bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:38510/0 (socket says 172.21.15.89:38510) 2024-03-20T13:39:24.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956d782640 1 -- 172.21.15.89:0/2115462002 learned_addr learned my addr 172.21.15.89:0/2115462002 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:39:24.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956df83640 1 -- 172.21.15.89:0/2115462002 >> v1:172.21.15.89:6789/0 conn(0x7f956812bb20 legacy=0x7f956812bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:24.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956df83640 1 -- 172.21.15.89:0/2115462002 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568096320 con 0x7f9568128d10 2024-03-20T13:39:24.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956df83640 1 --2- 172.21.15.89:0/2115462002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681290f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9558009740 tx=0x7f955801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f39f2f42e31377 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:24.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956cf81640 1 -- 172.21.15.89:0/2115462002 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95580ab530 con 0x7f9568128d10 2024-03-20T13:39:24.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956cf81640 1 -- 172.21.15.89:0/2115462002 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95580a7050 con 0x7f9568128d10 2024-03-20T13:39:24.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f956cf81640 1 -- 172.21.15.89:0/2115462002 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95580ab7e0 con 0x7f9568128d10 2024-03-20T13:39:24.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 -- 172.21.15.89:0/2115462002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 msgr2=0x7f95681290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:24.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 --2- 172.21.15.89:0/2115462002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681290f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9558009740 tx=0x7f955801c400 comp rx=0 tx=0).stop 2024-03-20T13:39:24.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 -- 172.21.15.89:0/2115462002 shutdown_connections 2024-03-20T13:39:24.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 --2- 172.21.15.89:0/2115462002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681290f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:24.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.898+0000 7f95701e7640 1 -- 172.21.15.89:0/2115462002 >> 172.21.15.89:0/2115462002 conn(0x7f956809a2f0 msgr2=0x7f956809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:24.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- 172.21.15.89:0/2115462002 shutdown_connections 2024-03-20T13:39:24.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- 172.21.15.89:0/2115462002 wait complete. 2024-03-20T13:39:24.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 Processor -- start 2024-03-20T13:39:24.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- start start 2024-03-20T13:39:24.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:24.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568071970 con 0x7f9568128d10 2024-03-20T13:39:24.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f956df83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:24.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f956df83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59482/0 (socket says 172.21.15.89:59482) 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f956df83640 1 -- 172.21.15.89:0/3285590547 learned_addr learned my addr 172.21.15.89:0/3285590547 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f956df83640 1 -- 172.21.15.89:0/3285590547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558009420 con 0x7f9568128d10 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f956df83640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681c3ac0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f955801a030 tx=0x7f95580191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95580b4750 con 0x7f9568128d10 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95580a4e90 con 0x7f9568128d10 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956812cc70 con 0x7f9568128d10 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95580b49e0 con 0x7f9568128d10 2024-03-20T13:39:24.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9568071650 con 0x7f9568128d10 2024-03-20T13:39:24.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f95580b2040 con 0x7f9568128d10 2024-03-20T13:39:24.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9568067e00 con 0x7f9568128d10 2024-03-20T13:39:24.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f955e7fc640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f954c035a10 0x7f954c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:24.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f95580e2d80 con 0x7f9568128d10 2024-03-20T13:39:24.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.902+0000 7f956d782640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f954c035a10 0x7f954c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:24.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.906+0000 7f956d782640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f954c035a10 0x7f954c037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9564001610 tx=0x7f9564007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:24.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:24.910+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95580bc770 con 0x7f9568128d10 2024-03-20T13:39:25.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.062+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9568095170 con 0x7f954c035a10 2024-03-20T13:39:25.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.110+0000 7f955e7fc640 1 -- 172.21.15.89:0/3285590547 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672520 (secure 0 0 0) 0x7f9564001300 con 0x7f954c035a10 2024-03-20T13:39:25.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:39:25.125 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f954c035a10 msgr2=0x7f954c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f954c035a10 0x7f954c037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9564001610 tx=0x7f9564007ad0 comp rx=0 tx=0).stop 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 msgr2=0x7f95681c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681c3ac0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f955801a030 tx=0x7f95580191a0 comp rx=0 tx=0).stop 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 shutdown_connections 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7f954c035a10 0x7f954c037ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 --2- 172.21.15.89:0/3285590547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9568128d10 0x7f95681c3ac0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 >> 172.21.15.89:0/3285590547 conn(0x7f956809a2f0 msgr2=0x7f9568097170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 shutdown_connections 2024-03-20T13:39:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:25.114+0000 7f95701e7640 1 -- 172.21.15.89:0/3285590547 wait complete. 2024-03-20T13:39:25.135 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-03-20T13:39:24.356852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3999,"num_read_kb":3645,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1669,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3964,"ondisk_log_size":3964,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006717"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.320822+0000","last_change":"2024-03-20T13:39:07.320953+0000","last_active":"2024-03-20T13:39:07.320822+0000","last_peered":"2024-03-20T13:39:07.320822+0000","last_clean":"2024-03-20T13:39:07.320822+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:39:07.320822+0000","last_undegraded":"2024-03-20T13:39:07.320822+0000","last_fullsized":"2024-03-20T13:39:07.320822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:07.320546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:07.320546+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.320546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:11:48.938365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.364209+0000","last_change":"2024-03-20T13:38:54.364209+0000","last_active":"2024-03-20T13:38:54.364209+0000","last_peered":"2024-03-20T13:38:54.364209+0000","last_clean":"2024-03-20T13:38:54.364209+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:38:54.364209+0000","last_undegraded":"2024-03-20T13:38:54.364209+0000","last_fullsized":"2024-03-20T13:38:54.364209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:54.363935+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:54.363935+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.363935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:52.089220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.643293+0000","last_change":"2024-03-20T13:38:57.643357+0000","last_active":"2024-03-20T13:38:57.643293+0000","last_peered":"2024-03-20T13:38:57.643293+0000","last_clean":"2024-03-20T13:38:57.643293+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:38:57.643293+0000","last_undegraded":"2024-03-20T13:38:57.643293+0000","last_fullsized":"2024-03-20T13:38:57.643293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:57.643105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:57.643105+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.643105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:47:16.939195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:19.401082+0000","last_change":"2024-03-20T13:39:19.401143+0000","last_active":"2024-03-20T13:39:19.401082+0000","last_peered":"2024-03-20T13:39:19.401082+0000","last_clean":"2024-03-20T13:39:19.401082+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:39:19.401082+0000","last_undegraded":"2024-03-20T13:39:19.401082+0000","last_fullsized":"2024-03-20T13:39:19.401082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:19.400889+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:19.400889+0000","last_clean_scrub_stamp":"2024-03-20T13:39:19.400889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:42.035375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.494645+0000","last_change":"2024-03-20T13:39:06.494706+0000","last_active":"2024-03-20T13:39:06.494645+0000","last_peered":"2024-03-20T13:39:06.494645+0000","last_clean":"2024-03-20T13:39:06.494645+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:39:06.494645+0000","last_undegraded":"2024-03-20T13:39:06.494645+0000","last_fullsized":"2024-03-20T13:39:06.494645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:06.494452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:06.494452+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.494452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:40:20.307756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'13","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.543265+0000","last_change":"2024-03-20T13:36:38.818446+0000","last_active":"2024-03-20T13:38:23.543265+0000","last_peered":"2024-03-20T13:38:23.543265+0000","last_clean":"2024-03-20T13:38:23.543265+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:38:23.543265+0000","last_undegraded":"2024-03-20T13:38:23.543265+0000","last_fullsized":"2024-03-20T13:38:23.543265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.788403+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.788403+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.643201+0000","last_change":"2024-03-20T13:39:00.643262+0000","last_active":"2024-03-20T13:39:00.643201+0000","last_peered":"2024-03-20T13:39:00.643201+0000","last_clean":"2024-03-20T13:39:00.643201+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:39:00.643201+0000","last_undegraded":"2024-03-20T13:39:00.643201+0000","last_fullsized":"2024-03-20T13:39:00.643201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.643010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.643010+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.643010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:32:09.489594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.517649+0000","last_change":"2024-03-20T13:39:04.517649+0000","last_active":"2024-03-20T13:39:04.517649+0000","last_peered":"2024-03-20T13:39:04.517649+0000","last_clean":"2024-03-20T13:39:04.517649+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:39:04.517649+0000","last_undegraded":"2024-03-20T13:39:04.517649+0000","last_fullsized":"2024-03-20T13:39:04.517649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:04.517405+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:04.517405+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.517405+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:58.353894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159232+0000","last_change":"2024-03-20T13:36:36.819273+0000","last_active":"2024-03-20T13:38:22.159232+0000","last_peered":"2024-03-20T13:38:22.159232+0000","last_clean":"2024-03-20T13:38:22.159232+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:38:22.159232+0000","last_undegraded":"2024-03-20T13:38:22.159232+0000","last_fullsized":"2024-03-20T13:38:22.159232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.630024+0000","last_change":"2024-03-20T13:38:45.630090+0000","last_active":"2024-03-20T13:38:45.630024+0000","last_peered":"2024-03-20T13:38:45.630024+0000","last_clean":"2024-03-20T13:38:45.630024+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:45.630024+0000","last_undegraded":"2024-03-20T13:38:45.630024+0000","last_fullsized":"2024-03-20T13:38:45.630024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:45.629830+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:45.629830+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.629830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:36.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159269+0000","last_change":"2024-03-20T13:36:36.844434+0000","last_active":"2024-03-20T13:38:22.159269+0000","last_peered":"2024-03-20T13:38:22.159269+0000","last_clean":"2024-03-20T13:38:22.159269+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:38:22.159269+0000","last_undegraded":"2024-03-20T13:38:22.159269+0000","last_fullsized":"2024-03-20T13:38:22.159269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.360390+0000","last_change":"2024-03-20T13:38:34.360390+0000","last_active":"2024-03-20T13:38:34.360390+0000","last_peered":"2024-03-20T13:38:34.360390+0000","last_clean":"2024-03-20T13:38:34.360390+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:38:34.360390+0000","last_undegraded":"2024-03-20T13:38:34.360390+0000","last_fullsized":"2024-03-20T13:38:34.360390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.360106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:40.327388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:14.384893+0000","last_change":"2024-03-20T13:39:14.384951+0000","last_active":"2024-03-20T13:39:14.384893+0000","last_peered":"2024-03-20T13:39:14.384893+0000","last_clean":"2024-03-20T13:39:14.384893+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:39:14.384893+0000","last_undegraded":"2024-03-20T13:39:14.384893+0000","last_fullsized":"2024-03-20T13:39:14.384893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:14.384687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:14.384687+0000","last_clean_scrub_stamp":"2024-03-20T13:39:14.384687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:54.805823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.360463+0000","last_change":"2024-03-20T13:38:50.360616+0000","last_active":"2024-03-20T13:38:50.360463+0000","last_peered":"2024-03-20T13:38:50.360463+0000","last_clean":"2024-03-20T13:38:50.360463+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:38:50.360463+0000","last_undegraded":"2024-03-20T13:38:50.360463+0000","last_fullsized":"2024-03-20T13:38:50.360463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:50.360249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:50.360249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.360249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:27:20.207773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542614+0000","last_change":"2024-03-20T13:36:36.842199+0000","last_active":"2024-03-20T13:38:23.542614+0000","last_peered":"2024-03-20T13:38:23.542614+0000","last_clean":"2024-03-20T13:38:23.542614+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:38:23.542614+0000","last_undegraded":"2024-03-20T13:38:23.542614+0000","last_fullsized":"2024-03-20T13:38:23.542614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.671921+0000","last_change":"2024-03-20T13:38:42.671921+0000","last_active":"2024-03-20T13:38:42.671921+0000","last_peered":"2024-03-20T13:38:42.671921+0000","last_clean":"2024-03-20T13:38:42.671921+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:42.671921+0000","last_undegraded":"2024-03-20T13:38:42.671921+0000","last_fullsized":"2024-03-20T13:38:42.671921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:42.671660+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:42.671660+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.671660+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:41.237314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.372430+0000","last_change":"2024-03-20T13:38:55.372430+0000","last_active":"2024-03-20T13:38:55.372430+0000","last_peered":"2024-03-20T13:38:55.372430+0000","last_clean":"2024-03-20T13:38:55.372430+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:38:55.372430+0000","last_undegraded":"2024-03-20T13:38:55.372430+0000","last_fullsized":"2024-03-20T13:38:55.372430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:55.372162+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:55.372162+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.372162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:52:41.165170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.799786+0000","last_change":"2024-03-20T13:39:11.799949+0000","last_active":"2024-03-20T13:39:11.799786+0000","last_peered":"2024-03-20T13:39:11.799786+0000","last_clean":"2024-03-20T13:39:11.799786+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:39:11.799786+0000","last_undegraded":"2024-03-20T13:39:11.799786+0000","last_fullsized":"2024-03-20T13:39:11.799786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:11.799562+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:11.799562+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.799562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:41:52.919604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.356156+0000","last_change":"2024-03-20T13:38:51.356156+0000","last_active":"2024-03-20T13:38:51.356156+0000","last_peered":"2024-03-20T13:38:51.356156+0000","last_clean":"2024-03-20T13:38:51.356156+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:51.356156+0000","last_undegraded":"2024-03-20T13:38:51.356156+0000","last_fullsized":"2024-03-20T13:38:51.356156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-03-20T13:38:51.355757+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-03-20T13:38:51.355757+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.355757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:23:00.937432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.602289+0000","last_change":"2024-03-20T13:39:03.602350+0000","last_active":"2024-03-20T13:39:03.602289+0000","last_peered":"2024-03-20T13:39:03.602289+0000","last_clean":"2024-03-20T13:39:03.602289+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:39:03.602289+0000","last_undegraded":"2024-03-20T13:39:03.602289+0000","last_fullsized":"2024-03-20T13:39:03.602289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:03.602063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:03.602063+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.602063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:48.843570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.340213+0000","last_change":"2024-03-20T13:38:59.340213+0000","last_active":"2024-03-20T13:38:59.340213+0000","last_peered":"2024-03-20T13:38:59.340213+0000","last_clean":"2024-03-20T13:38:59.340213+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:59.340213+0000","last_undegraded":"2024-03-20T13:38:59.340213+0000","last_fullsized":"2024-03-20T13:38:59.340213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:59.339924+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:59.339924+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.339924+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:35.663825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:19.460014+0000","last_change":"2024-03-20T13:39:19.460074+0000","last_active":"2024-03-20T13:39:19.460014+0000","last_peered":"2024-03-20T13:39:19.460014+0000","last_clean":"2024-03-20T13:39:19.460014+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:39:19.460014+0000","last_undegraded":"2024-03-20T13:39:19.460014+0000","last_fullsized":"2024-03-20T13:39:19.460014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:19.459815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:19.459815+0000","last_clean_scrub_stamp":"2024-03-20T13:39:19.459815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:50:10.380187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.705994+0000","last_change":"2024-03-20T13:38:43.705994+0000","last_active":"2024-03-20T13:38:43.705994+0000","last_peered":"2024-03-20T13:38:43.705994+0000","last_clean":"2024-03-20T13:38:43.705994+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:43.705994+0000","last_undegraded":"2024-03-20T13:38:43.705994+0000","last_fullsized":"2024-03-20T13:38:43.705994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:43.705585+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:43.705585+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.705585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:47.485233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:16.407887+0000","last_change":"2024-03-20T13:39:16.407955+0000","last_active":"2024-03-20T13:39:16.407887+0000","last_peered":"2024-03-20T13:39:16.407887+0000","last_clean":"2024-03-20T13:39:16.407887+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:39:16.407887+0000","last_undegraded":"2024-03-20T13:39:16.407887+0000","last_fullsized":"2024-03-20T13:39:16.407887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:16.407685+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:16.407685+0000","last_clean_scrub_stamp":"2024-03-20T13:39:16.407685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:55:21.630434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.808048+0000","last_change":"2024-03-20T13:38:51.808048+0000","last_active":"2024-03-20T13:38:51.808048+0000","last_peered":"2024-03-20T13:38:51.808048+0000","last_clean":"2024-03-20T13:38:51.808048+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:38:51.808048+0000","last_undegraded":"2024-03-20T13:38:51.808048+0000","last_fullsized":"2024-03-20T13:38:51.808048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:51.807795+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:51.807795+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.807795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:46.641091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542593+0000","last_change":"2024-03-20T13:36:36.840923+0000","last_active":"2024-03-20T13:38:23.542593+0000","last_peered":"2024-03-20T13:38:23.542593+0000","last_clean":"2024-03-20T13:38:23.542593+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:38:23.542593+0000","last_undegraded":"2024-03-20T13:38:23.542593+0000","last_fullsized":"2024-03-20T13:38:23.542593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.639520+0000","last_change":"2024-03-20T13:38:53.639520+0000","last_active":"2024-03-20T13:38:53.639520+0000","last_peered":"2024-03-20T13:38:53.639520+0000","last_clean":"2024-03-20T13:38:53.639520+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:38:53.639520+0000","last_undegraded":"2024-03-20T13:38:53.639520+0000","last_fullsized":"2024-03-20T13:38:53.639520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:53.639272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:53.639272+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.639272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:06:35.620794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.503762+0000","last_change":"2024-03-20T13:39:05.503823+0000","last_active":"2024-03-20T13:39:05.503762+0000","last_peered":"2024-03-20T13:39:05.503762+0000","last_clean":"2024-03-20T13:39:05.503762+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:39:05.503762+0000","last_undegraded":"2024-03-20T13:39:05.503762+0000","last_fullsized":"2024-03-20T13:39:05.503762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:05.503557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:05.503557+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.503557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:14:42.256100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'17","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611662+0000","last_change":"2024-03-20T13:36:46.887548+0000","last_active":"2024-03-20T13:38:22.611662+0000","last_peered":"2024-03-20T13:38:22.611662+0000","last_clean":"2024-03-20T13:38:22.611662+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:38:22.611662+0000","last_undegraded":"2024-03-20T13:38:22.611662+0000","last_fullsized":"2024-03-20T13:38:22.611662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.524991+0000","last_change":"2024-03-20T13:38:57.524991+0000","last_active":"2024-03-20T13:38:57.524991+0000","last_peered":"2024-03-20T13:38:57.524991+0000","last_clean":"2024-03-20T13:38:57.524991+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:57.524991+0000","last_undegraded":"2024-03-20T13:38:57.524991+0000","last_fullsized":"2024-03-20T13:38:57.524991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:57.524736+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:57.524736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.524736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:02:53.826364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.411023+0000","last_change":"2024-03-20T13:39:08.411088+0000","last_active":"2024-03-20T13:39:08.411023+0000","last_peered":"2024-03-20T13:39:08.411023+0000","last_clean":"2024-03-20T13:39:08.411023+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:39:08.411023+0000","last_undegraded":"2024-03-20T13:39:08.411023+0000","last_fullsized":"2024-03-20T13:39:08.411023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:08.410818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:08.410818+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.410818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:28.681674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.524488+0000","last_change":"2024-03-20T13:38:45.524488+0000","last_active":"2024-03-20T13:38:45.524488+0000","last_peered":"2024-03-20T13:38:45.524488+0000","last_clean":"2024-03-20T13:38:45.524488+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:38:45.524488+0000","last_undegraded":"2024-03-20T13:38:45.524488+0000","last_fullsized":"2024-03-20T13:38:45.524488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:45.524251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:45.524251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.524251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:26:46.932589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.636370+0000","last_change":"2024-03-20T13:38:27.636370+0000","last_active":"2024-03-20T13:38:27.636370+0000","last_peered":"2024-03-20T13:38:27.636370+0000","last_clean":"2024-03-20T13:38:27.636370+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:27.636370+0000","last_undegraded":"2024-03-20T13:38:27.636370+0000","last_fullsized":"2024-03-20T13:38:27.636370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.636107+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:56.436080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.395264+0000","last_change":"2024-03-20T13:38:45.395264+0000","last_active":"2024-03-20T13:38:45.395264+0000","last_peered":"2024-03-20T13:38:45.395264+0000","last_clean":"2024-03-20T13:38:45.395264+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:38:45.395264+0000","last_undegraded":"2024-03-20T13:38:45.395264+0000","last_fullsized":"2024-03-20T13:38:45.395264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:45.395019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:45.395019+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.395019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:25.417312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160906+0000","last_change":"2024-03-20T13:36:46.880848+0000","last_active":"2024-03-20T13:38:22.160906+0000","last_peered":"2024-03-20T13:38:22.160906+0000","last_clean":"2024-03-20T13:38:22.160906+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:38:22.160906+0000","last_undegraded":"2024-03-20T13:38:22.160906+0000","last_fullsized":"2024-03-20T13:38:22.160906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.491387+0000","last_change":"2024-03-20T13:39:02.491387+0000","last_active":"2024-03-20T13:39:02.491387+0000","last_peered":"2024-03-20T13:39:02.491387+0000","last_clean":"2024-03-20T13:39:02.491387+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:39:02.491387+0000","last_undegraded":"2024-03-20T13:39:02.491387+0000","last_fullsized":"2024-03-20T13:39:02.491387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:02.491130+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:02.491130+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.491130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:00.648488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.617934+0000","last_change":"2024-03-20T13:39:02.618003+0000","last_active":"2024-03-20T13:39:02.617934+0000","last_peered":"2024-03-20T13:39:02.617934+0000","last_clean":"2024-03-20T13:39:02.617934+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:39:02.617934+0000","last_undegraded":"2024-03-20T13:39:02.617934+0000","last_fullsized":"2024-03-20T13:39:02.617934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:02.617744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:02.617744+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.617744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:16:04.583938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.609801+0000","last_change":"2024-03-20T13:38:28.609801+0000","last_active":"2024-03-20T13:38:28.609801+0000","last_peered":"2024-03-20T13:38:28.609801+0000","last_clean":"2024-03-20T13:38:28.609801+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:38:28.609801+0000","last_undegraded":"2024-03-20T13:38:28.609801+0000","last_fullsized":"2024-03-20T13:38:28.609801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.609546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.417547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.498376+0000","last_change":"2024-03-20T13:38:32.498376+0000","last_active":"2024-03-20T13:38:32.498376+0000","last_peered":"2024-03-20T13:38:32.498376+0000","last_clean":"2024-03-20T13:38:32.498376+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:38:32.498376+0000","last_undegraded":"2024-03-20T13:38:32.498376+0000","last_fullsized":"2024-03-20T13:38:32.498376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.497987+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:26.085583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160645+0000","last_change":"2024-03-20T13:36:44.879906+0000","last_active":"2024-03-20T13:38:22.160645+0000","last_peered":"2024-03-20T13:38:22.160645+0000","last_clean":"2024-03-20T13:38:22.160645+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:38:22.160645+0000","last_undegraded":"2024-03-20T13:38:22.160645+0000","last_fullsized":"2024-03-20T13:38:22.160645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.836514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.836514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544885+0000","last_change":"2024-03-20T13:36:46.897472+0000","last_active":"2024-03-20T13:38:23.544885+0000","last_peered":"2024-03-20T13:38:23.544885+0000","last_clean":"2024-03-20T13:38:23.544885+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:38:23.544885+0000","last_undegraded":"2024-03-20T13:38:23.544885+0000","last_fullsized":"2024-03-20T13:38:23.544885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.618703+0000","last_change":"2024-03-20T13:39:07.618761+0000","last_active":"2024-03-20T13:39:07.618703+0000","last_peered":"2024-03-20T13:39:07.618703+0000","last_clean":"2024-03-20T13:39:07.618703+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:39:07.618703+0000","last_undegraded":"2024-03-20T13:39:07.618703+0000","last_fullsized":"2024-03-20T13:39:07.618703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:07.618500+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:07.618500+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.618500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:57.842801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:18.440356+0000","last_change":"2024-03-20T13:39:18.440426+0000","last_active":"2024-03-20T13:39:18.440356+0000","last_peered":"2024-03-20T13:39:18.440356+0000","last_clean":"2024-03-20T13:39:18.440356+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:39:18.440356+0000","last_undegraded":"2024-03-20T13:39:18.440356+0000","last_fullsized":"2024-03-20T13:39:18.440356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:18.440145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:18.440145+0000","last_clean_scrub_stamp":"2024-03-20T13:39:18.440145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:41.074631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.622403+0000","last_change":"2024-03-20T13:38:32.622403+0000","last_active":"2024-03-20T13:38:32.622403+0000","last_peered":"2024-03-20T13:38:32.622403+0000","last_clean":"2024-03-20T13:38:32.622403+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:38:32.622403+0000","last_undegraded":"2024-03-20T13:38:32.622403+0000","last_fullsized":"2024-03-20T13:38:32.622403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.622043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:44.229800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.562204+0000","last_change":"2024-03-20T13:38:35.562204+0000","last_active":"2024-03-20T13:38:35.562204+0000","last_peered":"2024-03-20T13:38:35.562204+0000","last_clean":"2024-03-20T13:38:35.562204+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:38:35.562204+0000","last_undegraded":"2024-03-20T13:38:35.562204+0000","last_fullsized":"2024-03-20T13:38:35.562204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.561937+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:38:29.683966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'244","reported_seq":319,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.361559+0000","last_change":"2024-03-20T13:39:01.361559+0000","last_active":"2024-03-20T13:39:01.361559+0000","last_peered":"2024-03-20T13:39:01.361559+0000","last_clean":"2024-03-20T13:39:01.361559+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:39:01.361559+0000","last_undegraded":"2024-03-20T13:39:01.361559+0000","last_fullsized":"2024-03-20T13:39:01.361559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:39:01.361304+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:39:01.361304+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.361304+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:44:02.036320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.559533+0000","last_change":"2024-03-20T13:38:26.559533+0000","last_active":"2024-03-20T13:38:26.559533+0000","last_peered":"2024-03-20T13:38:26.559533+0000","last_clean":"2024-03-20T13:38:26.559533+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:38:26.559533+0000","last_undegraded":"2024-03-20T13:38:26.559533+0000","last_fullsized":"2024-03-20T13:38:26.559533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.559287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:27.493448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.465561+0000","last_change":"2024-03-20T13:38:53.465561+0000","last_active":"2024-03-20T13:38:53.465561+0000","last_peered":"2024-03-20T13:38:53.465561+0000","last_clean":"2024-03-20T13:38:53.465561+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:38:53.465561+0000","last_undegraded":"2024-03-20T13:38:53.465561+0000","last_fullsized":"2024-03-20T13:38:53.465561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:53.465309+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:53.465309+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.465309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:44.165890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:15.440189+0000","last_change":"2024-03-20T13:39:15.440247+0000","last_active":"2024-03-20T13:39:15.440189+0000","last_peered":"2024-03-20T13:39:15.440189+0000","last_clean":"2024-03-20T13:39:15.440189+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:39:15.440189+0000","last_undegraded":"2024-03-20T13:39:15.440189+0000","last_fullsized":"2024-03-20T13:39:15.440189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:15.439987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:15.439987+0000","last_clean_scrub_stamp":"2024-03-20T13:39:15.439987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:50:31.971326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.433031+0000","last_change":"2024-03-20T13:38:25.433031+0000","last_active":"2024-03-20T13:38:25.433031+0000","last_peered":"2024-03-20T13:38:25.433031+0000","last_clean":"2024-03-20T13:38:25.433031+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:38:25.433031+0000","last_undegraded":"2024-03-20T13:38:25.433031+0000","last_fullsized":"2024-03-20T13:38:25.433031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.432781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:35.180635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.346225+0000","last_change":"2024-03-20T13:38:42.346225+0000","last_active":"2024-03-20T13:38:42.346225+0000","last_peered":"2024-03-20T13:38:42.346225+0000","last_clean":"2024-03-20T13:38:42.346225+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:42.346225+0000","last_undegraded":"2024-03-20T13:38:42.346225+0000","last_fullsized":"2024-03-20T13:38:42.346225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:42.345943+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:42.345943+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.345943+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:35:22.378243+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'243","reported_seq":332,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.606212+0000","last_change":"2024-03-20T13:38:39.606212+0000","last_active":"2024-03-20T13:38:39.606212+0000","last_peered":"2024-03-20T13:38:39.606212+0000","last_clean":"2024-03-20T13:38:39.606212+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:39.606212+0000","last_undegraded":"2024-03-20T13:38:39.606212+0000","last_fullsized":"2024-03-20T13:38:39.606212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.605847+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:06:01.030174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.644018+0000","last_change":"2024-03-20T13:39:09.644074+0000","last_active":"2024-03-20T13:39:09.644018+0000","last_peered":"2024-03-20T13:39:09.644018+0000","last_clean":"2024-03-20T13:39:09.644018+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:39:09.644018+0000","last_undegraded":"2024-03-20T13:39:09.644018+0000","last_fullsized":"2024-03-20T13:39:09.644018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:09.643830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:09.643830+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.643830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:43:06.500277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.279257+0000","last_change":"2024-03-20T13:39:10.279325+0000","last_active":"2024-03-20T13:39:10.279257+0000","last_peered":"2024-03-20T13:39:10.279257+0000","last_clean":"2024-03-20T13:39:10.279257+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:39:10.279257+0000","last_undegraded":"2024-03-20T13:39:10.279257+0000","last_fullsized":"2024-03-20T13:39:10.279257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:10.279059+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:10.279059+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.279059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:38:22.275993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.529826+0000","last_change":"2024-03-20T13:38:33.529826+0000","last_active":"2024-03-20T13:38:33.529826+0000","last_peered":"2024-03-20T13:38:33.529826+0000","last_clean":"2024-03-20T13:38:33.529826+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:38:33.529826+0000","last_undegraded":"2024-03-20T13:38:33.529826+0000","last_fullsized":"2024-03-20T13:38:33.529826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.529572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:40.945003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.281180+0000","last_change":"2024-03-20T13:38:39.281180+0000","last_active":"2024-03-20T13:38:39.281180+0000","last_peered":"2024-03-20T13:38:39.281180+0000","last_clean":"2024-03-20T13:38:39.281180+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:39.281180+0000","last_undegraded":"2024-03-20T13:38:39.281180+0000","last_fullsized":"2024-03-20T13:38:39.281180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.281001+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:54.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.650522+0000","last_change":"2024-03-20T13:38:24.650522+0000","last_active":"2024-03-20T13:38:24.650522+0000","last_peered":"2024-03-20T13:38:24.650522+0000","last_clean":"2024-03-20T13:38:24.650522+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:38:24.650522+0000","last_undegraded":"2024-03-20T13:38:24.650522+0000","last_fullsized":"2024-03-20T13:38:24.650522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.650271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:30:43.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.539249+0000","last_change":"2024-03-20T13:38:34.539249+0000","last_active":"2024-03-20T13:38:34.539249+0000","last_peered":"2024-03-20T13:38:34.539249+0000","last_clean":"2024-03-20T13:38:34.539249+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:34.539249+0000","last_undegraded":"2024-03-20T13:38:34.539249+0000","last_fullsized":"2024-03-20T13:38:34.539249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.539008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:16:31.372326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.662171+0000","last_change":"2024-03-20T13:39:02.662251+0000","last_active":"2024-03-20T13:39:02.662171+0000","last_peered":"2024-03-20T13:39:02.662171+0000","last_clean":"2024-03-20T13:39:02.662171+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:39:02.662171+0000","last_undegraded":"2024-03-20T13:39:02.662171+0000","last_fullsized":"2024-03-20T13:39:02.662171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:02.661970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:02.661970+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.661970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:08.226754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:17.397465+0000","last_change":"2024-03-20T13:39:17.397526+0000","last_active":"2024-03-20T13:39:17.397465+0000","last_peered":"2024-03-20T13:39:17.397465+0000","last_clean":"2024-03-20T13:39:17.397465+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:39:17.397465+0000","last_undegraded":"2024-03-20T13:39:17.397465+0000","last_fullsized":"2024-03-20T13:39:17.397465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:17.397257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:17.397257+0000","last_clean_scrub_stamp":"2024-03-20T13:39:17.397257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:52:12.571149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.584967+0000","last_change":"2024-03-20T13:38:37.584967+0000","last_active":"2024-03-20T13:38:37.584967+0000","last_peered":"2024-03-20T13:38:37.584967+0000","last_clean":"2024-03-20T13:38:37.584967+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:38:37.584967+0000","last_undegraded":"2024-03-20T13:38:37.584967+0000","last_fullsized":"2024-03-20T13:38:37.584967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.584698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:47:36.547057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.690450+0000","last_change":"2024-03-20T13:38:24.690450+0000","last_active":"2024-03-20T13:38:24.690450+0000","last_peered":"2024-03-20T13:38:24.690450+0000","last_clean":"2024-03-20T13:38:24.690450+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:24.690450+0000","last_undegraded":"2024-03-20T13:38:24.690450+0000","last_fullsized":"2024-03-20T13:38:24.690450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.690100+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:03.686066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.585659+0000","last_change":"2024-03-20T13:38:34.585659+0000","last_active":"2024-03-20T13:38:34.585659+0000","last_peered":"2024-03-20T13:38:34.585659+0000","last_clean":"2024-03-20T13:38:34.585659+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:38:34.585659+0000","last_undegraded":"2024-03-20T13:38:34.585659+0000","last_fullsized":"2024-03-20T13:38:34.585659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.585283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.364588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.588729+0000","last_change":"2024-03-20T13:38:50.588729+0000","last_active":"2024-03-20T13:38:50.588729+0000","last_peered":"2024-03-20T13:38:50.588729+0000","last_clean":"2024-03-20T13:38:50.588729+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:38:50.588729+0000","last_undegraded":"2024-03-20T13:38:50.588729+0000","last_fullsized":"2024-03-20T13:38:50.588729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:50.588446+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:50.588446+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.588446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:39.899285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.342383+0000","last_change":"2024-03-20T13:39:06.342446+0000","last_active":"2024-03-20T13:39:06.342383+0000","last_peered":"2024-03-20T13:39:06.342383+0000","last_clean":"2024-03-20T13:39:06.342383+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:39:06.342383+0000","last_undegraded":"2024-03-20T13:39:06.342383+0000","last_fullsized":"2024-03-20T13:39:06.342383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:06.342189+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:06.342189+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.342189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:33.802784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:14.395514+0000","last_change":"2024-03-20T13:39:14.395576+0000","last_active":"2024-03-20T13:39:14.395514+0000","last_peered":"2024-03-20T13:39:14.395514+0000","last_clean":"2024-03-20T13:39:14.395514+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:39:14.395514+0000","last_undegraded":"2024-03-20T13:39:14.395514+0000","last_fullsized":"2024-03-20T13:39:14.395514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:14.395315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:14.395315+0000","last_clean_scrub_stamp":"2024-03-20T13:39:14.395315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:50:59.100686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.649892+0000","last_change":"2024-03-20T13:39:04.649946+0000","last_active":"2024-03-20T13:39:04.649892+0000","last_peered":"2024-03-20T13:39:04.649892+0000","last_clean":"2024-03-20T13:39:04.649892+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:39:04.649892+0000","last_undegraded":"2024-03-20T13:39:04.649892+0000","last_fullsized":"2024-03-20T13:39:04.649892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:04.649707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:04.649707+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.649707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:16:10.097795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.435258+0000","last_change":"2024-03-20T13:38:27.435258+0000","last_active":"2024-03-20T13:38:27.435258+0000","last_peered":"2024-03-20T13:38:27.435258+0000","last_clean":"2024-03-20T13:38:27.435258+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:27.435258+0000","last_undegraded":"2024-03-20T13:38:27.435258+0000","last_fullsized":"2024-03-20T13:38:27.435258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.434963+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:19.183364+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'243","reported_seq":297,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.518877+0000","last_change":"2024-03-20T13:38:24.518877+0000","last_active":"2024-03-20T13:38:24.518877+0000","last_peered":"2024-03-20T13:38:24.518877+0000","last_clean":"2024-03-20T13:38:24.518877+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:24.518877+0000","last_undegraded":"2024-03-20T13:38:24.518877+0000","last_fullsized":"2024-03-20T13:38:24.518877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.518629+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:39.808004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611264+0000","last_change":"2024-03-20T13:36:46.891435+0000","last_active":"2024-03-20T13:38:22.611264+0000","last_peered":"2024-03-20T13:38:22.611264+0000","last_clean":"2024-03-20T13:38:22.611264+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:38:22.611264+0000","last_undegraded":"2024-03-20T13:38:22.611264+0000","last_fullsized":"2024-03-20T13:38:22.611264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.772126+0000","last_change":"2024-03-20T13:38:46.772126+0000","last_active":"2024-03-20T13:38:46.772126+0000","last_peered":"2024-03-20T13:38:46.772126+0000","last_clean":"2024-03-20T13:38:46.772126+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:46.772126+0000","last_undegraded":"2024-03-20T13:38:46.772126+0000","last_fullsized":"2024-03-20T13:38:46.772126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:46.771877+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:46.771877+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.771877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:57:20.852991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158887+0000","last_change":"2024-03-20T13:36:36.823451+0000","last_active":"2024-03-20T13:38:22.158887+0000","last_peered":"2024-03-20T13:38:22.158887+0000","last_clean":"2024-03-20T13:38:22.158887+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:38:22.158887+0000","last_undegraded":"2024-03-20T13:38:22.158887+0000","last_fullsized":"2024-03-20T13:38:22.158887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.698820+0000","last_change":"2024-03-20T13:38:54.698871+0000","last_active":"2024-03-20T13:38:54.698820+0000","last_peered":"2024-03-20T13:38:54.698820+0000","last_clean":"2024-03-20T13:38:54.698820+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:38:54.698820+0000","last_undegraded":"2024-03-20T13:38:54.698820+0000","last_fullsized":"2024-03-20T13:38:54.698820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:54.698621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:54.698621+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.698621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:12:23.498595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'59","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.623377+0000","last_change":"2024-03-20T13:38:38.623377+0000","last_active":"2024-03-20T13:38:38.623377+0000","last_peered":"2024-03-20T13:38:38.623377+0000","last_clean":"2024-03-20T13:38:38.623377+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:38.623377+0000","last_undegraded":"2024-03-20T13:38:38.623377+0000","last_fullsized":"2024-03-20T13:38:38.623377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.623108+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:30.447395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.535665+0000","last_change":"2024-03-20T13:38:31.535665+0000","last_active":"2024-03-20T13:38:31.535665+0000","last_peered":"2024-03-20T13:38:31.535665+0000","last_clean":"2024-03-20T13:38:31.535665+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:38:31.535665+0000","last_undegraded":"2024-03-20T13:38:31.535665+0000","last_fullsized":"2024-03-20T13:38:31.535665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.535387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:13.731269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.610801+0000","last_change":"2024-03-20T13:38:54.610801+0000","last_active":"2024-03-20T13:38:54.610801+0000","last_peered":"2024-03-20T13:38:54.610801+0000","last_clean":"2024-03-20T13:38:54.610801+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:38:54.610801+0000","last_undegraded":"2024-03-20T13:38:54.610801+0000","last_fullsized":"2024-03-20T13:38:54.610801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:54.610460+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:54.610460+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.610460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:43.240773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.723534+0000","last_change":"2024-03-20T13:39:06.723620+0000","last_active":"2024-03-20T13:39:06.723534+0000","last_peered":"2024-03-20T13:39:06.723534+0000","last_clean":"2024-03-20T13:39:06.723534+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:39:06.723534+0000","last_undegraded":"2024-03-20T13:39:06.723534+0000","last_fullsized":"2024-03-20T13:39:06.723534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:06.723345+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:06.723345+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.723345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:27.618685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:18.400570+0000","last_change":"2024-03-20T13:39:18.400632+0000","last_active":"2024-03-20T13:39:18.400570+0000","last_peered":"2024-03-20T13:39:18.400570+0000","last_clean":"2024-03-20T13:39:18.400570+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:39:18.400570+0000","last_undegraded":"2024-03-20T13:39:18.400570+0000","last_fullsized":"2024-03-20T13:39:18.400570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:18.400372+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:18.400372+0000","last_clean_scrub_stamp":"2024-03-20T13:39:18.400372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:08:46.735844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.835816+0000","last_change":"2024-03-20T13:38:50.835816+0000","last_active":"2024-03-20T13:38:50.835816+0000","last_peered":"2024-03-20T13:38:50.835816+0000","last_clean":"2024-03-20T13:38:50.835816+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:38:50.835816+0000","last_undegraded":"2024-03-20T13:38:50.835816+0000","last_fullsized":"2024-03-20T13:38:50.835816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:50.835459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:50.835459+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.835459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:30.843392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.306918+0000","last_change":"2024-03-20T13:38:38.306918+0000","last_active":"2024-03-20T13:38:38.306918+0000","last_peered":"2024-03-20T13:38:38.306918+0000","last_clean":"2024-03-20T13:38:38.306918+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:38.306918+0000","last_undegraded":"2024-03-20T13:38:38.306918+0000","last_fullsized":"2024-03-20T13:38:38.306918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.306607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:10:18.381390+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.573861+0000","last_change":"2024-03-20T13:38:47.573861+0000","last_active":"2024-03-20T13:38:47.573861+0000","last_peered":"2024-03-20T13:38:47.573861+0000","last_clean":"2024-03-20T13:38:47.573861+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:38:47.573861+0000","last_undegraded":"2024-03-20T13:38:47.573861+0000","last_fullsized":"2024-03-20T13:38:47.573861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:47.573614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:47.573614+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.573614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:27:48.050248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.504981+0000","last_change":"2024-03-20T13:39:03.505034+0000","last_active":"2024-03-20T13:39:03.504981+0000","last_peered":"2024-03-20T13:39:03.504981+0000","last_clean":"2024-03-20T13:39:03.504981+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:39:03.504981+0000","last_undegraded":"2024-03-20T13:39:03.504981+0000","last_fullsized":"2024-03-20T13:39:03.504981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:03.504783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:03.504783+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.504783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:29.269709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.365085+0000","last_change":"2024-03-20T13:38:58.365162+0000","last_active":"2024-03-20T13:38:58.365085+0000","last_peered":"2024-03-20T13:38:58.365085+0000","last_clean":"2024-03-20T13:38:58.365085+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:38:58.365085+0000","last_undegraded":"2024-03-20T13:38:58.365085+0000","last_fullsized":"2024-03-20T13:38:58.365085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:58.364894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:58.364894+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.364894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:34.419966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159013+0000","last_change":"2024-03-20T13:36:36.824040+0000","last_active":"2024-03-20T13:38:22.159013+0000","last_peered":"2024-03-20T13:38:22.159013+0000","last_clean":"2024-03-20T13:38:22.159013+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:38:22.159013+0000","last_undegraded":"2024-03-20T13:38:22.159013+0000","last_fullsized":"2024-03-20T13:38:22.159013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.615334+0000","last_change":"2024-03-20T13:38:40.615334+0000","last_active":"2024-03-20T13:38:40.615334+0000","last_peered":"2024-03-20T13:38:40.615334+0000","last_clean":"2024-03-20T13:38:40.615334+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:38:40.615334+0000","last_undegraded":"2024-03-20T13:38:40.615334+0000","last_fullsized":"2024-03-20T13:38:40.615334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.614954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:28:08.933992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.605992+0000","last_change":"2024-03-20T13:38:36.605992+0000","last_active":"2024-03-20T13:38:36.605992+0000","last_peered":"2024-03-20T13:38:36.605992+0000","last_clean":"2024-03-20T13:38:36.605992+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:36.605992+0000","last_undegraded":"2024-03-20T13:38:36.605992+0000","last_fullsized":"2024-03-20T13:38:36.605992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.605713+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:07:49.073403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'243","reported_seq":334,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.527288+0000","last_change":"2024-03-20T13:38:25.527288+0000","last_active":"2024-03-20T13:38:25.527288+0000","last_peered":"2024-03-20T13:38:25.527288+0000","last_clean":"2024-03-20T13:38:25.527288+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:25.527288+0000","last_undegraded":"2024-03-20T13:38:25.527288+0000","last_fullsized":"2024-03-20T13:38:25.527288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.527025+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:50.329674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611214+0000","last_change":"2024-03-20T13:36:46.896808+0000","last_active":"2024-03-20T13:38:22.611214+0000","last_peered":"2024-03-20T13:38:22.611214+0000","last_clean":"2024-03-20T13:38:22.611214+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:38:22.611214+0000","last_undegraded":"2024-03-20T13:38:22.611214+0000","last_fullsized":"2024-03-20T13:38:22.611214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.798841+0000","last_change":"2024-03-20T13:38:49.798841+0000","last_active":"2024-03-20T13:38:49.798841+0000","last_peered":"2024-03-20T13:38:49.798841+0000","last_clean":"2024-03-20T13:38:49.798841+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:38:49.798841+0000","last_undegraded":"2024-03-20T13:38:49.798841+0000","last_fullsized":"2024-03-20T13:38:49.798841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:49.798478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:49.798478+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.798478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:08:13.331871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:12.435907+0000","last_change":"2024-03-20T13:39:12.436080+0000","last_active":"2024-03-20T13:39:12.435907+0000","last_peered":"2024-03-20T13:39:12.435907+0000","last_clean":"2024-03-20T13:39:12.435907+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:39:12.435907+0000","last_undegraded":"2024-03-20T13:39:12.435907+0000","last_fullsized":"2024-03-20T13:39:12.435907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:12.435613+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:12.435613+0000","last_clean_scrub_stamp":"2024-03-20T13:39:12.435613+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:30:32.426316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.451601+0000","last_change":"2024-03-20T13:38:24.451601+0000","last_active":"2024-03-20T13:38:24.451601+0000","last_peered":"2024-03-20T13:38:24.451601+0000","last_clean":"2024-03-20T13:38:24.451601+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:24.451601+0000","last_undegraded":"2024-03-20T13:38:24.451601+0000","last_fullsized":"2024-03-20T13:38:24.451601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.451322+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:19.284619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.664886+0000","last_change":"2024-03-20T13:38:26.664886+0000","last_active":"2024-03-20T13:38:26.664886+0000","last_peered":"2024-03-20T13:38:26.664886+0000","last_clean":"2024-03-20T13:38:26.664886+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:38:26.664886+0000","last_undegraded":"2024-03-20T13:38:26.664886+0000","last_fullsized":"2024-03-20T13:38:26.664886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.664636+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:08.014180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'244","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.370410+0000","last_change":"2024-03-20T13:39:05.370473+0000","last_active":"2024-03-20T13:39:05.370410+0000","last_peered":"2024-03-20T13:39:05.370410+0000","last_clean":"2024-03-20T13:39:05.370410+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:39:05.370410+0000","last_undegraded":"2024-03-20T13:39:05.370410+0000","last_fullsized":"2024-03-20T13:39:05.370410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:39:05.370216+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:39:05.370216+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.370216+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:52:28.482939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.658630+0000","last_change":"2024-03-20T13:39:06.658693+0000","last_active":"2024-03-20T13:39:06.658630+0000","last_peered":"2024-03-20T13:39:06.658630+0000","last_clean":"2024-03-20T13:39:06.658630+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:39:06.658630+0000","last_undegraded":"2024-03-20T13:39:06.658630+0000","last_fullsized":"2024-03-20T13:39:06.658630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:06.658433+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:06.658433+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.658433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:02.977756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.632047+0000","last_change":"2024-03-20T13:38:56.632175+0000","last_active":"2024-03-20T13:38:56.632047+0000","last_peered":"2024-03-20T13:38:56.632047+0000","last_clean":"2024-03-20T13:38:56.632047+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:56.632047+0000","last_undegraded":"2024-03-20T13:38:56.632047+0000","last_fullsized":"2024-03-20T13:38:56.632047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:56.631839+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:56.631839+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.631839+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:18.688964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.541931+0000","last_change":"2024-03-20T13:36:36.844656+0000","last_active":"2024-03-20T13:38:23.541931+0000","last_peered":"2024-03-20T13:38:23.541931+0000","last_clean":"2024-03-20T13:38:23.541931+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:38:23.541931+0000","last_undegraded":"2024-03-20T13:38:23.541931+0000","last_fullsized":"2024-03-20T13:38:23.541931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.569151+0000","last_change":"2024-03-20T13:38:46.569151+0000","last_active":"2024-03-20T13:38:46.569151+0000","last_peered":"2024-03-20T13:38:46.569151+0000","last_clean":"2024-03-20T13:38:46.569151+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:38:46.569151+0000","last_undegraded":"2024-03-20T13:38:46.569151+0000","last_fullsized":"2024-03-20T13:38:46.569151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:46.568905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:46.568905+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.568905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:55.191076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.347995+0000","last_change":"2024-03-20T13:38:36.347995+0000","last_active":"2024-03-20T13:38:36.347995+0000","last_peered":"2024-03-20T13:38:36.347995+0000","last_clean":"2024-03-20T13:38:36.347995+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:36.347995+0000","last_undegraded":"2024-03-20T13:38:36.347995+0000","last_fullsized":"2024-03-20T13:38:36.347995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.347716+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:02.799858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.349678+0000","last_change":"2024-03-20T13:38:53.349678+0000","last_active":"2024-03-20T13:38:53.349678+0000","last_peered":"2024-03-20T13:38:53.349678+0000","last_clean":"2024-03-20T13:38:53.349678+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:38:53.349678+0000","last_undegraded":"2024-03-20T13:38:53.349678+0000","last_fullsized":"2024-03-20T13:38:53.349678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:53.349437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:53.349437+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.349437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:12:43.840969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.589381+0000","last_change":"2024-03-20T13:38:46.589381+0000","last_active":"2024-03-20T13:38:46.589381+0000","last_peered":"2024-03-20T13:38:46.589381+0000","last_clean":"2024-03-20T13:38:46.589381+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:38:46.589381+0000","last_undegraded":"2024-03-20T13:38:46.589381+0000","last_fullsized":"2024-03-20T13:38:46.589381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:46.589122+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:46.589122+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.589122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:31:03.922880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.373201+0000","last_change":"2024-03-20T13:38:47.373268+0000","last_active":"2024-03-20T13:38:47.373201+0000","last_peered":"2024-03-20T13:38:47.373201+0000","last_clean":"2024-03-20T13:38:47.373201+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:38:47.373201+0000","last_undegraded":"2024-03-20T13:38:47.373201+0000","last_fullsized":"2024-03-20T13:38:47.373201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:38:47.372986+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:38:47.372986+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.372986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:40:49.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":213,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:12.818024+0000","last_change":"2024-03-20T13:39:12.818095+0000","last_active":"2024-03-20T13:39:12.818024+0000","last_peered":"2024-03-20T13:39:12.818024+0000","last_clean":"2024-03-20T13:39:12.818024+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:39:12.818024+0000","last_undegraded":"2024-03-20T13:39:12.818024+0000","last_fullsized":"2024-03-20T13:39:12.818024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-03-20T13:39:12.817838+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-03-20T13:39:12.817838+0000","last_clean_scrub_stamp":"2024-03-20T13:39:12.817838+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:02:59.365172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158644+0000","last_change":"2024-03-20T13:36:28.752189+0000","last_active":"2024-03-20T13:38:22.158644+0000","last_peered":"2024-03-20T13:38:22.158644+0000","last_clean":"2024-03-20T13:38:22.158644+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:38:22.158644+0000","last_undegraded":"2024-03-20T13:38:22.158644+0000","last_fullsized":"2024-03-20T13:38:22.158644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:13.392639+0000","last_change":"2024-03-20T13:39:13.392698+0000","last_active":"2024-03-20T13:39:13.392639+0000","last_peered":"2024-03-20T13:39:13.392639+0000","last_clean":"2024-03-20T13:39:13.392639+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:39:13.392639+0000","last_undegraded":"2024-03-20T13:39:13.392639+0000","last_fullsized":"2024-03-20T13:39:13.392639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:13.392438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:13.392438+0000","last_clean_scrub_stamp":"2024-03-20T13:39:13.392438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:29.667224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.568862+0000","last_change":"2024-03-20T13:38:39.568862+0000","last_active":"2024-03-20T13:38:39.568862+0000","last_peered":"2024-03-20T13:38:39.568862+0000","last_clean":"2024-03-20T13:38:39.568862+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:38:39.568862+0000","last_undegraded":"2024-03-20T13:38:39.568862+0000","last_fullsized":"2024-03-20T13:38:39.568862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.568507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:20.535216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.413088+0000","last_change":"2024-03-20T13:38:46.413088+0000","last_active":"2024-03-20T13:38:46.413088+0000","last_peered":"2024-03-20T13:38:46.413088+0000","last_clean":"2024-03-20T13:38:46.413088+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:46.413088+0000","last_undegraded":"2024-03-20T13:38:46.413088+0000","last_fullsized":"2024-03-20T13:38:46.413088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-03-20T13:38:46.412823+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-03-20T13:38:46.412823+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.412823+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:08.560465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.462333+0000","last_change":"2024-03-20T13:38:51.462333+0000","last_active":"2024-03-20T13:38:51.462333+0000","last_peered":"2024-03-20T13:38:51.462333+0000","last_clean":"2024-03-20T13:38:51.462333+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:38:51.462333+0000","last_undegraded":"2024-03-20T13:38:51.462333+0000","last_fullsized":"2024-03-20T13:38:51.462333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:51.462055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:51.462055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.462055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:26.757666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'52","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.679580+0000","last_change":"2024-03-20T13:39:05.679648+0000","last_active":"2024-03-20T13:39:05.679580+0000","last_peered":"2024-03-20T13:39:05.679580+0000","last_clean":"2024-03-20T13:39:05.679580+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:39:05.679580+0000","last_undegraded":"2024-03-20T13:39:05.679580+0000","last_fullsized":"2024-03-20T13:39:05.679580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-03-20T13:39:05.679385+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-03-20T13:39:05.679385+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.679385+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:47:20.875327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.483111+0000","last_change":"2024-03-20T13:38:54.483175+0000","last_active":"2024-03-20T13:38:54.483111+0000","last_peered":"2024-03-20T13:38:54.483111+0000","last_clean":"2024-03-20T13:38:54.483111+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:38:54.483111+0000","last_undegraded":"2024-03-20T13:38:54.483111+0000","last_fullsized":"2024-03-20T13:38:54.483111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:54.482914+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:54.482914+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.482914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:27:35.407795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158556+0000","last_change":"2024-03-20T13:36:28.754134+0000","last_active":"2024-03-20T13:38:22.158556+0000","last_peered":"2024-03-20T13:38:22.158556+0000","last_clean":"2024-03-20T13:38:22.158556+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:38:22.158556+0000","last_undegraded":"2024-03-20T13:38:22.158556+0000","last_fullsized":"2024-03-20T13:38:22.158556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.739621+0000","last_change":"2024-03-20T13:39:07.739678+0000","last_active":"2024-03-20T13:39:07.739621+0000","last_peered":"2024-03-20T13:39:07.739621+0000","last_clean":"2024-03-20T13:39:07.739621+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:39:07.739621+0000","last_undegraded":"2024-03-20T13:39:07.739621+0000","last_fullsized":"2024-03-20T13:39:07.739621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:07.739431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:07.739431+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.739431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:19:48.986195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.404985+0000","last_change":"2024-03-20T13:38:31.404985+0000","last_active":"2024-03-20T13:38:31.404985+0000","last_peered":"2024-03-20T13:38:31.404985+0000","last_clean":"2024-03-20T13:38:31.404985+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:38:31.404985+0000","last_undegraded":"2024-03-20T13:38:31.404985+0000","last_fullsized":"2024-03-20T13:38:31.404985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.404736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:36.082582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'256","reported_seq":448,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.594117+0000","last_change":"2024-03-20T13:38:27.594117+0000","last_active":"2024-03-20T13:38:27.594117+0000","last_peered":"2024-03-20T13:38:27.594117+0000","last_clean":"2024-03-20T13:38:27.594117+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:27.594117+0000","last_undegraded":"2024-03-20T13:38:27.594117+0000","last_fullsized":"2024-03-20T13:38:27.594117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'256","last_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_deep_scrub":"34'256","last_deep_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.593856+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:15.732896+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.556386+0000","last_change":"2024-03-20T13:38:43.556386+0000","last_active":"2024-03-20T13:38:43.556386+0000","last_peered":"2024-03-20T13:38:43.556386+0000","last_clean":"2024-03-20T13:38:43.556386+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:38:43.556386+0000","last_undegraded":"2024-03-20T13:38:43.556386+0000","last_fullsized":"2024-03-20T13:38:43.556386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:43.556135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:43.556135+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.556135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:18.900581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611557+0000","last_change":"2024-03-20T13:36:46.895964+0000","last_active":"2024-03-20T13:38:22.611557+0000","last_peered":"2024-03-20T13:38:22.611557+0000","last_clean":"2024-03-20T13:38:22.611557+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:38:22.611557+0000","last_undegraded":"2024-03-20T13:38:22.611557+0000","last_fullsized":"2024-03-20T13:38:22.611557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.719111+0000","last_change":"2024-03-20T13:39:04.719169+0000","last_active":"2024-03-20T13:39:04.719111+0000","last_peered":"2024-03-20T13:39:04.719111+0000","last_clean":"2024-03-20T13:39:04.719111+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:39:04.719111+0000","last_undegraded":"2024-03-20T13:39:04.719111+0000","last_fullsized":"2024-03-20T13:39:04.719111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:04.718913+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:04.718913+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.718913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:15.435734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.675046+0000","last_change":"2024-03-20T13:38:56.675104+0000","last_active":"2024-03-20T13:38:56.675046+0000","last_peered":"2024-03-20T13:38:56.675046+0000","last_clean":"2024-03-20T13:38:56.675046+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:38:56.675046+0000","last_undegraded":"2024-03-20T13:38:56.675046+0000","last_fullsized":"2024-03-20T13:38:56.675046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:56.674857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:56.674857+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.674857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:59:12.553051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.708377+0000","last_change":"2024-03-20T13:39:01.708434+0000","last_active":"2024-03-20T13:39:01.708377+0000","last_peered":"2024-03-20T13:39:01.708377+0000","last_clean":"2024-03-20T13:39:01.708377+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:39:01.708377+0000","last_undegraded":"2024-03-20T13:39:01.708377+0000","last_fullsized":"2024-03-20T13:39:01.708377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:01.708181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:01.708181+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.708181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:07:51.185359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.785460+0000","last_change":"2024-03-20T13:38:52.785528+0000","last_active":"2024-03-20T13:38:52.785460+0000","last_peered":"2024-03-20T13:38:52.785460+0000","last_clean":"2024-03-20T13:38:52.785460+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:38:52.785460+0000","last_undegraded":"2024-03-20T13:38:52.785460+0000","last_fullsized":"2024-03-20T13:38:52.785460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:52.785272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.785272+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.785272+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:02.533126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.434925+0000","last_change":"2024-03-20T13:38:29.434925+0000","last_active":"2024-03-20T13:38:29.434925+0000","last_peered":"2024-03-20T13:38:29.434925+0000","last_clean":"2024-03-20T13:38:29.434925+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:29.434925+0000","last_undegraded":"2024-03-20T13:38:29.434925+0000","last_fullsized":"2024-03-20T13:38:29.434925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.434642+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.312836+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.577902+0000","last_change":"2024-03-20T13:38:26.577902+0000","last_active":"2024-03-20T13:38:26.577902+0000","last_peered":"2024-03-20T13:38:26.577902+0000","last_clean":"2024-03-20T13:38:26.577902+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:38:26.577902+0000","last_undegraded":"2024-03-20T13:38:26.577902+0000","last_fullsized":"2024-03-20T13:38:26.577902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.577544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:31.374045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.478081+0000","last_change":"2024-03-20T13:38:59.478081+0000","last_active":"2024-03-20T13:38:59.478081+0000","last_peered":"2024-03-20T13:38:59.478081+0000","last_clean":"2024-03-20T13:38:59.478081+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:38:59.478081+0000","last_undegraded":"2024-03-20T13:38:59.478081+0000","last_fullsized":"2024-03-20T13:38:59.478081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.477674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.477674+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.477674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:35:30.131510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.579357+0000","last_change":"2024-03-20T13:38:48.579421+0000","last_active":"2024-03-20T13:38:48.579357+0000","last_peered":"2024-03-20T13:38:48.579357+0000","last_clean":"2024-03-20T13:38:48.579357+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:48.579357+0000","last_undegraded":"2024-03-20T13:38:48.579357+0000","last_fullsized":"2024-03-20T13:38:48.579357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:48.579175+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:48.579175+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.579175+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:18.825200+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158551+0000","last_change":"2024-03-20T13:36:28.752442+0000","last_active":"2024-03-20T13:38:22.158551+0000","last_peered":"2024-03-20T13:38:22.158551+0000","last_clean":"2024-03-20T13:38:22.158551+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:38:22.158551+0000","last_undegraded":"2024-03-20T13:38:22.158551+0000","last_fullsized":"2024-03-20T13:38:22.158551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158714+0000","last_change":"2024-03-20T13:36:36.820308+0000","last_active":"2024-03-20T13:38:22.158714+0000","last_peered":"2024-03-20T13:38:22.158714+0000","last_clean":"2024-03-20T13:38:22.158714+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:38:22.158714+0000","last_undegraded":"2024-03-20T13:38:22.158714+0000","last_fullsized":"2024-03-20T13:38:22.158714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.643838+0000","last_change":"2024-03-20T13:38:43.643838+0000","last_active":"2024-03-20T13:38:43.643838+0000","last_peered":"2024-03-20T13:38:43.643838+0000","last_clean":"2024-03-20T13:38:43.643838+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:38:43.643838+0000","last_undegraded":"2024-03-20T13:38:43.643838+0000","last_fullsized":"2024-03-20T13:38:43.643838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:43.643583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:43.643583+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.643583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:49.867880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.665096+0000","last_change":"2024-03-20T13:38:31.665096+0000","last_active":"2024-03-20T13:38:31.665096+0000","last_peered":"2024-03-20T13:38:31.665096+0000","last_clean":"2024-03-20T13:38:31.665096+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:31.665096+0000","last_undegraded":"2024-03-20T13:38:31.665096+0000","last_fullsized":"2024-03-20T13:38:31.665096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.664843+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:03:43.219513+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.526385+0000","last_change":"2024-03-20T13:38:55.526385+0000","last_active":"2024-03-20T13:38:55.526385+0000","last_peered":"2024-03-20T13:38:55.526385+0000","last_clean":"2024-03-20T13:38:55.526385+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:38:55.526385+0000","last_undegraded":"2024-03-20T13:38:55.526385+0000","last_fullsized":"2024-03-20T13:38:55.526385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:55.526096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:55.526096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.526096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:50.661554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611506+0000","last_change":"2024-03-20T13:36:46.890926+0000","last_active":"2024-03-20T13:38:22.611506+0000","last_peered":"2024-03-20T13:38:22.611506+0000","last_clean":"2024-03-20T13:38:22.611506+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:38:22.611506+0000","last_undegraded":"2024-03-20T13:38:22.611506+0000","last_fullsized":"2024-03-20T13:38:22.611506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:20.738972+0000","last_change":"2024-03-20T13:39:20.739126+0000","last_active":"2024-03-20T13:39:20.738972+0000","last_peered":"2024-03-20T13:39:20.738972+0000","last_clean":"2024-03-20T13:39:20.738972+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:39:20.738972+0000","last_undegraded":"2024-03-20T13:39:20.738972+0000","last_fullsized":"2024-03-20T13:39:20.738972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:20.738695+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:20.738695+0000","last_clean_scrub_stamp":"2024-03-20T13:39:20.738695+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:52:04.437958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158865+0000","last_change":"2024-03-20T13:36:36.820280+0000","last_active":"2024-03-20T13:38:22.158865+0000","last_peered":"2024-03-20T13:38:22.158865+0000","last_clean":"2024-03-20T13:38:22.158865+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:38:22.158865+0000","last_undegraded":"2024-03-20T13:38:22.158865+0000","last_fullsized":"2024-03-20T13:38:22.158865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:14.753811+0000","last_change":"2024-03-20T13:39:14.753937+0000","last_active":"2024-03-20T13:39:14.753811+0000","last_peered":"2024-03-20T13:39:14.753811+0000","last_clean":"2024-03-20T13:39:14.753811+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:39:14.753811+0000","last_undegraded":"2024-03-20T13:39:14.753811+0000","last_fullsized":"2024-03-20T13:39:14.753811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:14.753585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:14.753585+0000","last_clean_scrub_stamp":"2024-03-20T13:39:14.753585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:05.278331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.595471+0000","last_change":"2024-03-20T13:38:39.595471+0000","last_active":"2024-03-20T13:38:39.595471+0000","last_peered":"2024-03-20T13:38:39.595471+0000","last_clean":"2024-03-20T13:38:39.595471+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:38:39.595471+0000","last_undegraded":"2024-03-20T13:38:39.595471+0000","last_fullsized":"2024-03-20T13:38:39.595471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.595226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:34.240122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'68","reported_seq":144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.532606+0000","last_change":"2024-03-20T13:38:31.532606+0000","last_active":"2024-03-20T13:38:31.532606+0000","last_peered":"2024-03-20T13:38:31.532606+0000","last_clean":"2024-03-20T13:38:31.532606+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:31.532606+0000","last_undegraded":"2024-03-20T13:38:31.532606+0000","last_fullsized":"2024-03-20T13:38:31.532606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'68","last_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_deep_scrub":"34'68","last_deep_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.532334+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:30:24.833392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.295952+0000","last_change":"2024-03-20T13:38:41.295952+0000","last_active":"2024-03-20T13:38:41.295952+0000","last_peered":"2024-03-20T13:38:41.295952+0000","last_clean":"2024-03-20T13:38:41.295952+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:38:41.295952+0000","last_undegraded":"2024-03-20T13:38:41.295952+0000","last_fullsized":"2024-03-20T13:38:41.295952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:41.295702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:41.295702+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.295702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:31.520002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.559920+0000","last_change":"2024-03-20T13:38:30.559920+0000","last_active":"2024-03-20T13:38:30.559920+0000","last_peered":"2024-03-20T13:38:30.559920+0000","last_clean":"2024-03-20T13:38:30.559920+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:30.559920+0000","last_undegraded":"2024-03-20T13:38:30.559920+0000","last_fullsized":"2024-03-20T13:38:30.559920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.559669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:18:34.421204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.719618+0000","last_change":"2024-03-20T13:39:00.719680+0000","last_active":"2024-03-20T13:39:00.719618+0000","last_peered":"2024-03-20T13:39:00.719618+0000","last_clean":"2024-03-20T13:39:00.719618+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:39:00.719618+0000","last_undegraded":"2024-03-20T13:39:00.719618+0000","last_fullsized":"2024-03-20T13:39:00.719618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:00.719427+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:00.719427+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.719427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:35:54.364275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:16.742325+0000","last_change":"2024-03-20T13:39:16.742471+0000","last_active":"2024-03-20T13:39:16.742325+0000","last_peered":"2024-03-20T13:39:16.742325+0000","last_clean":"2024-03-20T13:39:16.742325+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:39:16.742325+0000","last_undegraded":"2024-03-20T13:39:16.742325+0000","last_fullsized":"2024-03-20T13:39:16.742325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:16.742053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:16.742053+0000","last_clean_scrub_stamp":"2024-03-20T13:39:16.742053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:23:54.596602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158672+0000","last_change":"2024-03-20T13:36:28.752138+0000","last_active":"2024-03-20T13:38:22.158672+0000","last_peered":"2024-03-20T13:38:22.158672+0000","last_clean":"2024-03-20T13:38:22.158672+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:38:22.158672+0000","last_undegraded":"2024-03-20T13:38:22.158672+0000","last_fullsized":"2024-03-20T13:38:22.158672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.396031+0000","last_change":"2024-03-20T13:38:30.396031+0000","last_active":"2024-03-20T13:38:30.396031+0000","last_peered":"2024-03-20T13:38:30.396031+0000","last_clean":"2024-03-20T13:38:30.396031+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:38:30.396031+0000","last_undegraded":"2024-03-20T13:38:30.396031+0000","last_fullsized":"2024-03-20T13:38:30.396031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.395743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:19.841036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.620785+0000","last_change":"2024-03-20T13:38:25.620785+0000","last_active":"2024-03-20T13:38:25.620785+0000","last_peered":"2024-03-20T13:38:25.620785+0000","last_clean":"2024-03-20T13:38:25.620785+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:38:25.620785+0000","last_undegraded":"2024-03-20T13:38:25.620785+0000","last_fullsized":"2024-03-20T13:38:25.620785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.620381+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:16.685474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'243","reported_seq":331,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.526805+0000","last_change":"2024-03-20T13:38:30.526805+0000","last_active":"2024-03-20T13:38:30.526805+0000","last_peered":"2024-03-20T13:38:30.526805+0000","last_clean":"2024-03-20T13:38:30.526805+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:30.526805+0000","last_undegraded":"2024-03-20T13:38:30.526805+0000","last_fullsized":"2024-03-20T13:38:30.526805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.526556+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:46.021855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544739+0000","last_change":"2024-03-20T13:36:46.895782+0000","last_active":"2024-03-20T13:38:23.544739+0000","last_peered":"2024-03-20T13:38:23.544739+0000","last_clean":"2024-03-20T13:38:23.544739+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:38:23.544739+0000","last_undegraded":"2024-03-20T13:38:23.544739+0000","last_fullsized":"2024-03-20T13:38:23.544739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:17.407031+0000","last_change":"2024-03-20T13:39:17.407096+0000","last_active":"2024-03-20T13:39:17.407031+0000","last_peered":"2024-03-20T13:39:17.407031+0000","last_clean":"2024-03-20T13:39:17.407031+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:39:17.407031+0000","last_undegraded":"2024-03-20T13:39:17.407031+0000","last_fullsized":"2024-03-20T13:39:17.407031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:17.406838+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:17.406838+0000","last_clean_scrub_stamp":"2024-03-20T13:39:17.406838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:55:22.629587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.432733+0000","last_change":"2024-03-20T13:39:10.432891+0000","last_active":"2024-03-20T13:39:10.432733+0000","last_peered":"2024-03-20T13:39:10.432733+0000","last_clean":"2024-03-20T13:39:10.432733+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:39:10.432733+0000","last_undegraded":"2024-03-20T13:39:10.432733+0000","last_fullsized":"2024-03-20T13:39:10.432733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:10.432510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:10.432510+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.432510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:13:39.177692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:13.772995+0000","last_change":"2024-03-20T13:39:13.773047+0000","last_active":"2024-03-20T13:39:13.772995+0000","last_peered":"2024-03-20T13:39:13.772995+0000","last_clean":"2024-03-20T13:39:13.772995+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:39:13.772995+0000","last_undegraded":"2024-03-20T13:39:13.772995+0000","last_fullsized":"2024-03-20T13:39:13.772995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:13.772806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:13.772806+0000","last_clean_scrub_stamp":"2024-03-20T13:39:13.772806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:40:08.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.425602+0000","last_change":"2024-03-20T13:38:23.425602+0000","last_active":"2024-03-20T13:38:23.425602+0000","last_peered":"2024-03-20T13:38:23.425602+0000","last_clean":"2024-03-20T13:38:23.425602+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:38:23.425602+0000","last_undegraded":"2024-03-20T13:38:23.425602+0000","last_fullsized":"2024-03-20T13:38:23.425602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.425487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:03.433420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.612586+0000","last_change":"2024-03-20T13:38:42.612586+0000","last_active":"2024-03-20T13:38:42.612586+0000","last_peered":"2024-03-20T13:38:42.612586+0000","last_clean":"2024-03-20T13:38:42.612586+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:38:42.612586+0000","last_undegraded":"2024-03-20T13:38:42.612586+0000","last_fullsized":"2024-03-20T13:38:42.612586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-03-20T13:38:42.612284+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-03-20T13:38:42.612284+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.612284+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:43.020680+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'243","reported_seq":329,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.624509+0000","last_change":"2024-03-20T13:38:33.624509+0000","last_active":"2024-03-20T13:38:33.624509+0000","last_peered":"2024-03-20T13:38:33.624509+0000","last_clean":"2024-03-20T13:38:33.624509+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:33.624509+0000","last_undegraded":"2024-03-20T13:38:33.624509+0000","last_fullsized":"2024-03-20T13:38:33.624509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.624254+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:31:42.470838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611572+0000","last_change":"2024-03-20T13:36:46.892684+0000","last_active":"2024-03-20T13:38:22.611572+0000","last_peered":"2024-03-20T13:38:22.611572+0000","last_clean":"2024-03-20T13:38:22.611572+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:38:22.611572+0000","last_undegraded":"2024-03-20T13:38:22.611572+0000","last_fullsized":"2024-03-20T13:38:22.611572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.796755+0000","last_change":"2024-03-20T13:38:47.796817+0000","last_active":"2024-03-20T13:38:47.796755+0000","last_peered":"2024-03-20T13:38:47.796755+0000","last_clean":"2024-03-20T13:38:47.796755+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:38:47.796755+0000","last_undegraded":"2024-03-20T13:38:47.796755+0000","last_fullsized":"2024-03-20T13:38:47.796755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:47.796569+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:47.796569+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.796569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:46.550018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:18.769720+0000","last_change":"2024-03-20T13:39:18.769780+0000","last_active":"2024-03-20T13:39:18.769720+0000","last_peered":"2024-03-20T13:39:18.769720+0000","last_clean":"2024-03-20T13:39:18.769720+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:39:18.769720+0000","last_undegraded":"2024-03-20T13:39:18.769720+0000","last_fullsized":"2024-03-20T13:39:18.769720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:18.769523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:18.769523+0000","last_clean_scrub_stamp":"2024-03-20T13:39:18.769523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:10.422181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.158673+0000","last_change":"2024-03-20T13:36:28.753052+0000","last_active":"2024-03-20T13:38:22.158673+0000","last_peered":"2024-03-20T13:38:22.158673+0000","last_clean":"2024-03-20T13:38:22.158673+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:38:22.158673+0000","last_undegraded":"2024-03-20T13:38:22.158673+0000","last_fullsized":"2024-03-20T13:38:22.158673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:27.736046+0000","last_clean_scrub_stamp":"2024-03-20T13:36:27.736046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.640338+0000","last_change":"2024-03-20T13:38:30.640338+0000","last_active":"2024-03-20T13:38:30.640338+0000","last_peered":"2024-03-20T13:38:30.640338+0000","last_clean":"2024-03-20T13:38:30.640338+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:38:30.640338+0000","last_undegraded":"2024-03-20T13:38:30.640338+0000","last_fullsized":"2024-03-20T13:38:30.640338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.640055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:20.085347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":184,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.394015+0000","last_change":"2024-03-20T13:38:33.394015+0000","last_active":"2024-03-20T13:38:33.394015+0000","last_peered":"2024-03-20T13:38:33.394015+0000","last_clean":"2024-03-20T13:38:33.394015+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:33.394015+0000","last_undegraded":"2024-03-20T13:38:33.394015+0000","last_fullsized":"2024-03-20T13:38:33.394015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.393752+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:13.108218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.607288+0000","last_change":"2024-03-20T13:38:35.607288+0000","last_active":"2024-03-20T13:38:35.607288+0000","last_peered":"2024-03-20T13:38:35.607288+0000","last_clean":"2024-03-20T13:38:35.607288+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:38:35.607288+0000","last_undegraded":"2024-03-20T13:38:35.607288+0000","last_fullsized":"2024-03-20T13:38:35.607288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.607032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:55:24.977582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.511758+0000","last_change":"2024-03-20T13:38:23.511758+0000","last_active":"2024-03-20T13:38:23.511758+0000","last_peered":"2024-03-20T13:38:23.511758+0000","last_clean":"2024-03-20T13:38:23.511758+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:38:23.511758+0000","last_undegraded":"2024-03-20T13:38:23.511758+0000","last_fullsized":"2024-03-20T13:38:23.511758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.511495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:10.006144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.608882+0000","last_change":"2024-03-20T13:38:38.608882+0000","last_active":"2024-03-20T13:38:38.608882+0000","last_peered":"2024-03-20T13:38:38.608882+0000","last_clean":"2024-03-20T13:38:38.608882+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:38:38.608882+0000","last_undegraded":"2024-03-20T13:38:38.608882+0000","last_fullsized":"2024-03-20T13:38:38.608882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.608632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:09.360540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.774095+0000","last_change":"2024-03-20T13:38:45.774095+0000","last_active":"2024-03-20T13:38:45.774095+0000","last_peered":"2024-03-20T13:38:45.774095+0000","last_clean":"2024-03-20T13:38:45.774095+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:45.774095+0000","last_undegraded":"2024-03-20T13:38:45.774095+0000","last_fullsized":"2024-03-20T13:38:45.774095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-03-20T13:38:45.773816+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-03-20T13:38:45.773816+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.773816+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:39:52.703727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.159139+0000","last_change":"2024-03-20T13:36:36.841005+0000","last_active":"2024-03-20T13:38:22.159139+0000","last_peered":"2024-03-20T13:38:22.159139+0000","last_clean":"2024-03-20T13:38:22.159139+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:38:22.159139+0000","last_undegraded":"2024-03-20T13:38:22.159139+0000","last_fullsized":"2024-03-20T13:38:22.159139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.603602+0000","last_change":"2024-03-20T13:38:44.603602+0000","last_active":"2024-03-20T13:38:44.603602+0000","last_peered":"2024-03-20T13:38:44.603602+0000","last_clean":"2024-03-20T13:38:44.603602+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:38:44.603602+0000","last_undegraded":"2024-03-20T13:38:44.603602+0000","last_fullsized":"2024-03-20T13:38:44.603602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:44.603360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:44.603360+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.603360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:50:57.154639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.581462+0000","last_change":"2024-03-20T13:38:41.581462+0000","last_active":"2024-03-20T13:38:41.581462+0000","last_peered":"2024-03-20T13:38:41.581462+0000","last_clean":"2024-03-20T13:38:41.581462+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:41.581462+0000","last_undegraded":"2024-03-20T13:38:41.581462+0000","last_fullsized":"2024-03-20T13:38:41.581462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-03-20T13:38:41.580998+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-03-20T13:38:41.580998+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.580998+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:22:22.559251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.610771+0000","last_change":"2024-03-20T13:38:36.610771+0000","last_active":"2024-03-20T13:38:36.610771+0000","last_peered":"2024-03-20T13:38:36.610771+0000","last_clean":"2024-03-20T13:38:36.610771+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:38:36.610771+0000","last_undegraded":"2024-03-20T13:38:36.610771+0000","last_fullsized":"2024-03-20T13:38:36.610771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.610516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:03.062657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544915+0000","last_change":"2024-03-20T13:36:46.883756+0000","last_active":"2024-03-20T13:38:23.544915+0000","last_peered":"2024-03-20T13:38:23.544915+0000","last_clean":"2024-03-20T13:38:23.544915+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:38:23.544915+0000","last_undegraded":"2024-03-20T13:38:23.544915+0000","last_fullsized":"2024-03-20T13:38:23.544915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.633218+0000","last_change":"2024-03-20T13:38:55.633218+0000","last_active":"2024-03-20T13:38:55.633218+0000","last_peered":"2024-03-20T13:38:55.633218+0000","last_clean":"2024-03-20T13:38:55.633218+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:38:55.633218+0000","last_undegraded":"2024-03-20T13:38:55.633218+0000","last_fullsized":"2024-03-20T13:38:55.633218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:55.632954+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:55.632954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.632954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:05.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.683297+0000","last_change":"2024-03-20T13:38:58.683297+0000","last_active":"2024-03-20T13:38:58.683297+0000","last_peered":"2024-03-20T13:38:58.683297+0000","last_clean":"2024-03-20T13:38:58.683297+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:38:58.683297+0000","last_undegraded":"2024-03-20T13:38:58.683297+0000","last_fullsized":"2024-03-20T13:38:58.683297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:58.683054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:58.683054+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.683054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:04:10.237724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.555801+0000","last_change":"2024-03-20T13:38:48.555801+0000","last_active":"2024-03-20T13:38:48.555801+0000","last_peered":"2024-03-20T13:38:48.555801+0000","last_clean":"2024-03-20T13:38:48.555801+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:38:48.555801+0000","last_undegraded":"2024-03-20T13:38:48.555801+0000","last_fullsized":"2024-03-20T13:38:48.555801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:48.555555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:48.555555+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.555555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:14.196969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.580058+0000","last_change":"2024-03-20T13:38:29.580058+0000","last_active":"2024-03-20T13:38:29.580058+0000","last_peered":"2024-03-20T13:38:29.580058+0000","last_clean":"2024-03-20T13:38:29.580058+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:38:29.580058+0000","last_undegraded":"2024-03-20T13:38:29.580058+0000","last_fullsized":"2024-03-20T13:38:29.580058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.579791+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:56.167406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.591499+0000","last_change":"2024-03-20T13:38:29.591499+0000","last_active":"2024-03-20T13:38:29.591499+0000","last_peered":"2024-03-20T13:38:29.591499+0000","last_clean":"2024-03-20T13:38:29.591499+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:38:29.591499+0000","last_undegraded":"2024-03-20T13:38:29.591499+0000","last_fullsized":"2024-03-20T13:38:29.591499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.591251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:46.103619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.611586+0000","last_change":"2024-03-20T13:36:46.891019+0000","last_active":"2024-03-20T13:38:22.611586+0000","last_peered":"2024-03-20T13:38:22.611586+0000","last_clean":"2024-03-20T13:38:22.611586+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:38:22.611586+0000","last_undegraded":"2024-03-20T13:38:22.611586+0000","last_fullsized":"2024-03-20T13:38:22.611586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.477948+0000","last_change":"2024-03-20T13:38:58.477948+0000","last_active":"2024-03-20T13:38:58.477948+0000","last_peered":"2024-03-20T13:38:58.477948+0000","last_clean":"2024-03-20T13:38:58.477948+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:38:58.477948+0000","last_undegraded":"2024-03-20T13:38:58.477948+0000","last_fullsized":"2024-03-20T13:38:58.477948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:38:58.477682+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:38:58.477682+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.477682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:53:06.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.325197+0000","last_change":"2024-03-20T13:39:11.325258+0000","last_active":"2024-03-20T13:39:11.325197+0000","last_peered":"2024-03-20T13:39:11.325197+0000","last_clean":"2024-03-20T13:39:11.325197+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:39:11.325197+0000","last_undegraded":"2024-03-20T13:39:11.325197+0000","last_fullsized":"2024-03-20T13:39:11.325197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:11.324991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:11.324991+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.324991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.576347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.440960+0000","last_change":"2024-03-20T13:38:26.440960+0000","last_active":"2024-03-20T13:38:26.440960+0000","last_peered":"2024-03-20T13:38:26.440960+0000","last_clean":"2024-03-20T13:38:26.440960+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:38:26.440960+0000","last_undegraded":"2024-03-20T13:38:26.440960+0000","last_fullsized":"2024-03-20T13:38:26.440960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.440701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:34.910452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'42","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.605165+0000","last_change":"2024-03-20T13:38:40.605165+0000","last_active":"2024-03-20T13:38:40.605165+0000","last_peered":"2024-03-20T13:38:40.605165+0000","last_clean":"2024-03-20T13:38:40.605165+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:40.605165+0000","last_undegraded":"2024-03-20T13:38:40.605165+0000","last_fullsized":"2024-03-20T13:38:40.605165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'42","last_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_deep_scrub":"34'42","last_deep_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.604871+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:50:04.270564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.630318+0000","last_change":"2024-03-20T13:38:42.630318+0000","last_active":"2024-03-20T13:38:42.630318+0000","last_peered":"2024-03-20T13:38:42.630318+0000","last_clean":"2024-03-20T13:38:42.630318+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:38:42.630318+0000","last_undegraded":"2024-03-20T13:38:42.630318+0000","last_fullsized":"2024-03-20T13:38:42.630318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:42.630032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:42.630032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.630032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:35.899389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544939+0000","last_change":"2024-03-20T13:36:46.886280+0000","last_active":"2024-03-20T13:38:23.544939+0000","last_peered":"2024-03-20T13:38:23.544939+0000","last_clean":"2024-03-20T13:38:23.544939+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:38:23.544939+0000","last_undegraded":"2024-03-20T13:38:23.544939+0000","last_fullsized":"2024-03-20T13:38:23.544939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.508391+0000","last_change":"2024-03-20T13:38:56.508391+0000","last_active":"2024-03-20T13:38:56.508391+0000","last_peered":"2024-03-20T13:38:56.508391+0000","last_clean":"2024-03-20T13:38:56.508391+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:56.508391+0000","last_undegraded":"2024-03-20T13:38:56.508391+0000","last_fullsized":"2024-03-20T13:38:56.508391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:56.508131+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:56.508131+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.508131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:42.709535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:15.744850+0000","last_change":"2024-03-20T13:39:15.744910+0000","last_active":"2024-03-20T13:39:15.744850+0000","last_peered":"2024-03-20T13:39:15.744850+0000","last_clean":"2024-03-20T13:39:15.744850+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:39:15.744850+0000","last_undegraded":"2024-03-20T13:39:15.744850+0000","last_fullsized":"2024-03-20T13:39:15.744850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:15.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:15.744631+0000","last_clean_scrub_stamp":"2024-03-20T13:39:15.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:48:45.057395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.618082+0000","last_change":"2024-03-20T13:38:29.618082+0000","last_active":"2024-03-20T13:38:29.618082+0000","last_peered":"2024-03-20T13:38:29.618082+0000","last_clean":"2024-03-20T13:38:29.618082+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:38:29.618082+0000","last_undegraded":"2024-03-20T13:38:29.618082+0000","last_fullsized":"2024-03-20T13:38:29.618082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.617842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.496036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.357181+0000","last_change":"2024-03-20T13:38:44.357181+0000","last_active":"2024-03-20T13:38:44.357181+0000","last_peered":"2024-03-20T13:38:44.357181+0000","last_clean":"2024-03-20T13:38:44.357181+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:44.357181+0000","last_undegraded":"2024-03-20T13:38:44.357181+0000","last_fullsized":"2024-03-20T13:38:44.357181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:44.356772+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:44.356772+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.356772+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:34.210460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.530157+0000","last_change":"2024-03-20T13:38:32.530157+0000","last_active":"2024-03-20T13:38:32.530157+0000","last_peered":"2024-03-20T13:38:32.530157+0000","last_clean":"2024-03-20T13:38:32.530157+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:38:32.530157+0000","last_undegraded":"2024-03-20T13:38:32.530157+0000","last_fullsized":"2024-03-20T13:38:32.530157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.529912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:23:06.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.323124+0000","last_change":"2024-03-20T13:38:56.323183+0000","last_active":"2024-03-20T13:38:56.323124+0000","last_peered":"2024-03-20T13:38:56.323124+0000","last_clean":"2024-03-20T13:38:56.323124+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:38:56.323124+0000","last_undegraded":"2024-03-20T13:38:56.323124+0000","last_fullsized":"2024-03-20T13:38:56.323124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:56.322921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:56.322921+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.322921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:17.280083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542000+0000","last_change":"2024-03-20T13:36:36.844273+0000","last_active":"2024-03-20T13:38:23.542000+0000","last_peered":"2024-03-20T13:38:23.542000+0000","last_clean":"2024-03-20T13:38:23.542000+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:38:23.542000+0000","last_undegraded":"2024-03-20T13:38:23.542000+0000","last_fullsized":"2024-03-20T13:38:23.542000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.624003+0000","last_change":"2024-03-20T13:38:23.624003+0000","last_active":"2024-03-20T13:38:23.624003+0000","last_peered":"2024-03-20T13:38:23.624003+0000","last_clean":"2024-03-20T13:38:23.624003+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:38:23.624003+0000","last_undegraded":"2024-03-20T13:38:23.624003+0000","last_fullsized":"2024-03-20T13:38:23.624003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.623665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:46.378711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'59","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.584099+0000","last_change":"2024-03-20T13:38:28.584099+0000","last_active":"2024-03-20T13:38:28.584099+0000","last_peered":"2024-03-20T13:38:28.584099+0000","last_clean":"2024-03-20T13:38:28.584099+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:28.584099+0000","last_undegraded":"2024-03-20T13:38:28.584099+0000","last_fullsized":"2024-03-20T13:38:28.584099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.583677+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:50:25.438865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.554904+0000","last_change":"2024-03-20T13:38:28.554904+0000","last_active":"2024-03-20T13:38:28.554904+0000","last_peered":"2024-03-20T13:38:28.554904+0000","last_clean":"2024-03-20T13:38:28.554904+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:38:28.554904+0000","last_undegraded":"2024-03-20T13:38:28.554904+0000","last_fullsized":"2024-03-20T13:38:28.554904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.554662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:18.277488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544804+0000","last_change":"2024-03-20T13:36:46.891682+0000","last_active":"2024-03-20T13:38:23.544804+0000","last_peered":"2024-03-20T13:38:23.544804+0000","last_clean":"2024-03-20T13:38:23.544804+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:38:23.544804+0000","last_undegraded":"2024-03-20T13:38:23.544804+0000","last_fullsized":"2024-03-20T13:38:23.544804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.755964+0000","last_change":"2024-03-20T13:39:08.756024+0000","last_active":"2024-03-20T13:39:08.755964+0000","last_peered":"2024-03-20T13:39:08.755964+0000","last_clean":"2024-03-20T13:39:08.755964+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:39:08.755964+0000","last_undegraded":"2024-03-20T13:39:08.755964+0000","last_fullsized":"2024-03-20T13:39:08.755964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:08.755785+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:08.755785+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.755785+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:53.949890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.727726+0000","last_change":"2024-03-20T13:39:05.727790+0000","last_active":"2024-03-20T13:39:05.727726+0000","last_peered":"2024-03-20T13:39:05.727726+0000","last_clean":"2024-03-20T13:39:05.727726+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:39:05.727726+0000","last_undegraded":"2024-03-20T13:39:05.727726+0000","last_fullsized":"2024-03-20T13:39:05.727726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:05.727514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:05.727514+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.727514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:38.042586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.382567+0000","last_change":"2024-03-20T13:38:32.382567+0000","last_active":"2024-03-20T13:38:32.382567+0000","last_peered":"2024-03-20T13:38:32.382567+0000","last_clean":"2024-03-20T13:38:32.382567+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:38:32.382567+0000","last_undegraded":"2024-03-20T13:38:32.382567+0000","last_fullsized":"2024-03-20T13:38:32.382567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.382310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:43.990067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.283141+0000","last_change":"2024-03-20T13:38:40.283141+0000","last_active":"2024-03-20T13:38:40.283141+0000","last_peered":"2024-03-20T13:38:40.283141+0000","last_clean":"2024-03-20T13:38:40.283141+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:40.283141+0000","last_undegraded":"2024-03-20T13:38:40.283141+0000","last_fullsized":"2024-03-20T13:38:40.283141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.282858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:43:36.602180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.518505+0000","last_change":"2024-03-20T13:38:34.518505+0000","last_active":"2024-03-20T13:38:34.518505+0000","last_peered":"2024-03-20T13:38:34.518505+0000","last_clean":"2024-03-20T13:38:34.518505+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:38:34.518505+0000","last_undegraded":"2024-03-20T13:38:34.518505+0000","last_fullsized":"2024-03-20T13:38:34.518505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:09.209953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160763+0000","last_change":"2024-03-20T13:36:46.889881+0000","last_active":"2024-03-20T13:38:22.160763+0000","last_peered":"2024-03-20T13:38:22.160763+0000","last_clean":"2024-03-20T13:38:22.160763+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:38:22.160763+0000","last_undegraded":"2024-03-20T13:38:22.160763+0000","last_fullsized":"2024-03-20T13:38:22.160763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.514149+0000","last_change":"2024-03-20T13:38:49.514149+0000","last_active":"2024-03-20T13:38:49.514149+0000","last_peered":"2024-03-20T13:38:49.514149+0000","last_clean":"2024-03-20T13:38:49.514149+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:38:49.514149+0000","last_undegraded":"2024-03-20T13:38:49.514149+0000","last_fullsized":"2024-03-20T13:38:49.514149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:38:49.513894+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:38:49.513894+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.513894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:37:53.473877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.290698+0000","last_change":"2024-03-20T13:39:09.290698+0000","last_active":"2024-03-20T13:39:09.290698+0000","last_peered":"2024-03-20T13:39:09.290698+0000","last_clean":"2024-03-20T13:39:09.290698+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:39:09.290698+0000","last_undegraded":"2024-03-20T13:39:09.290698+0000","last_fullsized":"2024-03-20T13:39:09.290698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:09.290434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:09.290434+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.290434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:15.762675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.419777+0000","last_change":"2024-03-20T13:38:22.419777+0000","last_active":"2024-03-20T13:38:22.419777+0000","last_peered":"2024-03-20T13:38:22.419777+0000","last_clean":"2024-03-20T13:38:22.419777+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:38:22.419777+0000","last_undegraded":"2024-03-20T13:38:22.419777+0000","last_fullsized":"2024-03-20T13:38:22.419777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_clean_scrub_stamp":"2024-03-20T13:38:22.419651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:45.953043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.566628+0000","last_change":"2024-03-20T13:38:44.566628+0000","last_active":"2024-03-20T13:38:44.566628+0000","last_peered":"2024-03-20T13:38:44.566628+0000","last_clean":"2024-03-20T13:38:44.566628+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:44.566628+0000","last_undegraded":"2024-03-20T13:38:44.566628+0000","last_fullsized":"2024-03-20T13:38:44.566628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-03-20T13:38:44.566362+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-03-20T13:38:44.566362+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.566362+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:01.080651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.540382+0000","last_change":"2024-03-20T13:38:38.540382+0000","last_active":"2024-03-20T13:38:38.540382+0000","last_peered":"2024-03-20T13:38:38.540382+0000","last_clean":"2024-03-20T13:38:38.540382+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:38:38.540382+0000","last_undegraded":"2024-03-20T13:38:38.540382+0000","last_fullsized":"2024-03-20T13:38:38.540382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.540096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:29:14.710303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160752+0000","last_change":"2024-03-20T13:36:46.880883+0000","last_active":"2024-03-20T13:38:22.160752+0000","last_peered":"2024-03-20T13:38:22.160752+0000","last_clean":"2024-03-20T13:38:22.160752+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:38:22.160752+0000","last_undegraded":"2024-03-20T13:38:22.160752+0000","last_fullsized":"2024-03-20T13:38:22.160752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.833581+0000","last_change":"2024-03-20T13:38:48.833581+0000","last_active":"2024-03-20T13:38:48.833581+0000","last_peered":"2024-03-20T13:38:48.833581+0000","last_clean":"2024-03-20T13:38:48.833581+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:38:48.833581+0000","last_undegraded":"2024-03-20T13:38:48.833581+0000","last_fullsized":"2024-03-20T13:38:48.833581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:48.833308+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:48.833308+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.833308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:42.905473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542188+0000","last_change":"2024-03-20T13:36:36.841132+0000","last_active":"2024-03-20T13:38:23.542188+0000","last_peered":"2024-03-20T13:38:23.542188+0000","last_clean":"2024-03-20T13:38:23.542188+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:38:23.542188+0000","last_undegraded":"2024-03-20T13:38:23.542188+0000","last_fullsized":"2024-03-20T13:38:23.542188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.664389+0000","last_change":"2024-03-20T13:38:41.664389+0000","last_active":"2024-03-20T13:38:41.664389+0000","last_peered":"2024-03-20T13:38:41.664389+0000","last_clean":"2024-03-20T13:38:41.664389+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:38:41.664389+0000","last_undegraded":"2024-03-20T13:38:41.664389+0000","last_fullsized":"2024-03-20T13:38:41.664389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:41.664105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:41.664105+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.664105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:34:12.132470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.687890+0000","last_change":"2024-03-20T13:38:25.687890+0000","last_active":"2024-03-20T13:38:25.687890+0000","last_peered":"2024-03-20T13:38:25.687890+0000","last_clean":"2024-03-20T13:38:25.687890+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:38:25.687890+0000","last_undegraded":"2024-03-20T13:38:25.687890+0000","last_fullsized":"2024-03-20T13:38:25.687890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.687477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.537657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'244","reported_seq":318,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.369936+0000","last_change":"2024-03-20T13:38:49.369936+0000","last_active":"2024-03-20T13:38:49.369936+0000","last_peered":"2024-03-20T13:38:49.369936+0000","last_clean":"2024-03-20T13:38:49.369936+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:49.369936+0000","last_undegraded":"2024-03-20T13:38:49.369936+0000","last_fullsized":"2024-03-20T13:38:49.369936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:38:49.369673+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:38:49.369673+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.369673+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:42:52.765055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160793+0000","last_change":"2024-03-20T13:36:46.890336+0000","last_active":"2024-03-20T13:38:22.160793+0000","last_peered":"2024-03-20T13:38:22.160793+0000","last_clean":"2024-03-20T13:38:22.160793+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:38:22.160793+0000","last_undegraded":"2024-03-20T13:38:22.160793+0000","last_fullsized":"2024-03-20T13:38:22.160793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.746741+0000","last_change":"2024-03-20T13:38:44.746741+0000","last_active":"2024-03-20T13:38:44.746741+0000","last_peered":"2024-03-20T13:38:44.746741+0000","last_clean":"2024-03-20T13:38:44.746741+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:38:44.746741+0000","last_undegraded":"2024-03-20T13:38:44.746741+0000","last_fullsized":"2024-03-20T13:38:44.746741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:44.746483+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:44.746483+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.746483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:06.855881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.735541+0000","last_change":"2024-03-20T13:38:59.735541+0000","last_active":"2024-03-20T13:38:59.735541+0000","last_peered":"2024-03-20T13:38:59.735541+0000","last_clean":"2024-03-20T13:38:59.735541+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:38:59.735541+0000","last_undegraded":"2024-03-20T13:38:59.735541+0000","last_fullsized":"2024-03-20T13:38:59.735541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.735288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.735288+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.735288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:00:05.162580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.525470+0000","last_change":"2024-03-20T13:38:36.525470+0000","last_active":"2024-03-20T13:38:36.525470+0000","last_peered":"2024-03-20T13:38:36.525470+0000","last_clean":"2024-03-20T13:38:36.525470+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:36.525470+0000","last_undegraded":"2024-03-20T13:38:36.525470+0000","last_fullsized":"2024-03-20T13:38:36.525470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.525211+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:48:52.542790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.359327+0000","last_change":"2024-03-20T13:38:35.359327+0000","last_active":"2024-03-20T13:38:35.359327+0000","last_peered":"2024-03-20T13:38:35.359327+0000","last_clean":"2024-03-20T13:38:35.359327+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:35.359327+0000","last_undegraded":"2024-03-20T13:38:35.359327+0000","last_fullsized":"2024-03-20T13:38:35.359327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.359044+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:38.277772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.612986+0000","last_change":"2024-03-20T13:38:37.612986+0000","last_active":"2024-03-20T13:38:37.612986+0000","last_peered":"2024-03-20T13:38:37.612986+0000","last_clean":"2024-03-20T13:38:37.612986+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:38:37.612986+0000","last_undegraded":"2024-03-20T13:38:37.612986+0000","last_fullsized":"2024-03-20T13:38:37.612986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.612746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:43.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160711+0000","last_change":"2024-03-20T13:36:46.880666+0000","last_active":"2024-03-20T13:38:22.160711+0000","last_peered":"2024-03-20T13:38:22.160711+0000","last_clean":"2024-03-20T13:38:22.160711+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:38:22.160711+0000","last_undegraded":"2024-03-20T13:38:22.160711+0000","last_fullsized":"2024-03-20T13:38:22.160711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.346364+0000","last_change":"2024-03-20T13:39:04.346364+0000","last_active":"2024-03-20T13:39:04.346364+0000","last_peered":"2024-03-20T13:39:04.346364+0000","last_clean":"2024-03-20T13:39:04.346364+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:39:04.346364+0000","last_undegraded":"2024-03-20T13:39:04.346364+0000","last_fullsized":"2024-03-20T13:39:04.346364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:04.346110+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:04.346110+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.346110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:59:39.692731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:13.378455+0000","last_change":"2024-03-20T13:39:13.378513+0000","last_active":"2024-03-20T13:39:13.378455+0000","last_peered":"2024-03-20T13:39:13.378455+0000","last_clean":"2024-03-20T13:39:13.378455+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:39:13.378455+0000","last_undegraded":"2024-03-20T13:39:13.378455+0000","last_fullsized":"2024-03-20T13:39:13.378455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:13.378252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:13.378252+0000","last_clean_scrub_stamp":"2024-03-20T13:39:13.378252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:29.653038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":211,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.392546+0000","last_change":"2024-03-20T13:38:28.392546+0000","last_active":"2024-03-20T13:38:28.392546+0000","last_peered":"2024-03-20T13:38:28.392546+0000","last_clean":"2024-03-20T13:38:28.392546+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:28.392546+0000","last_undegraded":"2024-03-20T13:38:28.392546+0000","last_fullsized":"2024-03-20T13:38:28.392546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.392293+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.200294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.510699+0000","last_change":"2024-03-20T13:38:33.510699+0000","last_active":"2024-03-20T13:38:33.510699+0000","last_peered":"2024-03-20T13:38:33.510699+0000","last_clean":"2024-03-20T13:38:33.510699+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:33.510699+0000","last_undegraded":"2024-03-20T13:38:33.510699+0000","last_fullsized":"2024-03-20T13:38:33.510699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.510425+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:36.604731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.298312+0000","last_change":"2024-03-20T13:38:37.298312+0000","last_active":"2024-03-20T13:38:37.298312+0000","last_peered":"2024-03-20T13:38:37.298312+0000","last_clean":"2024-03-20T13:38:37.298312+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:38:37.298312+0000","last_undegraded":"2024-03-20T13:38:37.298312+0000","last_fullsized":"2024-03-20T13:38:37.298312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.297989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:19.272096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544875+0000","last_change":"2024-03-20T13:36:46.896802+0000","last_active":"2024-03-20T13:38:23.544875+0000","last_peered":"2024-03-20T13:38:23.544875+0000","last_clean":"2024-03-20T13:38:23.544875+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:38:23.544875+0000","last_undegraded":"2024-03-20T13:38:23.544875+0000","last_fullsized":"2024-03-20T13:38:23.544875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.497062+0000","last_change":"2024-03-20T13:39:01.497062+0000","last_active":"2024-03-20T13:39:01.497062+0000","last_peered":"2024-03-20T13:39:01.497062+0000","last_clean":"2024-03-20T13:39:01.497062+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:39:01.497062+0000","last_undegraded":"2024-03-20T13:39:01.497062+0000","last_fullsized":"2024-03-20T13:39:01.497062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:01.496800+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:01.496800+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.496800+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:34:29.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.452007+0000","last_change":"2024-03-20T13:39:07.452063+0000","last_active":"2024-03-20T13:39:07.452007+0000","last_peered":"2024-03-20T13:39:07.452007+0000","last_clean":"2024-03-20T13:39:07.452007+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:39:07.452007+0000","last_undegraded":"2024-03-20T13:39:07.452007+0000","last_fullsized":"2024-03-20T13:39:07.452007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:07.451818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:07.451818+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.451818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:11:49.069638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.568554+0000","last_change":"2024-03-20T13:38:37.568554+0000","last_active":"2024-03-20T13:38:37.568554+0000","last_peered":"2024-03-20T13:38:37.568554+0000","last_clean":"2024-03-20T13:38:37.568554+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:38:37.568554+0000","last_undegraded":"2024-03-20T13:38:37.568554+0000","last_fullsized":"2024-03-20T13:38:37.568554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.568192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:02:40.953434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.672659+0000","last_change":"2024-03-20T13:38:23.672659+0000","last_active":"2024-03-20T13:38:23.672659+0000","last_peered":"2024-03-20T13:38:23.672659+0000","last_clean":"2024-03-20T13:38:23.672659+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:23.672659+0000","last_undegraded":"2024-03-20T13:38:23.672659+0000","last_fullsized":"2024-03-20T13:38:23.672659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.672372+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:19.543310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.372209+0000","last_change":"2024-03-20T13:38:57.372209+0000","last_active":"2024-03-20T13:38:57.372209+0000","last_peered":"2024-03-20T13:38:57.372209+0000","last_clean":"2024-03-20T13:38:57.372209+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:38:57.372209+0000","last_undegraded":"2024-03-20T13:38:57.372209+0000","last_fullsized":"2024-03-20T13:38:57.372209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:57.371958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:57.371958+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.371958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:49.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.544827+0000","last_change":"2024-03-20T13:36:46.895376+0000","last_active":"2024-03-20T13:38:23.544827+0000","last_peered":"2024-03-20T13:38:23.544827+0000","last_clean":"2024-03-20T13:38:23.544827+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:38:23.544827+0000","last_undegraded":"2024-03-20T13:38:23.544827+0000","last_fullsized":"2024-03-20T13:38:23.544827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.374114+0000","last_change":"2024-03-20T13:38:48.374114+0000","last_active":"2024-03-20T13:38:48.374114+0000","last_peered":"2024-03-20T13:38:48.374114+0000","last_clean":"2024-03-20T13:38:48.374114+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:38:48.374114+0000","last_undegraded":"2024-03-20T13:38:48.374114+0000","last_fullsized":"2024-03-20T13:38:48.374114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-03-20T13:38:48.373835+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-03-20T13:38:48.373835+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.373835+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:21:02.963289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.787714+0000","last_change":"2024-03-20T13:39:09.787770+0000","last_active":"2024-03-20T13:39:09.787714+0000","last_peered":"2024-03-20T13:39:09.787714+0000","last_clean":"2024-03-20T13:39:09.787714+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:39:09.787714+0000","last_undegraded":"2024-03-20T13:39:09.787714+0000","last_fullsized":"2024-03-20T13:39:09.787714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:09.787528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:09.787528+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.787528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:47:15.649724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.505456+0000","last_change":"2024-03-20T13:38:35.505456+0000","last_active":"2024-03-20T13:38:35.505456+0000","last_peered":"2024-03-20T13:38:35.505456+0000","last_clean":"2024-03-20T13:38:35.505456+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:38:35.505456+0000","last_undegraded":"2024-03-20T13:38:35.505456+0000","last_fullsized":"2024-03-20T13:38:35.505456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.505077+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:06.593833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.336933+0000","last_change":"2024-03-20T13:38:43.336933+0000","last_active":"2024-03-20T13:38:43.336933+0000","last_peered":"2024-03-20T13:38:43.336933+0000","last_clean":"2024-03-20T13:38:43.336933+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:43.336933+0000","last_undegraded":"2024-03-20T13:38:43.336933+0000","last_fullsized":"2024-03-20T13:38:43.336933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-03-20T13:38:43.336633+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-03-20T13:38:43.336633+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.336633+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:42:40.193080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.579425+0000","last_change":"2024-03-20T13:38:27.579425+0000","last_active":"2024-03-20T13:38:27.579425+0000","last_peered":"2024-03-20T13:38:27.579425+0000","last_clean":"2024-03-20T13:38:27.579425+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:38:27.579425+0000","last_undegraded":"2024-03-20T13:38:27.579425+0000","last_fullsized":"2024-03-20T13:38:27.579425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.579191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:01.136809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.160937+0000","last_change":"2024-03-20T13:36:46.880370+0000","last_active":"2024-03-20T13:38:22.160937+0000","last_peered":"2024-03-20T13:38:22.160937+0000","last_clean":"2024-03-20T13:38:22.160937+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:38:22.160937+0000","last_undegraded":"2024-03-20T13:38:22.160937+0000","last_fullsized":"2024-03-20T13:38:22.160937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.843813+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.843813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.766679+0000","last_change":"2024-03-20T13:39:10.766737+0000","last_active":"2024-03-20T13:39:10.766679+0000","last_peered":"2024-03-20T13:39:10.766679+0000","last_clean":"2024-03-20T13:39:10.766679+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:39:10.766679+0000","last_undegraded":"2024-03-20T13:39:10.766679+0000","last_fullsized":"2024-03-20T13:39:10.766679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:10.766478+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:10.766478+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.766478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:50:15.671047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.643901+0000","last_change":"2024-03-20T13:38:59.643969+0000","last_active":"2024-03-20T13:38:59.643901+0000","last_peered":"2024-03-20T13:38:59.643901+0000","last_clean":"2024-03-20T13:38:59.643901+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:38:59.643901+0000","last_undegraded":"2024-03-20T13:38:59.643901+0000","last_fullsized":"2024-03-20T13:38:59.643901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.643704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.643704+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.643704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:06.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.599638+0000","last_change":"2024-03-20T13:38:51.599723+0000","last_active":"2024-03-20T13:38:51.599638+0000","last_peered":"2024-03-20T13:38:51.599638+0000","last_clean":"2024-03-20T13:38:51.599638+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:38:51.599638+0000","last_undegraded":"2024-03-20T13:38:51.599638+0000","last_fullsized":"2024-03-20T13:38:51.599638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:51.599437+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:51.599437+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.599437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:17.080484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.596554+0000","last_change":"2024-03-20T13:39:01.596627+0000","last_active":"2024-03-20T13:39:01.596554+0000","last_peered":"2024-03-20T13:39:01.596554+0000","last_clean":"2024-03-20T13:39:01.596554+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:39:01.596554+0000","last_undegraded":"2024-03-20T13:39:01.596554+0000","last_fullsized":"2024-03-20T13:39:01.596554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:01.596352+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:01.596352+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.596352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:25.375658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.344552+0000","last_change":"2024-03-20T13:38:52.344609+0000","last_active":"2024-03-20T13:38:52.344552+0000","last_peered":"2024-03-20T13:38:52.344552+0000","last_clean":"2024-03-20T13:38:52.344552+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:38:52.344552+0000","last_undegraded":"2024-03-20T13:38:52.344552+0000","last_fullsized":"2024-03-20T13:38:52.344552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:52.344358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:52.344358+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.344358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:21.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:15.411076+0000","last_change":"2024-03-20T13:39:15.411138+0000","last_active":"2024-03-20T13:39:15.411076+0000","last_peered":"2024-03-20T13:39:15.411076+0000","last_clean":"2024-03-20T13:39:15.411076+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:39:15.411076+0000","last_undegraded":"2024-03-20T13:39:15.411076+0000","last_fullsized":"2024-03-20T13:39:15.411076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:15.410878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:15.410878+0000","last_clean_scrub_stamp":"2024-03-20T13:39:15.410878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:58:22.162158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.564094+0000","last_change":"2024-03-20T13:38:47.564094+0000","last_active":"2024-03-20T13:38:47.564094+0000","last_peered":"2024-03-20T13:38:47.564094+0000","last_clean":"2024-03-20T13:38:47.564094+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:38:47.564094+0000","last_undegraded":"2024-03-20T13:38:47.564094+0000","last_fullsized":"2024-03-20T13:38:47.564094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:47.563835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:47.563835+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.563835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:59:16.361280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.663539+0000","last_change":"2024-03-20T13:38:57.663612+0000","last_active":"2024-03-20T13:38:57.663539+0000","last_peered":"2024-03-20T13:38:57.663539+0000","last_clean":"2024-03-20T13:38:57.663539+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:57.663539+0000","last_undegraded":"2024-03-20T13:38:57.663539+0000","last_fullsized":"2024-03-20T13:38:57.663539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:57.663332+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:57.663332+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.663332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:47.108625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.661137+0000","last_change":"2024-03-20T13:39:10.661208+0000","last_active":"2024-03-20T13:39:10.661137+0000","last_peered":"2024-03-20T13:39:10.661137+0000","last_clean":"2024-03-20T13:39:10.661137+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:39:10.661137+0000","last_undegraded":"2024-03-20T13:39:10.661137+0000","last_fullsized":"2024-03-20T13:39:10.661137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:10.660938+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:10.660938+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.660938+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:02:00.514626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:20.431918+0000","last_change":"2024-03-20T13:39:20.431986+0000","last_active":"2024-03-20T13:39:20.431918+0000","last_peered":"2024-03-20T13:39:20.431918+0000","last_clean":"2024-03-20T13:39:20.431918+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:39:20.431918+0000","last_undegraded":"2024-03-20T13:39:20.431918+0000","last_fullsized":"2024-03-20T13:39:20.431918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:20.431704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:20.431704+0000","last_clean_scrub_stamp":"2024-03-20T13:39:20.431704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:50:11.352075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.602517+0000","last_change":"2024-03-20T13:38:52.602578+0000","last_active":"2024-03-20T13:38:52.602517+0000","last_peered":"2024-03-20T13:38:52.602517+0000","last_clean":"2024-03-20T13:38:52.602517+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:38:52.602517+0000","last_undegraded":"2024-03-20T13:38:52.602517+0000","last_fullsized":"2024-03-20T13:38:52.602517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:52.602307+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.602307+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.602307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:59:45.472743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:17.724032+0000","last_change":"2024-03-20T13:39:17.724171+0000","last_active":"2024-03-20T13:39:17.724032+0000","last_peered":"2024-03-20T13:39:17.724032+0000","last_clean":"2024-03-20T13:39:17.724032+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:39:17.724032+0000","last_undegraded":"2024-03-20T13:39:17.724032+0000","last_fullsized":"2024-03-20T13:39:17.724032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:17.723757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:17.723757+0000","last_clean_scrub_stamp":"2024-03-20T13:39:17.723757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:00.930961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.433351+0000","last_change":"2024-03-20T13:38:52.433522+0000","last_active":"2024-03-20T13:38:52.433351+0000","last_peered":"2024-03-20T13:38:52.433351+0000","last_clean":"2024-03-20T13:38:52.433351+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:52.433351+0000","last_undegraded":"2024-03-20T13:38:52.433351+0000","last_fullsized":"2024-03-20T13:38:52.433351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:52.433131+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.433131+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.433131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:53.839074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.748399+0000","last_change":"2024-03-20T13:38:53.748455+0000","last_active":"2024-03-20T13:38:53.748399+0000","last_peered":"2024-03-20T13:38:53.748399+0000","last_clean":"2024-03-20T13:38:53.748399+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:38:53.748399+0000","last_undegraded":"2024-03-20T13:38:53.748399+0000","last_fullsized":"2024-03-20T13:38:53.748399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:53.748204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:53.748204+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.748204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:12:58.243259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.362506+0000","last_change":"2024-03-20T13:39:00.362567+0000","last_active":"2024-03-20T13:39:00.362506+0000","last_peered":"2024-03-20T13:39:00.362506+0000","last_clean":"2024-03-20T13:39:00.362506+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:39:00.362506+0000","last_undegraded":"2024-03-20T13:39:00.362506+0000","last_fullsized":"2024-03-20T13:39:00.362506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.362303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.362303+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.362303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:46.447885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542278+0000","last_change":"2024-03-20T13:36:36.845848+0000","last_active":"2024-03-20T13:38:23.542278+0000","last_peered":"2024-03-20T13:38:23.542278+0000","last_clean":"2024-03-20T13:38:23.542278+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:38:23.542278+0000","last_undegraded":"2024-03-20T13:38:23.542278+0000","last_fullsized":"2024-03-20T13:38:23.542278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.609193+0000","last_change":"2024-03-20T13:38:49.609193+0000","last_active":"2024-03-20T13:38:49.609193+0000","last_peered":"2024-03-20T13:38:49.609193+0000","last_clean":"2024-03-20T13:38:49.609193+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:49.609193+0000","last_undegraded":"2024-03-20T13:38:49.609193+0000","last_fullsized":"2024-03-20T13:38:49.609193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:49.608940+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:49.608940+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.608940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:56:54.242319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542395+0000","last_change":"2024-03-20T13:36:36.845918+0000","last_active":"2024-03-20T13:38:23.542395+0000","last_peered":"2024-03-20T13:38:23.542395+0000","last_clean":"2024-03-20T13:38:23.542395+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:38:23.542395+0000","last_undegraded":"2024-03-20T13:38:23.542395+0000","last_fullsized":"2024-03-20T13:38:23.542395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.476851+0000","last_change":"2024-03-20T13:39:00.476851+0000","last_active":"2024-03-20T13:39:00.476851+0000","last_peered":"2024-03-20T13:39:00.476851+0000","last_clean":"2024-03-20T13:39:00.476851+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:39:00.476851+0000","last_undegraded":"2024-03-20T13:39:00.476851+0000","last_fullsized":"2024-03-20T13:39:00.476851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.476528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.476528+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.476528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:46.562110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.427599+0000","last_change":"2024-03-20T13:39:11.427656+0000","last_active":"2024-03-20T13:39:11.427599+0000","last_peered":"2024-03-20T13:39:11.427599+0000","last_clean":"2024-03-20T13:39:11.427599+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:39:11.427599+0000","last_undegraded":"2024-03-20T13:39:11.427599+0000","last_fullsized":"2024-03-20T13:39:11.427599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:11.427382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:11.427382+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.427382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.678738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.619511+0000","last_change":"2024-03-20T13:38:40.619511+0000","last_active":"2024-03-20T13:38:40.619511+0000","last_peered":"2024-03-20T13:38:40.619511+0000","last_clean":"2024-03-20T13:38:40.619511+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:40.619511+0000","last_undegraded":"2024-03-20T13:38:40.619511+0000","last_fullsized":"2024-03-20T13:38:40.619511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.619249+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:28.069678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:12.372739+0000","last_change":"2024-03-20T13:39:12.372938+0000","last_active":"2024-03-20T13:39:12.372739+0000","last_peered":"2024-03-20T13:39:12.372739+0000","last_clean":"2024-03-20T13:39:12.372739+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:39:12.372739+0000","last_undegraded":"2024-03-20T13:39:12.372739+0000","last_fullsized":"2024-03-20T13:39:12.372739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:12.372507+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:12.372507+0000","last_clean_scrub_stamp":"2024-03-20T13:39:12.372507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:30:32.363210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.633242+0000","last_change":"2024-03-20T13:39:11.633297+0000","last_active":"2024-03-20T13:39:11.633242+0000","last_peered":"2024-03-20T13:39:11.633242+0000","last_clean":"2024-03-20T13:39:11.633242+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:39:11.633242+0000","last_undegraded":"2024-03-20T13:39:11.633242+0000","last_fullsized":"2024-03-20T13:39:11.633242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:11.633049+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:11.633049+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.633049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:51.655342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:19.765783+0000","last_change":"2024-03-20T13:39:19.765841+0000","last_active":"2024-03-20T13:39:19.765783+0000","last_peered":"2024-03-20T13:39:19.765783+0000","last_clean":"2024-03-20T13:39:19.765783+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:39:19.765783+0000","last_undegraded":"2024-03-20T13:39:19.765783+0000","last_fullsized":"2024-03-20T13:39:19.765783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:19.765555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:19.765555+0000","last_clean_scrub_stamp":"2024-03-20T13:39:19.765555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:09:03.411339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.387483+0000","last_change":"2024-03-20T13:39:02.387551+0000","last_active":"2024-03-20T13:39:02.387483+0000","last_peered":"2024-03-20T13:39:02.387483+0000","last_clean":"2024-03-20T13:39:02.387483+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:39:02.387483+0000","last_undegraded":"2024-03-20T13:39:02.387483+0000","last_fullsized":"2024-03-20T13:39:02.387483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:02.387285+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:02.387285+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.387285+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:34.213252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.542549+0000","last_change":"2024-03-20T13:36:36.844804+0000","last_active":"2024-03-20T13:38:23.542549+0000","last_peered":"2024-03-20T13:38:23.542549+0000","last_clean":"2024-03-20T13:38:23.542549+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:38:23.542549+0000","last_undegraded":"2024-03-20T13:38:23.542549+0000","last_fullsized":"2024-03-20T13:38:23.542549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.773600+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.773600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.595311+0000","last_change":"2024-03-20T13:39:08.595470+0000","last_active":"2024-03-20T13:39:08.595311+0000","last_peered":"2024-03-20T13:39:08.595311+0000","last_clean":"2024-03-20T13:39:08.595311+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:39:08.595311+0000","last_undegraded":"2024-03-20T13:39:08.595311+0000","last_fullsized":"2024-03-20T13:39:08.595311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:08.595078+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:08.595078+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.595078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:22:49.573330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.457481+0000","last_change":"2024-03-20T13:39:09.457563+0000","last_active":"2024-03-20T13:39:09.457481+0000","last_peered":"2024-03-20T13:39:09.457481+0000","last_clean":"2024-03-20T13:39:09.457481+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:39:09.457481+0000","last_undegraded":"2024-03-20T13:39:09.457481+0000","last_fullsized":"2024-03-20T13:39:09.457481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:09.457273+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:09.457273+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.457273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:25.152600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.492407+0000","last_change":"2024-03-20T13:38:50.492407+0000","last_active":"2024-03-20T13:38:50.492407+0000","last_peered":"2024-03-20T13:38:50.492407+0000","last_clean":"2024-03-20T13:38:50.492407+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:38:50.492407+0000","last_undegraded":"2024-03-20T13:38:50.492407+0000","last_fullsized":"2024-03-20T13:38:50.492407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:50.492146+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:50.492146+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.492146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:27:39.693616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.681515+0000","last_change":"2024-03-20T13:38:55.681515+0000","last_active":"2024-03-20T13:38:55.681515+0000","last_peered":"2024-03-20T13:38:55.681515+0000","last_clean":"2024-03-20T13:38:55.681515+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:38:55.681515+0000","last_undegraded":"2024-03-20T13:38:55.681515+0000","last_fullsized":"2024-03-20T13:38:55.681515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:55.681247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:55.681247+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.681247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:45.489248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.348642+0000","last_change":"2024-03-20T13:39:03.348706+0000","last_active":"2024-03-20T13:39:03.348642+0000","last_peered":"2024-03-20T13:39:03.348642+0000","last_clean":"2024-03-20T13:39:03.348642+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:39:03.348642+0000","last_undegraded":"2024-03-20T13:39:03.348642+0000","last_fullsized":"2024-03-20T13:39:03.348642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:03.348438+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:03.348438+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.348438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:27:05.021930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:16.365744+0000","last_change":"2024-03-20T13:39:16.365814+0000","last_active":"2024-03-20T13:39:16.365744+0000","last_peered":"2024-03-20T13:39:16.365744+0000","last_clean":"2024-03-20T13:39:16.365744+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:39:16.365744+0000","last_undegraded":"2024-03-20T13:39:16.365744+0000","last_fullsized":"2024-03-20T13:39:16.365744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:16.365556+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:16.365556+0000","last_clean_scrub_stamp":"2024-03-20T13:39:16.365556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:27.751836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.274908+0000","last_change":"2024-03-20T13:39:08.274971+0000","last_active":"2024-03-20T13:39:08.274908+0000","last_peered":"2024-03-20T13:39:08.274908+0000","last_clean":"2024-03-20T13:39:08.274908+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:39:08.274908+0000","last_undegraded":"2024-03-20T13:39:08.274908+0000","last_fullsized":"2024-03-20T13:39:08.274908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:08.274706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:08.274706+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.274706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:45.027984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.651777+0000","last_change":"2024-03-20T13:38:41.651777+0000","last_active":"2024-03-20T13:38:41.651777+0000","last_peered":"2024-03-20T13:38:41.651777+0000","last_clean":"2024-03-20T13:38:41.651777+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:38:41.651777+0000","last_undegraded":"2024-03-20T13:38:41.651777+0000","last_fullsized":"2024-03-20T13:38:41.651777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:41.651396+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:41.651396+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.651396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:02.659444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.678149+0000","last_change":"2024-03-20T13:39:03.678326+0000","last_active":"2024-03-20T13:39:03.678149+0000","last_peered":"2024-03-20T13:39:03.678149+0000","last_clean":"2024-03-20T13:39:03.678149+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:39:03.678149+0000","last_undegraded":"2024-03-20T13:39:03.678149+0000","last_fullsized":"2024-03-20T13:39:03.678149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:03.677935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:03.677935+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.677935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:45:21.933138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.690058+0000","last_change":"2024-03-20T13:38:58.690058+0000","last_active":"2024-03-20T13:38:58.690058+0000","last_peered":"2024-03-20T13:38:58.690058+0000","last_clean":"2024-03-20T13:38:58.690058+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:38:58.690058+0000","last_undegraded":"2024-03-20T13:38:58.690058+0000","last_fullsized":"2024-03-20T13:38:58.690058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:58.689817+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:58.689817+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.689817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.319664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1416,"ondisk_log_size":1416,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673000,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38200000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77900000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.77300000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Mar 20 13:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.89200000000000002,"5min":1.04,"15min":1.04},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71999999999999997,"5min":1.216,"15min":1.216},"last":0.57799999999999996}]}]},{"osd":2,"up_from":10,"seq":42949673001,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81100000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.224,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.25600000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.746,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.76700000000000002}]},{"osd":3,"last update":"Wed Mar 20 13:38:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.63},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.75,"5min":1.145,"15min":1.145},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.315,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77500000000000002,"5min":1,"15min":1},"last":0.50900000000000001}]}]},{"osd":1,"up_from":10,"seq":42949672999,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.49099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.623},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79500000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.75800000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.71299999999999997,"5min":1.411,"15min":1.411},"last":0.53400000000000003}]},{"osd":3,"last update":"Wed Mar 20 13:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.38500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85099999999999998,"5min":1.117,"15min":1.117},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.80500000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80500000000000005}]},{"osd":2,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91500000000000004,"5min":1.161,"15min":1.161},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90600000000000003,"5min":1.052,"15min":1.052},"last":0.71399999999999997}]},{"osd":3,"last update":"Wed Mar 20 13:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:39:25.145 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-20T13:36:37.788403+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=37, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.146 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.146 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.146 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.146 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.147 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.147 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.147 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-20T13:36:43.836514+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=43, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.147 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.148 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.148 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.148 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.148 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.149 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.149 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.149 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.149 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.150 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.150 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.150 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.150 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.150 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.151 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.151 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.151 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:36:27.736046+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=27, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.151 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.151 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.152 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.152 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.152 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.152 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.153 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.153 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.153 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.153 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.153 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.154 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.154 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.154 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:36:45.843813+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=45, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.154 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.155 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.155 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:36:35.773600+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=35, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:39:25.155 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:39:45.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:39:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.282+0000 7fb6b9429640 1 Processor -- start 2024-03-20T13:39:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.282+0000 7fb6b9429640 1 -- start start 2024-03-20T13:39:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6b41290f0 0x7fb6b412c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b4095ee0 con 0x7fb6b4128d10 2024-03-20T13:39:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b4096320 con 0x7fb6b41290f0 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb6b4128d10 0x7fb6b412bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36038/0 (socket says 172.21.15.89:36038) 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b2ffd640 1 -- 172.21.15.89:0/2739513418 learned_addr learned my addr 172.21.15.89:0/2739513418 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b27fc640 1 --2- 172.21.15.89:0/2739513418 >> v2:172.21.15.89:3300/0 conn(0x7fb6b41290f0 0x7fb6b412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b1ffb640 1 -- 172.21.15.89:0/2739513418 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946565255 0 0) 0x7fb6b4095ee0 con 0x7fb6b4128d10 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b1ffb640 1 -- 172.21.15.89:0/2739513418 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a0003530 con 0x7fb6b4128d10 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b27fc640 1 -- 172.21.15.89:0/2739513418 >> v1:172.21.15.89:6789/0 conn(0x7fb6b4128d10 legacy=0x7fb6b412bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b1ffb640 1 -- 172.21.15.89:0/2739513418 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691332997 0 0) 0x7fb6a0003530 con 0x7fb6b4128d10 2024-03-20T13:39:45.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b27fc640 1 -- 172.21.15.89:0/2739513418 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4128620 con 0x7fb6b41290f0 2024-03-20T13:39:45.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b27fc640 1 --2- 172.21.15.89:0/2739513418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b41290f0 0x7fb6b412c230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009740 tx=0x7fb6a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3a802c5882a0a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:45.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b1ffb640 1 -- 172.21.15.89:0/2739513418 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6a40ac530 con 0x7fb6b41290f0 2024-03-20T13:39:45.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b1ffb640 1 -- 172.21.15.89:0/2739513418 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a40a8050 con 0x7fb6b41290f0 2024-03-20T13:39:45.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b1ffb640 1 -- 172.21.15.89:0/2739513418 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6a40ac7c0 con 0x7fb6b41290f0 2024-03-20T13:39:45.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 -- 172.21.15.89:0/2739513418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b41290f0 msgr2=0x7fb6b412c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 --2- 172.21.15.89:0/2739513418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b41290f0 0x7fb6b412c230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009740 tx=0x7fb6a401c490 comp rx=0 tx=0).stop 2024-03-20T13:39:45.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 -- 172.21.15.89:0/2739513418 shutdown_connections 2024-03-20T13:39:45.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 --2- 172.21.15.89:0/2739513418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b41290f0 0x7fb6b412c230 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.286+0000 7fb6b9429640 1 -- 172.21.15.89:0/2739513418 >> 172.21.15.89:0/2739513418 conn(0x7fb6b409a2f0 msgr2=0x7fb6b409a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:45.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- 172.21.15.89:0/2739513418 shutdown_connections 2024-03-20T13:39:45.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- 172.21.15.89:0/2739513418 wait complete. 2024-03-20T13:39:45.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 Processor -- start 2024-03-20T13:39:45.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- start start 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 0x7fb6b412ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b41310d0 con 0x7fb6b4128d10 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 0x7fb6b412ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 0x7fb6b412ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45432/0 (socket says 172.21.15.89:45432) 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b2ffd640 1 -- 172.21.15.89:0/1237529298 learned_addr learned my addr 172.21.15.89:0/1237529298 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b2ffd640 1 -- 172.21.15.89:0/1237529298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009420 con 0x7fb6b4128d10 2024-03-20T13:39:45.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b2ffd640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 0x7fb6b412ead0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001ec0 tx=0x7fb69c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb69c005c20 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c005d80 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b4130460 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb69c007240 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b4130c80 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b4067e00 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb69c0073a0 con 0x7fb6b4128d10 2024-03-20T13:39:45.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6ab7fe640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb694035a10 0x7fb694037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:45.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fb69c047e20 con 0x7fb6b4128d10 2024-03-20T13:39:45.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.290+0000 7fb6b27fc640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb694035a10 0x7fb694037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:45.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.294+0000 7fb6b27fc640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb694035a10 0x7fb694037ed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ae000 tx=0x7fb6a40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:45.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.294+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb69c019bc0 con 0x7fb6b4128d10 2024-03-20T13:39:45.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.450+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 --> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6b4122050 con 0x7fb694035a10 2024-03-20T13:39:45.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.498+0000 7fb6ab7fe640 1 -- 172.21.15.89:0/1237529298 <== mgr.4101 v2:172.21.15.123:6824/2420952722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+674105 (secure 0 0 0) 0x7fb6b4122050 con 0x7fb694035a10 2024-03-20T13:39:45.508 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-03-20T13:39:45.514 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-03-20T13:39:45.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb694035a10 msgr2=0x7fb694037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb694035a10 0x7fb694037ed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ae000 tx=0x7fb6a40a7000 comp rx=0 tx=0).stop 2024-03-20T13:39:45.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 msgr2=0x7fb6b412ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 0x7fb6b412ead0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001ec0 tx=0x7fb69c00c860 comp rx=0 tx=0).stop 2024-03-20T13:39:45.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 shutdown_connections 2024-03-20T13:39:45.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7fb694035a10 0x7fb694037ed0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 --2- 172.21.15.89:0/1237529298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6b4128d10 0x7fb6b412ead0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 >> 172.21.15.89:0/1237529298 conn(0x7fb6b409a2f0 msgr2=0x7fb6b4121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:45.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 shutdown_connections 2024-03-20T13:39:45.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.502+0000 7fb6b9429640 1 -- 172.21.15.89:0/1237529298 wait complete. 2024-03-20T13:39:45.530 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-03-20T13:39:44.367464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3999,"num_read_kb":3645,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152536,"kb_used_data":2872,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334824,"statfs":{"total":386547056640,"available":386390859776,"internally_reserved":0,"allocated":2940928,"data_stored":1796834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006745"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.320822+0000","last_change":"2024-03-20T13:39:07.320953+0000","last_active":"2024-03-20T13:39:07.320822+0000","last_peered":"2024-03-20T13:39:07.320822+0000","last_clean":"2024-03-20T13:39:07.320822+0000","last_became_active":"2024-03-20T13:36:36.829937+0000","last_became_peered":"2024-03-20T13:36:36.829937+0000","last_unstale":"2024-03-20T13:39:07.320822+0000","last_undegraded":"2024-03-20T13:39:07.320822+0000","last_fullsized":"2024-03-20T13:39:07.320822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:07.320546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:07.320546+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.320546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:11:48.938365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.364209+0000","last_change":"2024-03-20T13:38:54.364209+0000","last_active":"2024-03-20T13:38:54.364209+0000","last_peered":"2024-03-20T13:38:54.364209+0000","last_clean":"2024-03-20T13:38:54.364209+0000","last_became_active":"2024-03-20T13:36:38.832622+0000","last_became_peered":"2024-03-20T13:36:38.832622+0000","last_unstale":"2024-03-20T13:38:54.364209+0000","last_undegraded":"2024-03-20T13:38:54.364209+0000","last_fullsized":"2024-03-20T13:38:54.364209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:54.363935+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:54.363935+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.363935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:52.089220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.643293+0000","last_change":"2024-03-20T13:38:57.643357+0000","last_active":"2024-03-20T13:38:57.643293+0000","last_peered":"2024-03-20T13:38:57.643293+0000","last_clean":"2024-03-20T13:38:57.643293+0000","last_became_active":"2024-03-20T13:36:36.848720+0000","last_became_peered":"2024-03-20T13:36:36.848720+0000","last_unstale":"2024-03-20T13:38:57.643293+0000","last_undegraded":"2024-03-20T13:38:57.643293+0000","last_fullsized":"2024-03-20T13:38:57.643293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:57.643105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:57.643105+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.643105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:47:16.939195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:19.401082+0000","last_change":"2024-03-20T13:39:19.401143+0000","last_active":"2024-03-20T13:39:19.401082+0000","last_peered":"2024-03-20T13:39:19.401082+0000","last_clean":"2024-03-20T13:39:19.401082+0000","last_became_active":"2024-03-20T13:36:38.817553+0000","last_became_peered":"2024-03-20T13:36:38.817553+0000","last_unstale":"2024-03-20T13:39:19.401082+0000","last_undegraded":"2024-03-20T13:39:19.401082+0000","last_fullsized":"2024-03-20T13:39:19.401082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:19.400889+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:19.400889+0000","last_clean_scrub_stamp":"2024-03-20T13:39:19.400889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:42.035375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.494645+0000","last_change":"2024-03-20T13:39:06.494706+0000","last_active":"2024-03-20T13:39:06.494645+0000","last_peered":"2024-03-20T13:39:06.494645+0000","last_clean":"2024-03-20T13:39:06.494645+0000","last_became_active":"2024-03-20T13:36:36.844342+0000","last_became_peered":"2024-03-20T13:36:36.844342+0000","last_unstale":"2024-03-20T13:39:06.494645+0000","last_undegraded":"2024-03-20T13:39:06.494645+0000","last_fullsized":"2024-03-20T13:39:06.494645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:06.494452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:06.494452+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.494452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:40:20.307756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:29.474387+0000","last_change":"2024-03-20T13:39:29.474458+0000","last_active":"2024-03-20T13:39:29.474387+0000","last_peered":"2024-03-20T13:39:29.474387+0000","last_clean":"2024-03-20T13:39:29.474387+0000","last_became_active":"2024-03-20T13:36:38.818121+0000","last_became_peered":"2024-03-20T13:36:38.818121+0000","last_unstale":"2024-03-20T13:39:29.474387+0000","last_undegraded":"2024-03-20T13:39:29.474387+0000","last_fullsized":"2024-03-20T13:39:29.474387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-03-20T13:39:29.474182+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-03-20T13:39:29.474182+0000","last_clean_scrub_stamp":"2024-03-20T13:39:29.474182+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:47.724405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":17,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.643201+0000","last_change":"2024-03-20T13:39:00.643262+0000","last_active":"2024-03-20T13:39:00.643201+0000","last_peered":"2024-03-20T13:39:00.643201+0000","last_clean":"2024-03-20T13:39:00.643201+0000","last_became_active":"2024-03-20T13:36:36.813082+0000","last_became_peered":"2024-03-20T13:36:36.813082+0000","last_unstale":"2024-03-20T13:39:00.643201+0000","last_undegraded":"2024-03-20T13:39:00.643201+0000","last_fullsized":"2024-03-20T13:39:00.643201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.643010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.643010+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.643010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:32:09.489594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.517649+0000","last_change":"2024-03-20T13:39:04.517649+0000","last_active":"2024-03-20T13:39:04.517649+0000","last_peered":"2024-03-20T13:39:04.517649+0000","last_clean":"2024-03-20T13:39:04.517649+0000","last_became_active":"2024-03-20T13:36:38.821194+0000","last_became_peered":"2024-03-20T13:36:38.821194+0000","last_unstale":"2024-03-20T13:39:04.517649+0000","last_undegraded":"2024-03-20T13:39:04.517649+0000","last_fullsized":"2024-03-20T13:39:04.517649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:04.517405+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:04.517405+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.517405+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:58.353894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:28.433336+0000","last_change":"2024-03-20T13:39:28.433405+0000","last_active":"2024-03-20T13:39:28.433336+0000","last_peered":"2024-03-20T13:39:28.433336+0000","last_clean":"2024-03-20T13:39:28.433336+0000","last_became_active":"2024-03-20T13:36:36.817729+0000","last_became_peered":"2024-03-20T13:36:36.817729+0000","last_unstale":"2024-03-20T13:39:28.433336+0000","last_undegraded":"2024-03-20T13:39:28.433336+0000","last_fullsized":"2024-03-20T13:39:28.433336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:28.433135+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:28.433135+0000","last_clean_scrub_stamp":"2024-03-20T13:39:28.433135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:23:38.844689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.630024+0000","last_change":"2024-03-20T13:38:45.630090+0000","last_active":"2024-03-20T13:38:45.630024+0000","last_peered":"2024-03-20T13:38:45.630024+0000","last_clean":"2024-03-20T13:38:45.630024+0000","last_became_active":"2024-03-20T13:36:38.841578+0000","last_became_peered":"2024-03-20T13:36:38.841578+0000","last_unstale":"2024-03-20T13:38:45.630024+0000","last_undegraded":"2024-03-20T13:38:45.630024+0000","last_fullsized":"2024-03-20T13:38:45.630024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:45.629830+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:45.629830+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.629830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:36.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:31.386764+0000","last_change":"2024-03-20T13:39:31.386826+0000","last_active":"2024-03-20T13:39:31.386764+0000","last_peered":"2024-03-20T13:39:31.386764+0000","last_clean":"2024-03-20T13:39:31.386764+0000","last_became_active":"2024-03-20T13:36:36.843427+0000","last_became_peered":"2024-03-20T13:36:36.843427+0000","last_unstale":"2024-03-20T13:39:31.386764+0000","last_undegraded":"2024-03-20T13:39:31.386764+0000","last_fullsized":"2024-03-20T13:39:31.386764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:31.386561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:31.386561+0000","last_clean_scrub_stamp":"2024-03-20T13:39:31.386561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:35:55.176817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.360390+0000","last_change":"2024-03-20T13:38:34.360390+0000","last_active":"2024-03-20T13:38:34.360390+0000","last_peered":"2024-03-20T13:38:34.360390+0000","last_clean":"2024-03-20T13:38:34.360390+0000","last_became_active":"2024-03-20T13:36:38.845284+0000","last_became_peered":"2024-03-20T13:36:38.845284+0000","last_unstale":"2024-03-20T13:38:34.360390+0000","last_undegraded":"2024-03-20T13:38:34.360390+0000","last_fullsized":"2024-03-20T13:38:34.360390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:34.360106+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.360106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:40.327388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:14.384893+0000","last_change":"2024-03-20T13:39:14.384951+0000","last_active":"2024-03-20T13:39:14.384893+0000","last_peered":"2024-03-20T13:39:14.384893+0000","last_clean":"2024-03-20T13:39:14.384893+0000","last_became_active":"2024-03-20T13:36:36.840260+0000","last_became_peered":"2024-03-20T13:36:36.840260+0000","last_unstale":"2024-03-20T13:39:14.384893+0000","last_undegraded":"2024-03-20T13:39:14.384893+0000","last_fullsized":"2024-03-20T13:39:14.384893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:14.384687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:14.384687+0000","last_clean_scrub_stamp":"2024-03-20T13:39:14.384687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:22:54.805823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.360463+0000","last_change":"2024-03-20T13:38:50.360616+0000","last_active":"2024-03-20T13:38:50.360463+0000","last_peered":"2024-03-20T13:38:50.360463+0000","last_clean":"2024-03-20T13:38:50.360463+0000","last_became_active":"2024-03-20T13:36:38.842766+0000","last_became_peered":"2024-03-20T13:36:38.842766+0000","last_unstale":"2024-03-20T13:38:50.360463+0000","last_undegraded":"2024-03-20T13:38:50.360463+0000","last_fullsized":"2024-03-20T13:38:50.360463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:50.360249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:50.360249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.360249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:27:20.207773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:23.463402+0000","last_change":"2024-03-20T13:39:23.463467+0000","last_active":"2024-03-20T13:39:23.463402+0000","last_peered":"2024-03-20T13:39:23.463402+0000","last_clean":"2024-03-20T13:39:23.463402+0000","last_became_active":"2024-03-20T13:36:36.839286+0000","last_became_peered":"2024-03-20T13:36:36.839286+0000","last_unstale":"2024-03-20T13:39:23.463402+0000","last_undegraded":"2024-03-20T13:39:23.463402+0000","last_fullsized":"2024-03-20T13:39:23.463402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:23.463194+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:23.463194+0000","last_clean_scrub_stamp":"2024-03-20T13:39:23.463194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:34:28.042396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.671921+0000","last_change":"2024-03-20T13:38:42.671921+0000","last_active":"2024-03-20T13:38:42.671921+0000","last_peered":"2024-03-20T13:38:42.671921+0000","last_clean":"2024-03-20T13:38:42.671921+0000","last_became_active":"2024-03-20T13:36:38.830620+0000","last_became_peered":"2024-03-20T13:36:38.830620+0000","last_unstale":"2024-03-20T13:38:42.671921+0000","last_undegraded":"2024-03-20T13:38:42.671921+0000","last_fullsized":"2024-03-20T13:38:42.671921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:42.671660+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:42.671660+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.671660+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:26:41.237314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.372430+0000","last_change":"2024-03-20T13:38:55.372430+0000","last_active":"2024-03-20T13:38:55.372430+0000","last_peered":"2024-03-20T13:38:55.372430+0000","last_clean":"2024-03-20T13:38:55.372430+0000","last_became_active":"2024-03-20T13:36:38.831595+0000","last_became_peered":"2024-03-20T13:36:38.831595+0000","last_unstale":"2024-03-20T13:38:55.372430+0000","last_undegraded":"2024-03-20T13:38:55.372430+0000","last_fullsized":"2024-03-20T13:38:55.372430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:55.372162+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:55.372162+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.372162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:52:41.165170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.799786+0000","last_change":"2024-03-20T13:39:11.799949+0000","last_active":"2024-03-20T13:39:11.799786+0000","last_peered":"2024-03-20T13:39:11.799786+0000","last_clean":"2024-03-20T13:39:11.799786+0000","last_became_active":"2024-03-20T13:36:36.831628+0000","last_became_peered":"2024-03-20T13:36:36.831628+0000","last_unstale":"2024-03-20T13:39:11.799786+0000","last_undegraded":"2024-03-20T13:39:11.799786+0000","last_fullsized":"2024-03-20T13:39:11.799786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:11.799562+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:11.799562+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.799562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:41:52.919604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.356156+0000","last_change":"2024-03-20T13:38:51.356156+0000","last_active":"2024-03-20T13:38:51.356156+0000","last_peered":"2024-03-20T13:38:51.356156+0000","last_clean":"2024-03-20T13:38:51.356156+0000","last_became_active":"2024-03-20T13:36:38.842454+0000","last_became_peered":"2024-03-20T13:36:38.842454+0000","last_unstale":"2024-03-20T13:38:51.356156+0000","last_undegraded":"2024-03-20T13:38:51.356156+0000","last_fullsized":"2024-03-20T13:38:51.356156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-03-20T13:38:51.355757+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-03-20T13:38:51.355757+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.355757+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:23:00.937432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.602289+0000","last_change":"2024-03-20T13:39:03.602350+0000","last_active":"2024-03-20T13:39:03.602289+0000","last_peered":"2024-03-20T13:39:03.602289+0000","last_clean":"2024-03-20T13:39:03.602289+0000","last_became_active":"2024-03-20T13:36:36.815504+0000","last_became_peered":"2024-03-20T13:36:36.815504+0000","last_unstale":"2024-03-20T13:39:03.602289+0000","last_undegraded":"2024-03-20T13:39:03.602289+0000","last_fullsized":"2024-03-20T13:39:03.602289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:03.602063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:03.602063+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.602063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:48.843570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.340213+0000","last_change":"2024-03-20T13:38:59.340213+0000","last_active":"2024-03-20T13:38:59.340213+0000","last_peered":"2024-03-20T13:38:59.340213+0000","last_clean":"2024-03-20T13:38:59.340213+0000","last_became_active":"2024-03-20T13:36:38.830967+0000","last_became_peered":"2024-03-20T13:36:38.830967+0000","last_unstale":"2024-03-20T13:38:59.340213+0000","last_undegraded":"2024-03-20T13:38:59.340213+0000","last_fullsized":"2024-03-20T13:38:59.340213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:59.339924+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:59.339924+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.339924+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:35.663825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:19.460014+0000","last_change":"2024-03-20T13:39:19.460074+0000","last_active":"2024-03-20T13:39:19.460014+0000","last_peered":"2024-03-20T13:39:19.460014+0000","last_clean":"2024-03-20T13:39:19.460014+0000","last_became_active":"2024-03-20T13:36:36.837850+0000","last_became_peered":"2024-03-20T13:36:36.837850+0000","last_unstale":"2024-03-20T13:39:19.460014+0000","last_undegraded":"2024-03-20T13:39:19.460014+0000","last_fullsized":"2024-03-20T13:39:19.460014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:19.459815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:19.459815+0000","last_clean_scrub_stamp":"2024-03-20T13:39:19.459815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:50:10.380187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.705994+0000","last_change":"2024-03-20T13:38:43.705994+0000","last_active":"2024-03-20T13:38:43.705994+0000","last_peered":"2024-03-20T13:38:43.705994+0000","last_clean":"2024-03-20T13:38:43.705994+0000","last_became_active":"2024-03-20T13:36:38.827311+0000","last_became_peered":"2024-03-20T13:36:38.827311+0000","last_unstale":"2024-03-20T13:38:43.705994+0000","last_undegraded":"2024-03-20T13:38:43.705994+0000","last_fullsized":"2024-03-20T13:38:43.705994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:43.705585+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:43.705585+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.705585+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:55:47.485233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:16.407887+0000","last_change":"2024-03-20T13:39:16.407955+0000","last_active":"2024-03-20T13:39:16.407887+0000","last_peered":"2024-03-20T13:39:16.407887+0000","last_clean":"2024-03-20T13:39:16.407887+0000","last_became_active":"2024-03-20T13:36:36.823830+0000","last_became_peered":"2024-03-20T13:36:36.823830+0000","last_unstale":"2024-03-20T13:39:16.407887+0000","last_undegraded":"2024-03-20T13:39:16.407887+0000","last_fullsized":"2024-03-20T13:39:16.407887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:16.407685+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:16.407685+0000","last_clean_scrub_stamp":"2024-03-20T13:39:16.407685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:55:21.630434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.808048+0000","last_change":"2024-03-20T13:38:51.808048+0000","last_active":"2024-03-20T13:38:51.808048+0000","last_peered":"2024-03-20T13:38:51.808048+0000","last_clean":"2024-03-20T13:38:51.808048+0000","last_became_active":"2024-03-20T13:36:38.825249+0000","last_became_peered":"2024-03-20T13:36:38.825249+0000","last_unstale":"2024-03-20T13:38:51.808048+0000","last_undegraded":"2024-03-20T13:38:51.808048+0000","last_fullsized":"2024-03-20T13:38:51.808048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:51.807795+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:51.807795+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.807795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:46.641091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:21.416245+0000","last_change":"2024-03-20T13:39:21.416301+0000","last_active":"2024-03-20T13:39:21.416245+0000","last_peered":"2024-03-20T13:39:21.416245+0000","last_clean":"2024-03-20T13:39:21.416245+0000","last_became_active":"2024-03-20T13:36:36.839790+0000","last_became_peered":"2024-03-20T13:36:36.839790+0000","last_unstale":"2024-03-20T13:39:21.416245+0000","last_undegraded":"2024-03-20T13:39:21.416245+0000","last_fullsized":"2024-03-20T13:39:21.416245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:21.416049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:21.416049+0000","last_clean_scrub_stamp":"2024-03-20T13:39:21.416049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:59:32.607257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.639520+0000","last_change":"2024-03-20T13:38:53.639520+0000","last_active":"2024-03-20T13:38:53.639520+0000","last_peered":"2024-03-20T13:38:53.639520+0000","last_clean":"2024-03-20T13:38:53.639520+0000","last_became_active":"2024-03-20T13:36:38.836240+0000","last_became_peered":"2024-03-20T13:36:38.836240+0000","last_unstale":"2024-03-20T13:38:53.639520+0000","last_undegraded":"2024-03-20T13:38:53.639520+0000","last_fullsized":"2024-03-20T13:38:53.639520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:53.639272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:53.639272+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.639272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:06:35.620794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.503762+0000","last_change":"2024-03-20T13:39:05.503823+0000","last_active":"2024-03-20T13:39:05.503762+0000","last_peered":"2024-03-20T13:39:05.503762+0000","last_clean":"2024-03-20T13:39:05.503762+0000","last_became_active":"2024-03-20T13:36:36.842539+0000","last_became_peered":"2024-03-20T13:36:36.842539+0000","last_unstale":"2024-03-20T13:39:05.503762+0000","last_undegraded":"2024-03-20T13:39:05.503762+0000","last_fullsized":"2024-03-20T13:39:05.503762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:05.503557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:05.503557+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.503557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:14:42.256100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'18","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:21.756673+0000","last_change":"2024-03-20T13:39:21.756747+0000","last_active":"2024-03-20T13:39:21.756673+0000","last_peered":"2024-03-20T13:39:21.756673+0000","last_clean":"2024-03-20T13:39:21.756673+0000","last_became_active":"2024-03-20T13:36:46.885157+0000","last_became_peered":"2024-03-20T13:36:46.885157+0000","last_unstale":"2024-03-20T13:39:21.756673+0000","last_undegraded":"2024-03-20T13:39:21.756673+0000","last_fullsized":"2024-03-20T13:39:21.756673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-03-20T13:39:21.756467+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-03-20T13:39:21.756467+0000","last_clean_scrub_stamp":"2024-03-20T13:39:21.756467+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:04.705650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.524991+0000","last_change":"2024-03-20T13:38:57.524991+0000","last_active":"2024-03-20T13:38:57.524991+0000","last_peered":"2024-03-20T13:38:57.524991+0000","last_clean":"2024-03-20T13:38:57.524991+0000","last_became_active":"2024-03-20T13:36:38.832794+0000","last_became_peered":"2024-03-20T13:36:38.832794+0000","last_unstale":"2024-03-20T13:38:57.524991+0000","last_undegraded":"2024-03-20T13:38:57.524991+0000","last_fullsized":"2024-03-20T13:38:57.524991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:57.524736+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:57.524736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.524736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:02:53.826364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.411023+0000","last_change":"2024-03-20T13:39:08.411088+0000","last_active":"2024-03-20T13:39:08.411023+0000","last_peered":"2024-03-20T13:39:08.411023+0000","last_clean":"2024-03-20T13:39:08.411023+0000","last_became_active":"2024-03-20T13:36:36.847569+0000","last_became_peered":"2024-03-20T13:36:36.847569+0000","last_unstale":"2024-03-20T13:39:08.411023+0000","last_undegraded":"2024-03-20T13:39:08.411023+0000","last_fullsized":"2024-03-20T13:39:08.411023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:08.410818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:08.410818+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.410818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:28.681674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.524488+0000","last_change":"2024-03-20T13:38:45.524488+0000","last_active":"2024-03-20T13:38:45.524488+0000","last_peered":"2024-03-20T13:38:45.524488+0000","last_clean":"2024-03-20T13:38:45.524488+0000","last_became_active":"2024-03-20T13:36:40.849217+0000","last_became_peered":"2024-03-20T13:36:40.849217+0000","last_unstale":"2024-03-20T13:38:45.524488+0000","last_undegraded":"2024-03-20T13:38:45.524488+0000","last_fullsized":"2024-03-20T13:38:45.524488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:45.524251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:45.524251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.524251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:26:46.932589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.636370+0000","last_change":"2024-03-20T13:38:27.636370+0000","last_active":"2024-03-20T13:38:27.636370+0000","last_peered":"2024-03-20T13:38:27.636370+0000","last_clean":"2024-03-20T13:38:27.636370+0000","last_became_active":"2024-03-20T13:36:42.845894+0000","last_became_peered":"2024-03-20T13:36:42.845894+0000","last_unstale":"2024-03-20T13:38:27.636370+0000","last_undegraded":"2024-03-20T13:38:27.636370+0000","last_fullsized":"2024-03-20T13:38:27.636370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:27.636107+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.636107+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:56.436080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.395264+0000","last_change":"2024-03-20T13:38:45.395264+0000","last_active":"2024-03-20T13:38:45.395264+0000","last_peered":"2024-03-20T13:38:45.395264+0000","last_clean":"2024-03-20T13:38:45.395264+0000","last_became_active":"2024-03-20T13:36:44.869236+0000","last_became_peered":"2024-03-20T13:36:44.869236+0000","last_unstale":"2024-03-20T13:38:45.395264+0000","last_undegraded":"2024-03-20T13:38:45.395264+0000","last_fullsized":"2024-03-20T13:38:45.395264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:45.395019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:45.395019+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.395019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:25.417312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:35.406606+0000","last_change":"2024-03-20T13:39:35.406764+0000","last_active":"2024-03-20T13:39:35.406606+0000","last_peered":"2024-03-20T13:39:35.406606+0000","last_clean":"2024-03-20T13:39:35.406606+0000","last_became_active":"2024-03-20T13:36:46.879808+0000","last_became_peered":"2024-03-20T13:36:46.879808+0000","last_unstale":"2024-03-20T13:39:35.406606+0000","last_undegraded":"2024-03-20T13:39:35.406606+0000","last_fullsized":"2024-03-20T13:39:35.406606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:35.406389+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:35.406389+0000","last_clean_scrub_stamp":"2024-03-20T13:39:35.406389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:44:07.088979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.491387+0000","last_change":"2024-03-20T13:39:02.491387+0000","last_active":"2024-03-20T13:39:02.491387+0000","last_peered":"2024-03-20T13:39:02.491387+0000","last_clean":"2024-03-20T13:39:02.491387+0000","last_became_active":"2024-03-20T13:36:38.821794+0000","last_became_peered":"2024-03-20T13:36:38.821794+0000","last_unstale":"2024-03-20T13:39:02.491387+0000","last_undegraded":"2024-03-20T13:39:02.491387+0000","last_fullsized":"2024-03-20T13:39:02.491387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:02.491130+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:02.491130+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.491130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:00.648488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.617934+0000","last_change":"2024-03-20T13:39:02.618003+0000","last_active":"2024-03-20T13:39:02.617934+0000","last_peered":"2024-03-20T13:39:02.617934+0000","last_clean":"2024-03-20T13:39:02.617934+0000","last_became_active":"2024-03-20T13:36:36.814044+0000","last_became_peered":"2024-03-20T13:36:36.814044+0000","last_unstale":"2024-03-20T13:39:02.617934+0000","last_undegraded":"2024-03-20T13:39:02.617934+0000","last_fullsized":"2024-03-20T13:39:02.617934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:02.617744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:02.617744+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.617744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:16:04.583938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.609801+0000","last_change":"2024-03-20T13:38:28.609801+0000","last_active":"2024-03-20T13:38:28.609801+0000","last_peered":"2024-03-20T13:38:28.609801+0000","last_clean":"2024-03-20T13:38:28.609801+0000","last_became_active":"2024-03-20T13:36:40.852628+0000","last_became_peered":"2024-03-20T13:36:40.852628+0000","last_unstale":"2024-03-20T13:38:28.609801+0000","last_undegraded":"2024-03-20T13:38:28.609801+0000","last_fullsized":"2024-03-20T13:38:28.609801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.609546+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.609546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.417547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.498376+0000","last_change":"2024-03-20T13:38:32.498376+0000","last_active":"2024-03-20T13:38:32.498376+0000","last_peered":"2024-03-20T13:38:32.498376+0000","last_clean":"2024-03-20T13:38:32.498376+0000","last_became_active":"2024-03-20T13:36:42.850606+0000","last_became_peered":"2024-03-20T13:36:42.850606+0000","last_unstale":"2024-03-20T13:38:32.498376+0000","last_undegraded":"2024-03-20T13:38:32.498376+0000","last_fullsized":"2024-03-20T13:38:32.498376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:32.497987+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.497987+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:26.085583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:32.370415+0000","last_change":"2024-03-20T13:39:32.370469+0000","last_active":"2024-03-20T13:39:32.370415+0000","last_peered":"2024-03-20T13:39:32.370415+0000","last_clean":"2024-03-20T13:39:32.370415+0000","last_became_active":"2024-03-20T13:36:44.879133+0000","last_became_peered":"2024-03-20T13:36:44.879133+0000","last_unstale":"2024-03-20T13:39:32.370415+0000","last_undegraded":"2024-03-20T13:39:32.370415+0000","last_fullsized":"2024-03-20T13:39:32.370415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:32.370220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:32.370220+0000","last_clean_scrub_stamp":"2024-03-20T13:39:32.370220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:02:46.752946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:36.458659+0000","last_change":"2024-03-20T13:39:36.458721+0000","last_active":"2024-03-20T13:39:36.458659+0000","last_peered":"2024-03-20T13:39:36.458659+0000","last_clean":"2024-03-20T13:39:36.458659+0000","last_became_active":"2024-03-20T13:36:46.896452+0000","last_became_peered":"2024-03-20T13:36:46.896452+0000","last_unstale":"2024-03-20T13:39:36.458659+0000","last_undegraded":"2024-03-20T13:39:36.458659+0000","last_fullsized":"2024-03-20T13:39:36.458659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:36.458468+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:36.458468+0000","last_clean_scrub_stamp":"2024-03-20T13:39:36.458468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:17.891804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.618703+0000","last_change":"2024-03-20T13:39:07.618761+0000","last_active":"2024-03-20T13:39:07.618703+0000","last_peered":"2024-03-20T13:39:07.618703+0000","last_clean":"2024-03-20T13:39:07.618703+0000","last_became_active":"2024-03-20T13:37:17.350392+0000","last_became_peered":"2024-03-20T13:37:17.350392+0000","last_unstale":"2024-03-20T13:39:07.618703+0000","last_undegraded":"2024-03-20T13:39:07.618703+0000","last_fullsized":"2024-03-20T13:39:07.618703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:07.618500+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:07.618500+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.618500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:57.842801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:18.440356+0000","last_change":"2024-03-20T13:39:18.440426+0000","last_active":"2024-03-20T13:39:18.440356+0000","last_peered":"2024-03-20T13:39:18.440356+0000","last_clean":"2024-03-20T13:39:18.440356+0000","last_became_active":"2024-03-20T13:36:36.821270+0000","last_became_peered":"2024-03-20T13:36:36.821270+0000","last_unstale":"2024-03-20T13:39:18.440356+0000","last_undegraded":"2024-03-20T13:39:18.440356+0000","last_fullsized":"2024-03-20T13:39:18.440356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:18.440145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:18.440145+0000","last_clean_scrub_stamp":"2024-03-20T13:39:18.440145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:41.074631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.622403+0000","last_change":"2024-03-20T13:38:32.622403+0000","last_active":"2024-03-20T13:38:32.622403+0000","last_peered":"2024-03-20T13:38:32.622403+0000","last_clean":"2024-03-20T13:38:32.622403+0000","last_became_active":"2024-03-20T13:36:40.850407+0000","last_became_peered":"2024-03-20T13:36:40.850407+0000","last_unstale":"2024-03-20T13:38:32.622403+0000","last_undegraded":"2024-03-20T13:38:32.622403+0000","last_fullsized":"2024-03-20T13:38:32.622403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.622043+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.622043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:44.229800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.562204+0000","last_change":"2024-03-20T13:38:35.562204+0000","last_active":"2024-03-20T13:38:35.562204+0000","last_peered":"2024-03-20T13:38:35.562204+0000","last_clean":"2024-03-20T13:38:35.562204+0000","last_became_active":"2024-03-20T13:36:42.854893+0000","last_became_peered":"2024-03-20T13:36:42.854893+0000","last_unstale":"2024-03-20T13:38:35.562204+0000","last_undegraded":"2024-03-20T13:38:35.562204+0000","last_fullsized":"2024-03-20T13:38:35.562204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:35.561937+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.561937+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:38:29.683966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'244","reported_seq":319,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.361559+0000","last_change":"2024-03-20T13:39:01.361559+0000","last_active":"2024-03-20T13:39:01.361559+0000","last_peered":"2024-03-20T13:39:01.361559+0000","last_clean":"2024-03-20T13:39:01.361559+0000","last_became_active":"2024-03-20T13:36:44.877712+0000","last_became_peered":"2024-03-20T13:36:44.877712+0000","last_unstale":"2024-03-20T13:39:01.361559+0000","last_undegraded":"2024-03-20T13:39:01.361559+0000","last_fullsized":"2024-03-20T13:39:01.361559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:39:01.361304+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:39:01.361304+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.361304+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:44:02.036320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.559533+0000","last_change":"2024-03-20T13:38:26.559533+0000","last_active":"2024-03-20T13:38:26.559533+0000","last_peered":"2024-03-20T13:38:26.559533+0000","last_clean":"2024-03-20T13:38:26.559533+0000","last_became_active":"2024-03-20T13:36:46.888247+0000","last_became_peered":"2024-03-20T13:36:46.888247+0000","last_unstale":"2024-03-20T13:38:26.559533+0000","last_undegraded":"2024-03-20T13:38:26.559533+0000","last_fullsized":"2024-03-20T13:38:26.559533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.559287+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.559287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:27.493448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.465561+0000","last_change":"2024-03-20T13:38:53.465561+0000","last_active":"2024-03-20T13:38:53.465561+0000","last_peered":"2024-03-20T13:38:53.465561+0000","last_clean":"2024-03-20T13:38:53.465561+0000","last_became_active":"2024-03-20T13:36:38.833468+0000","last_became_peered":"2024-03-20T13:36:38.833468+0000","last_unstale":"2024-03-20T13:38:53.465561+0000","last_undegraded":"2024-03-20T13:38:53.465561+0000","last_fullsized":"2024-03-20T13:38:53.465561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:53.465309+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:53.465309+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.465309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:44.165890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:15.440189+0000","last_change":"2024-03-20T13:39:15.440247+0000","last_active":"2024-03-20T13:39:15.440189+0000","last_peered":"2024-03-20T13:39:15.440189+0000","last_clean":"2024-03-20T13:39:15.440189+0000","last_became_active":"2024-03-20T13:36:36.835134+0000","last_became_peered":"2024-03-20T13:36:36.835134+0000","last_unstale":"2024-03-20T13:39:15.440189+0000","last_undegraded":"2024-03-20T13:39:15.440189+0000","last_fullsized":"2024-03-20T13:39:15.440189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:15.439987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:15.439987+0000","last_clean_scrub_stamp":"2024-03-20T13:39:15.439987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:50:31.971326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.433031+0000","last_change":"2024-03-20T13:38:25.433031+0000","last_active":"2024-03-20T13:38:25.433031+0000","last_peered":"2024-03-20T13:38:25.433031+0000","last_clean":"2024-03-20T13:38:25.433031+0000","last_became_active":"2024-03-20T13:36:40.858863+0000","last_became_peered":"2024-03-20T13:36:40.858863+0000","last_unstale":"2024-03-20T13:38:25.433031+0000","last_undegraded":"2024-03-20T13:38:25.433031+0000","last_fullsized":"2024-03-20T13:38:25.433031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:25.432781+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.432781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:35.180635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.346225+0000","last_change":"2024-03-20T13:38:42.346225+0000","last_active":"2024-03-20T13:38:42.346225+0000","last_peered":"2024-03-20T13:38:42.346225+0000","last_clean":"2024-03-20T13:38:42.346225+0000","last_became_active":"2024-03-20T13:36:42.859620+0000","last_became_peered":"2024-03-20T13:36:42.859620+0000","last_unstale":"2024-03-20T13:38:42.346225+0000","last_undegraded":"2024-03-20T13:38:42.346225+0000","last_fullsized":"2024-03-20T13:38:42.346225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:42.345943+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:42.345943+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.345943+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:35:22.378243+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"34'243","reported_seq":332,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.606212+0000","last_change":"2024-03-20T13:38:39.606212+0000","last_active":"2024-03-20T13:38:39.606212+0000","last_peered":"2024-03-20T13:38:39.606212+0000","last_clean":"2024-03-20T13:38:39.606212+0000","last_became_active":"2024-03-20T13:36:44.897174+0000","last_became_peered":"2024-03-20T13:36:44.897174+0000","last_unstale":"2024-03-20T13:38:39.606212+0000","last_undegraded":"2024-03-20T13:38:39.606212+0000","last_fullsized":"2024-03-20T13:38:39.606212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:39.605847+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.605847+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:06:01.030174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.644074+0000","last_change":"2024-03-20T13:39:09.644074+0000","last_active":"2024-03-20T13:39:09.644074+0000","last_peered":"2024-03-20T13:39:09.644074+0000","last_clean":"2024-03-20T13:39:09.644074+0000","last_became_active":"2024-03-20T13:37:17.355340+0000","last_became_peered":"2024-03-20T13:37:17.355340+0000","last_unstale":"2024-03-20T13:39:09.644074+0000","last_undegraded":"2024-03-20T13:39:09.644074+0000","last_fullsized":"2024-03-20T13:39:09.644074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:09.643830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:09.643830+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.643830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:43:06.500277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.279257+0000","last_change":"2024-03-20T13:39:10.279325+0000","last_active":"2024-03-20T13:39:10.279257+0000","last_peered":"2024-03-20T13:39:10.279257+0000","last_clean":"2024-03-20T13:39:10.279257+0000","last_became_active":"2024-03-20T13:36:36.827154+0000","last_became_peered":"2024-03-20T13:36:36.827154+0000","last_unstale":"2024-03-20T13:39:10.279257+0000","last_undegraded":"2024-03-20T13:39:10.279257+0000","last_fullsized":"2024-03-20T13:39:10.279257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:10.279059+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:10.279059+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.279059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:38:22.275993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.529826+0000","last_change":"2024-03-20T13:38:33.529826+0000","last_active":"2024-03-20T13:38:33.529826+0000","last_peered":"2024-03-20T13:38:33.529826+0000","last_clean":"2024-03-20T13:38:33.529826+0000","last_became_active":"2024-03-20T13:36:40.856938+0000","last_became_peered":"2024-03-20T13:36:40.856938+0000","last_unstale":"2024-03-20T13:38:33.529826+0000","last_undegraded":"2024-03-20T13:38:33.529826+0000","last_fullsized":"2024-03-20T13:38:33.529826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:33.529572+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.529572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:40.945003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.281180+0000","last_change":"2024-03-20T13:38:39.281180+0000","last_active":"2024-03-20T13:38:39.281180+0000","last_peered":"2024-03-20T13:38:39.281180+0000","last_clean":"2024-03-20T13:38:39.281180+0000","last_became_active":"2024-03-20T13:36:42.872841+0000","last_became_peered":"2024-03-20T13:36:42.872841+0000","last_unstale":"2024-03-20T13:38:39.281180+0000","last_undegraded":"2024-03-20T13:38:39.281180+0000","last_fullsized":"2024-03-20T13:38:39.281180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-03-20T13:38:39.281001+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.281001+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:54.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.650522+0000","last_change":"2024-03-20T13:38:24.650522+0000","last_active":"2024-03-20T13:38:24.650522+0000","last_peered":"2024-03-20T13:38:24.650522+0000","last_clean":"2024-03-20T13:38:24.650522+0000","last_became_active":"2024-03-20T13:36:44.865858+0000","last_became_peered":"2024-03-20T13:36:44.865858+0000","last_unstale":"2024-03-20T13:38:24.650522+0000","last_undegraded":"2024-03-20T13:38:24.650522+0000","last_fullsized":"2024-03-20T13:38:24.650522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:24.650271+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.650271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:30:43.245615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.539249+0000","last_change":"2024-03-20T13:38:34.539249+0000","last_active":"2024-03-20T13:38:34.539249+0000","last_peered":"2024-03-20T13:38:34.539249+0000","last_clean":"2024-03-20T13:38:34.539249+0000","last_became_active":"2024-03-20T13:36:46.888869+0000","last_became_peered":"2024-03-20T13:36:46.888869+0000","last_unstale":"2024-03-20T13:38:34.539249+0000","last_undegraded":"2024-03-20T13:38:34.539249+0000","last_fullsized":"2024-03-20T13:38:34.539249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:34.539008+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.539008+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:16:31.372326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.662171+0000","last_change":"2024-03-20T13:39:02.662251+0000","last_active":"2024-03-20T13:39:02.662171+0000","last_peered":"2024-03-20T13:39:02.662171+0000","last_clean":"2024-03-20T13:39:02.662171+0000","last_became_active":"2024-03-20T13:36:38.831664+0000","last_became_peered":"2024-03-20T13:36:38.831664+0000","last_unstale":"2024-03-20T13:39:02.662171+0000","last_undegraded":"2024-03-20T13:39:02.662171+0000","last_fullsized":"2024-03-20T13:39:02.662171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:02.661970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:02.661970+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.661970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:08.226754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:17.397465+0000","last_change":"2024-03-20T13:39:17.397526+0000","last_active":"2024-03-20T13:39:17.397465+0000","last_peered":"2024-03-20T13:39:17.397465+0000","last_clean":"2024-03-20T13:39:17.397465+0000","last_became_active":"2024-03-20T13:36:36.833250+0000","last_became_peered":"2024-03-20T13:36:36.833250+0000","last_unstale":"2024-03-20T13:39:17.397465+0000","last_undegraded":"2024-03-20T13:39:17.397465+0000","last_fullsized":"2024-03-20T13:39:17.397465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:17.397257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:17.397257+0000","last_clean_scrub_stamp":"2024-03-20T13:39:17.397257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:52:12.571149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.584967+0000","last_change":"2024-03-20T13:38:37.584967+0000","last_active":"2024-03-20T13:38:37.584967+0000","last_peered":"2024-03-20T13:38:37.584967+0000","last_clean":"2024-03-20T13:38:37.584967+0000","last_became_active":"2024-03-20T13:36:40.856575+0000","last_became_peered":"2024-03-20T13:36:40.856575+0000","last_unstale":"2024-03-20T13:38:37.584967+0000","last_undegraded":"2024-03-20T13:38:37.584967+0000","last_fullsized":"2024-03-20T13:38:37.584967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.584698+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.584698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:47:36.547057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.690450+0000","last_change":"2024-03-20T13:38:24.690450+0000","last_active":"2024-03-20T13:38:24.690450+0000","last_peered":"2024-03-20T13:38:24.690450+0000","last_clean":"2024-03-20T13:38:24.690450+0000","last_became_active":"2024-03-20T13:36:42.842864+0000","last_became_peered":"2024-03-20T13:36:42.842864+0000","last_unstale":"2024-03-20T13:38:24.690450+0000","last_undegraded":"2024-03-20T13:38:24.690450+0000","last_fullsized":"2024-03-20T13:38:24.690450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:24.690100+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.690100+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:03.686066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.585659+0000","last_change":"2024-03-20T13:38:34.585659+0000","last_active":"2024-03-20T13:38:34.585659+0000","last_peered":"2024-03-20T13:38:34.585659+0000","last_clean":"2024-03-20T13:38:34.585659+0000","last_became_active":"2024-03-20T13:36:44.888004+0000","last_became_peered":"2024-03-20T13:36:44.888004+0000","last_unstale":"2024-03-20T13:38:34.585659+0000","last_undegraded":"2024-03-20T13:38:34.585659+0000","last_fullsized":"2024-03-20T13:38:34.585659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.585283+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.585283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.364588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.588729+0000","last_change":"2024-03-20T13:38:50.588729+0000","last_active":"2024-03-20T13:38:50.588729+0000","last_peered":"2024-03-20T13:38:50.588729+0000","last_clean":"2024-03-20T13:38:50.588729+0000","last_became_active":"2024-03-20T13:36:46.872286+0000","last_became_peered":"2024-03-20T13:36:46.872286+0000","last_unstale":"2024-03-20T13:38:50.588729+0000","last_undegraded":"2024-03-20T13:38:50.588729+0000","last_fullsized":"2024-03-20T13:38:50.588729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:50.588446+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:50.588446+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.588446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:09:39.899285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.342383+0000","last_change":"2024-03-20T13:39:06.342446+0000","last_active":"2024-03-20T13:39:06.342383+0000","last_peered":"2024-03-20T13:39:06.342383+0000","last_clean":"2024-03-20T13:39:06.342383+0000","last_became_active":"2024-03-20T13:36:38.826149+0000","last_became_peered":"2024-03-20T13:36:38.826149+0000","last_unstale":"2024-03-20T13:39:06.342383+0000","last_undegraded":"2024-03-20T13:39:06.342383+0000","last_fullsized":"2024-03-20T13:39:06.342383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:06.342189+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:06.342189+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.342189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:33.802784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:14.395514+0000","last_change":"2024-03-20T13:39:14.395576+0000","last_active":"2024-03-20T13:39:14.395514+0000","last_peered":"2024-03-20T13:39:14.395514+0000","last_clean":"2024-03-20T13:39:14.395514+0000","last_became_active":"2024-03-20T13:36:36.818626+0000","last_became_peered":"2024-03-20T13:36:36.818626+0000","last_unstale":"2024-03-20T13:39:14.395514+0000","last_undegraded":"2024-03-20T13:39:14.395514+0000","last_fullsized":"2024-03-20T13:39:14.395514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:14.395315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:14.395315+0000","last_clean_scrub_stamp":"2024-03-20T13:39:14.395315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:50:59.100686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.649892+0000","last_change":"2024-03-20T13:39:04.649946+0000","last_active":"2024-03-20T13:39:04.649892+0000","last_peered":"2024-03-20T13:39:04.649892+0000","last_clean":"2024-03-20T13:39:04.649892+0000","last_became_active":"2024-03-20T13:36:40.845394+0000","last_became_peered":"2024-03-20T13:36:40.845394+0000","last_unstale":"2024-03-20T13:39:04.649892+0000","last_undegraded":"2024-03-20T13:39:04.649892+0000","last_fullsized":"2024-03-20T13:39:04.649892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:04.649707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:04.649707+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.649707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:16:10.097795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.435258+0000","last_change":"2024-03-20T13:38:27.435258+0000","last_active":"2024-03-20T13:38:27.435258+0000","last_peered":"2024-03-20T13:38:27.435258+0000","last_clean":"2024-03-20T13:38:27.435258+0000","last_became_active":"2024-03-20T13:36:42.841270+0000","last_became_peered":"2024-03-20T13:36:42.841270+0000","last_unstale":"2024-03-20T13:38:27.435258+0000","last_undegraded":"2024-03-20T13:38:27.435258+0000","last_fullsized":"2024-03-20T13:38:27.435258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:27.434963+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.434963+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:19.183364+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"34'243","reported_seq":297,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.518877+0000","last_change":"2024-03-20T13:38:24.518877+0000","last_active":"2024-03-20T13:38:24.518877+0000","last_peered":"2024-03-20T13:38:24.518877+0000","last_clean":"2024-03-20T13:38:24.518877+0000","last_became_active":"2024-03-20T13:36:44.881053+0000","last_became_peered":"2024-03-20T13:36:44.881053+0000","last_unstale":"2024-03-20T13:38:24.518877+0000","last_undegraded":"2024-03-20T13:38:24.518877+0000","last_fullsized":"2024-03-20T13:38:24.518877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:24.518629+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.518629+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:39.808004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:24.753593+0000","last_change":"2024-03-20T13:39:24.753749+0000","last_active":"2024-03-20T13:39:24.753593+0000","last_peered":"2024-03-20T13:39:24.753593+0000","last_clean":"2024-03-20T13:39:24.753593+0000","last_became_active":"2024-03-20T13:36:46.890721+0000","last_became_peered":"2024-03-20T13:36:46.890721+0000","last_unstale":"2024-03-20T13:39:24.753593+0000","last_undegraded":"2024-03-20T13:39:24.753593+0000","last_fullsized":"2024-03-20T13:39:24.753593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:24.753373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:24.753373+0000","last_clean_scrub_stamp":"2024-03-20T13:39:24.753373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:20:10.458457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.772126+0000","last_change":"2024-03-20T13:38:46.772126+0000","last_active":"2024-03-20T13:38:46.772126+0000","last_peered":"2024-03-20T13:38:46.772126+0000","last_clean":"2024-03-20T13:38:46.772126+0000","last_became_active":"2024-03-20T13:36:38.840493+0000","last_became_peered":"2024-03-20T13:36:38.840493+0000","last_unstale":"2024-03-20T13:38:46.772126+0000","last_undegraded":"2024-03-20T13:38:46.772126+0000","last_fullsized":"2024-03-20T13:38:46.772126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:46.771877+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:46.771877+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.771877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:57:20.852991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:22.424954+0000","last_change":"2024-03-20T13:39:22.425012+0000","last_active":"2024-03-20T13:39:22.424954+0000","last_peered":"2024-03-20T13:39:22.424954+0000","last_clean":"2024-03-20T13:39:22.424954+0000","last_became_active":"2024-03-20T13:36:36.820548+0000","last_became_peered":"2024-03-20T13:36:36.820548+0000","last_unstale":"2024-03-20T13:39:22.424954+0000","last_undegraded":"2024-03-20T13:39:22.424954+0000","last_fullsized":"2024-03-20T13:39:22.424954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:22.424758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:22.424758+0000","last_clean_scrub_stamp":"2024-03-20T13:39:22.424758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:32.175503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.698820+0000","last_change":"2024-03-20T13:38:54.698871+0000","last_active":"2024-03-20T13:38:54.698820+0000","last_peered":"2024-03-20T13:38:54.698820+0000","last_clean":"2024-03-20T13:38:54.698820+0000","last_became_active":"2024-03-20T13:36:40.845295+0000","last_became_peered":"2024-03-20T13:36:40.845295+0000","last_unstale":"2024-03-20T13:38:54.698820+0000","last_undegraded":"2024-03-20T13:38:54.698820+0000","last_fullsized":"2024-03-20T13:38:54.698820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:54.698621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:54.698621+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.698621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:12:23.498595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'59","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.623377+0000","last_change":"2024-03-20T13:38:38.623377+0000","last_active":"2024-03-20T13:38:38.623377+0000","last_peered":"2024-03-20T13:38:38.623377+0000","last_clean":"2024-03-20T13:38:38.623377+0000","last_became_active":"2024-03-20T13:36:42.868186+0000","last_became_peered":"2024-03-20T13:36:42.868186+0000","last_unstale":"2024-03-20T13:38:38.623377+0000","last_undegraded":"2024-03-20T13:38:38.623377+0000","last_fullsized":"2024-03-20T13:38:38.623377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:38.623108+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.623108+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:09:30.447395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.535665+0000","last_change":"2024-03-20T13:38:31.535665+0000","last_active":"2024-03-20T13:38:31.535665+0000","last_peered":"2024-03-20T13:38:31.535665+0000","last_clean":"2024-03-20T13:38:31.535665+0000","last_became_active":"2024-03-20T13:36:44.862156+0000","last_became_peered":"2024-03-20T13:36:44.862156+0000","last_unstale":"2024-03-20T13:38:31.535665+0000","last_undegraded":"2024-03-20T13:38:31.535665+0000","last_fullsized":"2024-03-20T13:38:31.535665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.535387+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.535387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:13.731269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.610801+0000","last_change":"2024-03-20T13:38:54.610801+0000","last_active":"2024-03-20T13:38:54.610801+0000","last_peered":"2024-03-20T13:38:54.610801+0000","last_clean":"2024-03-20T13:38:54.610801+0000","last_became_active":"2024-03-20T13:36:46.885455+0000","last_became_peered":"2024-03-20T13:36:46.885455+0000","last_unstale":"2024-03-20T13:38:54.610801+0000","last_undegraded":"2024-03-20T13:38:54.610801+0000","last_fullsized":"2024-03-20T13:38:54.610801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:54.610460+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:54.610460+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.610460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:41:43.240773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.723534+0000","last_change":"2024-03-20T13:39:06.723620+0000","last_active":"2024-03-20T13:39:06.723534+0000","last_peered":"2024-03-20T13:39:06.723534+0000","last_clean":"2024-03-20T13:39:06.723534+0000","last_became_active":"2024-03-20T13:36:38.832426+0000","last_became_peered":"2024-03-20T13:36:38.832426+0000","last_unstale":"2024-03-20T13:39:06.723534+0000","last_undegraded":"2024-03-20T13:39:06.723534+0000","last_fullsized":"2024-03-20T13:39:06.723534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:06.723345+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:06.723345+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.723345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:27.618685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:18.400570+0000","last_change":"2024-03-20T13:39:18.400632+0000","last_active":"2024-03-20T13:39:18.400570+0000","last_peered":"2024-03-20T13:39:18.400570+0000","last_clean":"2024-03-20T13:39:18.400570+0000","last_became_active":"2024-03-20T13:36:36.845131+0000","last_became_peered":"2024-03-20T13:36:36.845131+0000","last_unstale":"2024-03-20T13:39:18.400570+0000","last_undegraded":"2024-03-20T13:39:18.400570+0000","last_fullsized":"2024-03-20T13:39:18.400570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:18.400372+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:18.400372+0000","last_clean_scrub_stamp":"2024-03-20T13:39:18.400372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:08:46.735844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.835816+0000","last_change":"2024-03-20T13:38:50.835816+0000","last_active":"2024-03-20T13:38:50.835816+0000","last_peered":"2024-03-20T13:38:50.835816+0000","last_clean":"2024-03-20T13:38:50.835816+0000","last_became_active":"2024-03-20T13:36:40.835394+0000","last_became_peered":"2024-03-20T13:36:40.835394+0000","last_unstale":"2024-03-20T13:38:50.835816+0000","last_undegraded":"2024-03-20T13:38:50.835816+0000","last_fullsized":"2024-03-20T13:38:50.835816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:50.835459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:50.835459+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.835459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:30.843392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.306918+0000","last_change":"2024-03-20T13:38:38.306918+0000","last_active":"2024-03-20T13:38:38.306918+0000","last_peered":"2024-03-20T13:38:38.306918+0000","last_clean":"2024-03-20T13:38:38.306918+0000","last_became_active":"2024-03-20T13:36:42.875506+0000","last_became_peered":"2024-03-20T13:36:42.875506+0000","last_unstale":"2024-03-20T13:38:38.306918+0000","last_undegraded":"2024-03-20T13:38:38.306918+0000","last_fullsized":"2024-03-20T13:38:38.306918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-03-20T13:38:38.306607+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.306607+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:10:18.381390+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.573861+0000","last_change":"2024-03-20T13:38:47.573861+0000","last_active":"2024-03-20T13:38:47.573861+0000","last_peered":"2024-03-20T13:38:47.573861+0000","last_clean":"2024-03-20T13:38:47.573861+0000","last_became_active":"2024-03-20T13:36:44.898816+0000","last_became_peered":"2024-03-20T13:36:44.898816+0000","last_unstale":"2024-03-20T13:38:47.573861+0000","last_undegraded":"2024-03-20T13:38:47.573861+0000","last_fullsized":"2024-03-20T13:38:47.573861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:47.573614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:47.573614+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.573614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:27:48.050248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.504981+0000","last_change":"2024-03-20T13:39:03.505034+0000","last_active":"2024-03-20T13:39:03.504981+0000","last_peered":"2024-03-20T13:39:03.504981+0000","last_clean":"2024-03-20T13:39:03.504981+0000","last_became_active":"2024-03-20T13:36:46.875053+0000","last_became_peered":"2024-03-20T13:36:46.875053+0000","last_unstale":"2024-03-20T13:39:03.504981+0000","last_undegraded":"2024-03-20T13:39:03.504981+0000","last_fullsized":"2024-03-20T13:39:03.504981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:03.504783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:03.504783+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.504783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:15:29.269709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.365085+0000","last_change":"2024-03-20T13:38:58.365162+0000","last_active":"2024-03-20T13:38:58.365085+0000","last_peered":"2024-03-20T13:38:58.365085+0000","last_clean":"2024-03-20T13:38:58.365085+0000","last_became_active":"2024-03-20T13:36:38.830999+0000","last_became_peered":"2024-03-20T13:36:38.830999+0000","last_unstale":"2024-03-20T13:38:58.365085+0000","last_undegraded":"2024-03-20T13:38:58.365085+0000","last_fullsized":"2024-03-20T13:38:58.365085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:58.364894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:58.364894+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.364894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:44:34.419966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:20.436340+0000","last_change":"2024-03-20T13:39:20.436406+0000","last_active":"2024-03-20T13:39:20.436340+0000","last_peered":"2024-03-20T13:39:20.436340+0000","last_clean":"2024-03-20T13:39:20.436340+0000","last_became_active":"2024-03-20T13:36:36.821743+0000","last_became_peered":"2024-03-20T13:36:36.821743+0000","last_unstale":"2024-03-20T13:39:20.436340+0000","last_undegraded":"2024-03-20T13:39:20.436340+0000","last_fullsized":"2024-03-20T13:39:20.436340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:20.436117+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:20.436117+0000","last_clean_scrub_stamp":"2024-03-20T13:39:20.436117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:59:57.323058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.615334+0000","last_change":"2024-03-20T13:38:40.615334+0000","last_active":"2024-03-20T13:38:40.615334+0000","last_peered":"2024-03-20T13:38:40.615334+0000","last_clean":"2024-03-20T13:38:40.615334+0000","last_became_active":"2024-03-20T13:36:40.843814+0000","last_became_peered":"2024-03-20T13:36:40.843814+0000","last_unstale":"2024-03-20T13:38:40.615334+0000","last_undegraded":"2024-03-20T13:38:40.615334+0000","last_fullsized":"2024-03-20T13:38:40.615334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:40.614954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.614954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:28:08.933992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.605992+0000","last_change":"2024-03-20T13:38:36.605992+0000","last_active":"2024-03-20T13:38:36.605992+0000","last_peered":"2024-03-20T13:38:36.605992+0000","last_clean":"2024-03-20T13:38:36.605992+0000","last_became_active":"2024-03-20T13:36:42.842392+0000","last_became_peered":"2024-03-20T13:36:42.842392+0000","last_unstale":"2024-03-20T13:38:36.605992+0000","last_undegraded":"2024-03-20T13:38:36.605992+0000","last_fullsized":"2024-03-20T13:38:36.605992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:36.605713+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.605713+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:07:49.073403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'243","reported_seq":334,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.527288+0000","last_change":"2024-03-20T13:38:25.527288+0000","last_active":"2024-03-20T13:38:25.527288+0000","last_peered":"2024-03-20T13:38:25.527288+0000","last_clean":"2024-03-20T13:38:25.527288+0000","last_became_active":"2024-03-20T13:36:44.878634+0000","last_became_peered":"2024-03-20T13:36:44.878634+0000","last_unstale":"2024-03-20T13:38:25.527288+0000","last_undegraded":"2024-03-20T13:38:25.527288+0000","last_fullsized":"2024-03-20T13:38:25.527288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:25.527025+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.527025+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:53:50.329674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:27.760759+0000","last_change":"2024-03-20T13:39:27.760818+0000","last_active":"2024-03-20T13:39:27.760759+0000","last_peered":"2024-03-20T13:39:27.760759+0000","last_clean":"2024-03-20T13:39:27.760759+0000","last_became_active":"2024-03-20T13:36:46.894787+0000","last_became_peered":"2024-03-20T13:36:46.894787+0000","last_unstale":"2024-03-20T13:39:27.760759+0000","last_undegraded":"2024-03-20T13:39:27.760759+0000","last_fullsized":"2024-03-20T13:39:27.760759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:27.760557+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:27.760557+0000","last_clean_scrub_stamp":"2024-03-20T13:39:27.760557+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:24:15.848660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.798841+0000","last_change":"2024-03-20T13:38:49.798841+0000","last_active":"2024-03-20T13:38:49.798841+0000","last_peered":"2024-03-20T13:38:49.798841+0000","last_clean":"2024-03-20T13:38:49.798841+0000","last_became_active":"2024-03-20T13:36:38.825189+0000","last_became_peered":"2024-03-20T13:36:38.825189+0000","last_unstale":"2024-03-20T13:38:49.798841+0000","last_undegraded":"2024-03-20T13:38:49.798841+0000","last_fullsized":"2024-03-20T13:38:49.798841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:49.798478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:49.798478+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.798478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:08:13.331871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:12.435907+0000","last_change":"2024-03-20T13:39:12.436080+0000","last_active":"2024-03-20T13:39:12.435907+0000","last_peered":"2024-03-20T13:39:12.435907+0000","last_clean":"2024-03-20T13:39:12.435907+0000","last_became_active":"2024-03-20T13:36:36.842094+0000","last_became_peered":"2024-03-20T13:36:36.842094+0000","last_unstale":"2024-03-20T13:39:12.435907+0000","last_undegraded":"2024-03-20T13:39:12.435907+0000","last_fullsized":"2024-03-20T13:39:12.435907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:12.435613+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:12.435613+0000","last_clean_scrub_stamp":"2024-03-20T13:39:12.435613+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:30:32.426316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:24.451601+0000","last_change":"2024-03-20T13:38:24.451601+0000","last_active":"2024-03-20T13:38:24.451601+0000","last_peered":"2024-03-20T13:38:24.451601+0000","last_clean":"2024-03-20T13:38:24.451601+0000","last_became_active":"2024-03-20T13:36:40.855001+0000","last_became_peered":"2024-03-20T13:36:40.855001+0000","last_unstale":"2024-03-20T13:38:24.451601+0000","last_undegraded":"2024-03-20T13:38:24.451601+0000","last_fullsized":"2024-03-20T13:38:24.451601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:24.451322+0000","last_clean_scrub_stamp":"2024-03-20T13:38:24.451322+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:19.284619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.664886+0000","last_change":"2024-03-20T13:38:26.664886+0000","last_active":"2024-03-20T13:38:26.664886+0000","last_peered":"2024-03-20T13:38:26.664886+0000","last_clean":"2024-03-20T13:38:26.664886+0000","last_became_active":"2024-03-20T13:36:42.843303+0000","last_became_peered":"2024-03-20T13:36:42.843303+0000","last_unstale":"2024-03-20T13:38:26.664886+0000","last_undegraded":"2024-03-20T13:38:26.664886+0000","last_fullsized":"2024-03-20T13:38:26.664886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:26.664636+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.664636+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:08.014180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'244","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.370410+0000","last_change":"2024-03-20T13:39:05.370473+0000","last_active":"2024-03-20T13:39:05.370410+0000","last_peered":"2024-03-20T13:39:05.370410+0000","last_clean":"2024-03-20T13:39:05.370410+0000","last_became_active":"2024-03-20T13:36:44.877911+0000","last_became_peered":"2024-03-20T13:36:44.877911+0000","last_unstale":"2024-03-20T13:39:05.370410+0000","last_undegraded":"2024-03-20T13:39:05.370410+0000","last_fullsized":"2024-03-20T13:39:05.370410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:39:05.370216+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:39:05.370216+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.370216+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:52:28.482939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:06.658630+0000","last_change":"2024-03-20T13:39:06.658693+0000","last_active":"2024-03-20T13:39:06.658630+0000","last_peered":"2024-03-20T13:39:06.658630+0000","last_clean":"2024-03-20T13:39:06.658630+0000","last_became_active":"2024-03-20T13:36:46.893716+0000","last_became_peered":"2024-03-20T13:36:46.893716+0000","last_unstale":"2024-03-20T13:39:06.658630+0000","last_undegraded":"2024-03-20T13:39:06.658630+0000","last_fullsized":"2024-03-20T13:39:06.658630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:06.658433+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:06.658433+0000","last_clean_scrub_stamp":"2024-03-20T13:39:06.658433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:44:02.977756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.632047+0000","last_change":"2024-03-20T13:38:56.632175+0000","last_active":"2024-03-20T13:38:56.632047+0000","last_peered":"2024-03-20T13:38:56.632047+0000","last_clean":"2024-03-20T13:38:56.632047+0000","last_became_active":"2024-03-20T13:36:38.826993+0000","last_became_peered":"2024-03-20T13:36:38.826993+0000","last_unstale":"2024-03-20T13:38:56.632047+0000","last_undegraded":"2024-03-20T13:38:56.632047+0000","last_fullsized":"2024-03-20T13:38:56.632047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:56.631839+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:56.631839+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.631839+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:18.688964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:25.433365+0000","last_change":"2024-03-20T13:39:25.433431+0000","last_active":"2024-03-20T13:39:25.433365+0000","last_peered":"2024-03-20T13:39:25.433365+0000","last_clean":"2024-03-20T13:39:25.433365+0000","last_became_active":"2024-03-20T13:36:36.840881+0000","last_became_peered":"2024-03-20T13:36:36.840881+0000","last_unstale":"2024-03-20T13:39:25.433365+0000","last_undegraded":"2024-03-20T13:39:25.433365+0000","last_fullsized":"2024-03-20T13:39:25.433365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:25.433160+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:25.433160+0000","last_clean_scrub_stamp":"2024-03-20T13:39:25.433160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:22:20.340433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.569151+0000","last_change":"2024-03-20T13:38:46.569151+0000","last_active":"2024-03-20T13:38:46.569151+0000","last_peered":"2024-03-20T13:38:46.569151+0000","last_clean":"2024-03-20T13:38:46.569151+0000","last_became_active":"2024-03-20T13:36:40.849727+0000","last_became_peered":"2024-03-20T13:36:40.849727+0000","last_unstale":"2024-03-20T13:38:46.569151+0000","last_undegraded":"2024-03-20T13:38:46.569151+0000","last_fullsized":"2024-03-20T13:38:46.569151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:46.568905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:46.568905+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.568905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:55.191076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.347995+0000","last_change":"2024-03-20T13:38:36.347995+0000","last_active":"2024-03-20T13:38:36.347995+0000","last_peered":"2024-03-20T13:38:36.347995+0000","last_clean":"2024-03-20T13:38:36.347995+0000","last_became_active":"2024-03-20T13:36:42.875591+0000","last_became_peered":"2024-03-20T13:36:42.875591+0000","last_unstale":"2024-03-20T13:38:36.347995+0000","last_undegraded":"2024-03-20T13:38:36.347995+0000","last_fullsized":"2024-03-20T13:38:36.347995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-03-20T13:38:36.347716+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.347716+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:02.799858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.349678+0000","last_change":"2024-03-20T13:38:53.349678+0000","last_active":"2024-03-20T13:38:53.349678+0000","last_peered":"2024-03-20T13:38:53.349678+0000","last_clean":"2024-03-20T13:38:53.349678+0000","last_became_active":"2024-03-20T13:36:44.870587+0000","last_became_peered":"2024-03-20T13:36:44.870587+0000","last_unstale":"2024-03-20T13:38:53.349678+0000","last_undegraded":"2024-03-20T13:38:53.349678+0000","last_fullsized":"2024-03-20T13:38:53.349678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:53.349437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:53.349437+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.349437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:12:43.840969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.589381+0000","last_change":"2024-03-20T13:38:46.589381+0000","last_active":"2024-03-20T13:38:46.589381+0000","last_peered":"2024-03-20T13:38:46.589381+0000","last_clean":"2024-03-20T13:38:46.589381+0000","last_became_active":"2024-03-20T13:36:46.871380+0000","last_became_peered":"2024-03-20T13:36:46.871380+0000","last_unstale":"2024-03-20T13:38:46.589381+0000","last_undegraded":"2024-03-20T13:38:46.589381+0000","last_fullsized":"2024-03-20T13:38:46.589381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:46.589122+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:46.589122+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.589122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:31:03.922880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.373201+0000","last_change":"2024-03-20T13:38:47.373268+0000","last_active":"2024-03-20T13:38:47.373201+0000","last_peered":"2024-03-20T13:38:47.373201+0000","last_clean":"2024-03-20T13:38:47.373201+0000","last_became_active":"2024-03-20T13:36:38.844814+0000","last_became_peered":"2024-03-20T13:36:38.844814+0000","last_unstale":"2024-03-20T13:38:47.373201+0000","last_undegraded":"2024-03-20T13:38:47.373201+0000","last_fullsized":"2024-03-20T13:38:47.373201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:38:47.372986+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:38:47.372986+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.372986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:40:49.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":213,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:12.818024+0000","last_change":"2024-03-20T13:39:12.818095+0000","last_active":"2024-03-20T13:39:12.818024+0000","last_peered":"2024-03-20T13:39:12.818024+0000","last_clean":"2024-03-20T13:39:12.818024+0000","last_became_active":"2024-03-20T13:36:24.180246+0000","last_became_peered":"2024-03-20T13:36:24.180246+0000","last_unstale":"2024-03-20T13:39:12.818024+0000","last_undegraded":"2024-03-20T13:39:12.818024+0000","last_fullsized":"2024-03-20T13:39:12.818024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-03-20T13:39:12.817838+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-03-20T13:39:12.817838+0000","last_clean_scrub_stamp":"2024-03-20T13:39:12.817838+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:02:59.365172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:24.410353+0000","last_change":"2024-03-20T13:39:24.410416+0000","last_active":"2024-03-20T13:39:24.410353+0000","last_peered":"2024-03-20T13:39:24.410353+0000","last_clean":"2024-03-20T13:39:24.410353+0000","last_became_active":"2024-03-20T13:36:28.751656+0000","last_became_peered":"2024-03-20T13:36:28.751656+0000","last_unstale":"2024-03-20T13:39:24.410353+0000","last_undegraded":"2024-03-20T13:39:24.410353+0000","last_fullsized":"2024-03-20T13:39:24.410353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:24.410159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:24.410159+0000","last_clean_scrub_stamp":"2024-03-20T13:39:24.410159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:44:17.310196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:13.392639+0000","last_change":"2024-03-20T13:39:13.392698+0000","last_active":"2024-03-20T13:39:13.392639+0000","last_peered":"2024-03-20T13:39:13.392639+0000","last_clean":"2024-03-20T13:39:13.392639+0000","last_became_active":"2024-03-20T13:36:36.848810+0000","last_became_peered":"2024-03-20T13:36:36.848810+0000","last_unstale":"2024-03-20T13:39:13.392639+0000","last_undegraded":"2024-03-20T13:39:13.392639+0000","last_fullsized":"2024-03-20T13:39:13.392639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:13.392438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:13.392438+0000","last_clean_scrub_stamp":"2024-03-20T13:39:13.392438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:29.667224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.568862+0000","last_change":"2024-03-20T13:38:39.568862+0000","last_active":"2024-03-20T13:38:39.568862+0000","last_peered":"2024-03-20T13:38:39.568862+0000","last_clean":"2024-03-20T13:38:39.568862+0000","last_became_active":"2024-03-20T13:36:40.847995+0000","last_became_peered":"2024-03-20T13:36:40.847995+0000","last_unstale":"2024-03-20T13:38:39.568862+0000","last_undegraded":"2024-03-20T13:38:39.568862+0000","last_fullsized":"2024-03-20T13:38:39.568862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.568507+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.568507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:20.535216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:46.413088+0000","last_change":"2024-03-20T13:38:46.413088+0000","last_active":"2024-03-20T13:38:46.413088+0000","last_peered":"2024-03-20T13:38:46.413088+0000","last_clean":"2024-03-20T13:38:46.413088+0000","last_became_active":"2024-03-20T13:36:42.846078+0000","last_became_peered":"2024-03-20T13:36:42.846078+0000","last_unstale":"2024-03-20T13:38:46.413088+0000","last_undegraded":"2024-03-20T13:38:46.413088+0000","last_fullsized":"2024-03-20T13:38:46.413088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-03-20T13:38:46.412823+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-03-20T13:38:46.412823+0000","last_clean_scrub_stamp":"2024-03-20T13:38:46.412823+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:08.560465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.462333+0000","last_change":"2024-03-20T13:38:51.462333+0000","last_active":"2024-03-20T13:38:51.462333+0000","last_peered":"2024-03-20T13:38:51.462333+0000","last_clean":"2024-03-20T13:38:51.462333+0000","last_became_active":"2024-03-20T13:36:44.898757+0000","last_became_peered":"2024-03-20T13:36:44.898757+0000","last_unstale":"2024-03-20T13:38:51.462333+0000","last_undegraded":"2024-03-20T13:38:51.462333+0000","last_fullsized":"2024-03-20T13:38:51.462333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:51.462055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:51.462055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.462055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:26.757666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"34'52","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.679580+0000","last_change":"2024-03-20T13:39:05.679648+0000","last_active":"2024-03-20T13:39:05.679580+0000","last_peered":"2024-03-20T13:39:05.679580+0000","last_clean":"2024-03-20T13:39:05.679580+0000","last_became_active":"2024-03-20T13:36:46.889332+0000","last_became_peered":"2024-03-20T13:36:46.889332+0000","last_unstale":"2024-03-20T13:39:05.679580+0000","last_undegraded":"2024-03-20T13:39:05.679580+0000","last_fullsized":"2024-03-20T13:39:05.679580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-03-20T13:39:05.679385+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-03-20T13:39:05.679385+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.679385+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:47:20.875327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":148,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:54.483111+0000","last_change":"2024-03-20T13:38:54.483175+0000","last_active":"2024-03-20T13:38:54.483111+0000","last_peered":"2024-03-20T13:38:54.483111+0000","last_clean":"2024-03-20T13:38:54.483111+0000","last_became_active":"2024-03-20T13:36:38.834617+0000","last_became_peered":"2024-03-20T13:36:38.834617+0000","last_unstale":"2024-03-20T13:38:54.483111+0000","last_undegraded":"2024-03-20T13:38:54.483111+0000","last_fullsized":"2024-03-20T13:38:54.483111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:54.482914+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:54.482914+0000","last_clean_scrub_stamp":"2024-03-20T13:38:54.482914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:27:35.407795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:27.401013+0000","last_change":"2024-03-20T13:39:27.401070+0000","last_active":"2024-03-20T13:39:27.401013+0000","last_peered":"2024-03-20T13:39:27.401013+0000","last_clean":"2024-03-20T13:39:27.401013+0000","last_became_active":"2024-03-20T13:36:28.753702+0000","last_became_peered":"2024-03-20T13:36:28.753702+0000","last_unstale":"2024-03-20T13:39:27.401013+0000","last_undegraded":"2024-03-20T13:39:27.401013+0000","last_fullsized":"2024-03-20T13:39:27.401013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:27.400796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:27.400796+0000","last_clean_scrub_stamp":"2024-03-20T13:39:27.400796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:14:00.409807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.739621+0000","last_change":"2024-03-20T13:39:07.739678+0000","last_active":"2024-03-20T13:39:07.739621+0000","last_peered":"2024-03-20T13:39:07.739621+0000","last_clean":"2024-03-20T13:39:07.739621+0000","last_became_active":"2024-03-20T13:36:36.832418+0000","last_became_peered":"2024-03-20T13:36:36.832418+0000","last_unstale":"2024-03-20T13:39:07.739621+0000","last_undegraded":"2024-03-20T13:39:07.739621+0000","last_fullsized":"2024-03-20T13:39:07.739621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:07.739431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:07.739431+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.739431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:19:48.986195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.404985+0000","last_change":"2024-03-20T13:38:31.404985+0000","last_active":"2024-03-20T13:38:31.404985+0000","last_peered":"2024-03-20T13:38:31.404985+0000","last_clean":"2024-03-20T13:38:31.404985+0000","last_became_active":"2024-03-20T13:36:40.850120+0000","last_became_peered":"2024-03-20T13:36:40.850120+0000","last_unstale":"2024-03-20T13:38:31.404985+0000","last_undegraded":"2024-03-20T13:38:31.404985+0000","last_fullsized":"2024-03-20T13:38:31.404985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:31.404736+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.404736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:36.082582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"34'256","reported_seq":448,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.594117+0000","last_change":"2024-03-20T13:38:27.594117+0000","last_active":"2024-03-20T13:38:27.594117+0000","last_peered":"2024-03-20T13:38:27.594117+0000","last_clean":"2024-03-20T13:38:27.594117+0000","last_became_active":"2024-03-20T13:36:42.862579+0000","last_became_peered":"2024-03-20T13:36:42.862579+0000","last_unstale":"2024-03-20T13:38:27.594117+0000","last_undegraded":"2024-03-20T13:38:27.594117+0000","last_fullsized":"2024-03-20T13:38:27.594117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'256","last_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_deep_scrub":"34'256","last_deep_scrub_stamp":"2024-03-20T13:38:27.593856+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.593856+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:15.732896+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.556386+0000","last_change":"2024-03-20T13:38:43.556386+0000","last_active":"2024-03-20T13:38:43.556386+0000","last_peered":"2024-03-20T13:38:43.556386+0000","last_clean":"2024-03-20T13:38:43.556386+0000","last_became_active":"2024-03-20T13:36:44.897239+0000","last_became_peered":"2024-03-20T13:36:44.897239+0000","last_unstale":"2024-03-20T13:38:43.556386+0000","last_undegraded":"2024-03-20T13:38:43.556386+0000","last_fullsized":"2024-03-20T13:38:43.556386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:43.556135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:43.556135+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.556135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:18.900581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:26.743799+0000","last_change":"2024-03-20T13:39:26.743860+0000","last_active":"2024-03-20T13:39:26.743799+0000","last_peered":"2024-03-20T13:39:26.743799+0000","last_clean":"2024-03-20T13:39:26.743799+0000","last_became_active":"2024-03-20T13:36:46.894579+0000","last_became_peered":"2024-03-20T13:36:46.894579+0000","last_unstale":"2024-03-20T13:39:26.743799+0000","last_undegraded":"2024-03-20T13:39:26.743799+0000","last_fullsized":"2024-03-20T13:39:26.743799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-03-20T13:39:26.743607+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-03-20T13:39:26.743607+0000","last_clean_scrub_stamp":"2024-03-20T13:39:26.743607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:12:08.987813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.719111+0000","last_change":"2024-03-20T13:39:04.719169+0000","last_active":"2024-03-20T13:39:04.719111+0000","last_peered":"2024-03-20T13:39:04.719111+0000","last_clean":"2024-03-20T13:39:04.719111+0000","last_became_active":"2024-03-20T13:36:38.831794+0000","last_became_peered":"2024-03-20T13:36:38.831794+0000","last_unstale":"2024-03-20T13:39:04.719111+0000","last_undegraded":"2024-03-20T13:39:04.719111+0000","last_fullsized":"2024-03-20T13:39:04.719111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:04.718913+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:04.718913+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.718913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:15.435734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.675046+0000","last_change":"2024-03-20T13:38:56.675104+0000","last_active":"2024-03-20T13:38:56.675046+0000","last_peered":"2024-03-20T13:38:56.675046+0000","last_clean":"2024-03-20T13:38:56.675046+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:38:56.675046+0000","last_undegraded":"2024-03-20T13:38:56.675046+0000","last_fullsized":"2024-03-20T13:38:56.675046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:56.674857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:56.674857+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.674857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:59:12.553051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.708377+0000","last_change":"2024-03-20T13:39:01.708434+0000","last_active":"2024-03-20T13:39:01.708377+0000","last_peered":"2024-03-20T13:39:01.708377+0000","last_clean":"2024-03-20T13:39:01.708377+0000","last_became_active":"2024-03-20T13:36:36.835839+0000","last_became_peered":"2024-03-20T13:36:36.835839+0000","last_unstale":"2024-03-20T13:39:01.708377+0000","last_undegraded":"2024-03-20T13:39:01.708377+0000","last_fullsized":"2024-03-20T13:39:01.708377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:01.708181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:01.708181+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.708181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:07:51.185359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.785460+0000","last_change":"2024-03-20T13:38:52.785528+0000","last_active":"2024-03-20T13:38:52.785460+0000","last_peered":"2024-03-20T13:38:52.785460+0000","last_clean":"2024-03-20T13:38:52.785460+0000","last_became_active":"2024-03-20T13:36:40.835462+0000","last_became_peered":"2024-03-20T13:36:40.835462+0000","last_unstale":"2024-03-20T13:38:52.785460+0000","last_undegraded":"2024-03-20T13:38:52.785460+0000","last_fullsized":"2024-03-20T13:38:52.785460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:52.785272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.785272+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.785272+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:02.533126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.434925+0000","last_change":"2024-03-20T13:38:29.434925+0000","last_active":"2024-03-20T13:38:29.434925+0000","last_peered":"2024-03-20T13:38:29.434925+0000","last_clean":"2024-03-20T13:38:29.434925+0000","last_became_active":"2024-03-20T13:36:42.842143+0000","last_became_peered":"2024-03-20T13:36:42.842143+0000","last_unstale":"2024-03-20T13:38:29.434925+0000","last_undegraded":"2024-03-20T13:38:29.434925+0000","last_fullsized":"2024-03-20T13:38:29.434925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-03-20T13:38:29.434642+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.434642+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.312836+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.577902+0000","last_change":"2024-03-20T13:38:26.577902+0000","last_active":"2024-03-20T13:38:26.577902+0000","last_peered":"2024-03-20T13:38:26.577902+0000","last_clean":"2024-03-20T13:38:26.577902+0000","last_became_active":"2024-03-20T13:36:44.871479+0000","last_became_peered":"2024-03-20T13:36:44.871479+0000","last_unstale":"2024-03-20T13:38:26.577902+0000","last_undegraded":"2024-03-20T13:38:26.577902+0000","last_fullsized":"2024-03-20T13:38:26.577902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.577544+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.577544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:31.374045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.478081+0000","last_change":"2024-03-20T13:38:59.478081+0000","last_active":"2024-03-20T13:38:59.478081+0000","last_peered":"2024-03-20T13:38:59.478081+0000","last_clean":"2024-03-20T13:38:59.478081+0000","last_became_active":"2024-03-20T13:36:46.873226+0000","last_became_peered":"2024-03-20T13:36:46.873226+0000","last_unstale":"2024-03-20T13:38:59.478081+0000","last_undegraded":"2024-03-20T13:38:59.478081+0000","last_fullsized":"2024-03-20T13:38:59.478081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.477674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.477674+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.477674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:35:30.131510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.579357+0000","last_change":"2024-03-20T13:38:48.579421+0000","last_active":"2024-03-20T13:38:48.579357+0000","last_peered":"2024-03-20T13:38:48.579357+0000","last_clean":"2024-03-20T13:38:48.579357+0000","last_became_active":"2024-03-20T13:36:38.838789+0000","last_became_peered":"2024-03-20T13:36:38.838789+0000","last_unstale":"2024-03-20T13:38:48.579357+0000","last_undegraded":"2024-03-20T13:38:48.579357+0000","last_fullsized":"2024-03-20T13:38:48.579357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:48.579175+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:48.579175+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.579175+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:07:18.825200+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:25.457445+0000","last_change":"2024-03-20T13:39:25.457498+0000","last_active":"2024-03-20T13:39:25.457445+0000","last_peered":"2024-03-20T13:39:25.457445+0000","last_clean":"2024-03-20T13:39:25.457445+0000","last_became_active":"2024-03-20T13:36:28.752013+0000","last_became_peered":"2024-03-20T13:36:28.752013+0000","last_unstale":"2024-03-20T13:39:25.457445+0000","last_undegraded":"2024-03-20T13:39:25.457445+0000","last_fullsized":"2024-03-20T13:39:25.457445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:25.457246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:25.457246+0000","last_clean_scrub_stamp":"2024-03-20T13:39:25.457246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:22:20.364519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:30.384496+0000","last_change":"2024-03-20T13:39:30.384556+0000","last_active":"2024-03-20T13:39:30.384496+0000","last_peered":"2024-03-20T13:39:30.384496+0000","last_clean":"2024-03-20T13:39:30.384496+0000","last_became_active":"2024-03-20T13:36:36.817973+0000","last_became_peered":"2024-03-20T13:36:36.817973+0000","last_unstale":"2024-03-20T13:39:30.384496+0000","last_undegraded":"2024-03-20T13:39:30.384496+0000","last_fullsized":"2024-03-20T13:39:30.384496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:30.384295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:30.384295+0000","last_clean_scrub_stamp":"2024-03-20T13:39:30.384295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:20.002315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.643838+0000","last_change":"2024-03-20T13:38:43.643838+0000","last_active":"2024-03-20T13:38:43.643838+0000","last_peered":"2024-03-20T13:38:43.643838+0000","last_clean":"2024-03-20T13:38:43.643838+0000","last_became_active":"2024-03-20T13:36:40.845391+0000","last_became_peered":"2024-03-20T13:36:40.845391+0000","last_unstale":"2024-03-20T13:38:43.643838+0000","last_undegraded":"2024-03-20T13:38:43.643838+0000","last_fullsized":"2024-03-20T13:38:43.643838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:43.643583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:43.643583+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.643583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:13:49.867880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.665096+0000","last_change":"2024-03-20T13:38:31.665096+0000","last_active":"2024-03-20T13:38:31.665096+0000","last_peered":"2024-03-20T13:38:31.665096+0000","last_clean":"2024-03-20T13:38:31.665096+0000","last_became_active":"2024-03-20T13:36:42.846567+0000","last_became_peered":"2024-03-20T13:36:42.846567+0000","last_unstale":"2024-03-20T13:38:31.665096+0000","last_undegraded":"2024-03-20T13:38:31.665096+0000","last_fullsized":"2024-03-20T13:38:31.665096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-03-20T13:38:31.664843+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.664843+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:03:43.219513+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.526385+0000","last_change":"2024-03-20T13:38:55.526385+0000","last_active":"2024-03-20T13:38:55.526385+0000","last_peered":"2024-03-20T13:38:55.526385+0000","last_clean":"2024-03-20T13:38:55.526385+0000","last_became_active":"2024-03-20T13:36:44.900311+0000","last_became_peered":"2024-03-20T13:36:44.900311+0000","last_unstale":"2024-03-20T13:38:55.526385+0000","last_undegraded":"2024-03-20T13:38:55.526385+0000","last_fullsized":"2024-03-20T13:38:55.526385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:55.526096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:55.526096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.526096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:50.661554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:22.775182+0000","last_change":"2024-03-20T13:39:22.775239+0000","last_active":"2024-03-20T13:39:22.775182+0000","last_peered":"2024-03-20T13:39:22.775182+0000","last_clean":"2024-03-20T13:39:22.775182+0000","last_became_active":"2024-03-20T13:36:46.885996+0000","last_became_peered":"2024-03-20T13:36:46.885996+0000","last_unstale":"2024-03-20T13:39:22.775182+0000","last_undegraded":"2024-03-20T13:39:22.775182+0000","last_fullsized":"2024-03-20T13:39:22.775182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:22.774988+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:22.774988+0000","last_clean_scrub_stamp":"2024-03-20T13:39:22.774988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:43:32.861643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:20.738972+0000","last_change":"2024-03-20T13:39:20.739126+0000","last_active":"2024-03-20T13:39:20.738972+0000","last_peered":"2024-03-20T13:39:20.738972+0000","last_clean":"2024-03-20T13:39:20.738972+0000","last_became_active":"2024-03-20T13:36:38.834120+0000","last_became_peered":"2024-03-20T13:36:38.834120+0000","last_unstale":"2024-03-20T13:39:20.738972+0000","last_undegraded":"2024-03-20T13:39:20.738972+0000","last_fullsized":"2024-03-20T13:39:20.738972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:20.738695+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:20.738695+0000","last_clean_scrub_stamp":"2024-03-20T13:39:20.738695+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:52:04.437958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:29.433007+0000","last_change":"2024-03-20T13:39:29.433065+0000","last_active":"2024-03-20T13:39:29.433007+0000","last_peered":"2024-03-20T13:39:29.433007+0000","last_clean":"2024-03-20T13:39:29.433007+0000","last_became_active":"2024-03-20T13:36:36.817419+0000","last_became_peered":"2024-03-20T13:36:36.817419+0000","last_unstale":"2024-03-20T13:39:29.433007+0000","last_undegraded":"2024-03-20T13:39:29.433007+0000","last_fullsized":"2024-03-20T13:39:29.433007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:29.432805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:29.432805+0000","last_clean_scrub_stamp":"2024-03-20T13:39:29.432805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:47.683027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:14.753811+0000","last_change":"2024-03-20T13:39:14.753937+0000","last_active":"2024-03-20T13:39:14.753811+0000","last_peered":"2024-03-20T13:39:14.753811+0000","last_clean":"2024-03-20T13:39:14.753811+0000","last_became_active":"2024-03-20T13:36:29.118229+0000","last_became_peered":"2024-03-20T13:36:29.118229+0000","last_unstale":"2024-03-20T13:39:14.753811+0000","last_undegraded":"2024-03-20T13:39:14.753811+0000","last_fullsized":"2024-03-20T13:39:14.753811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:14.753585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:14.753585+0000","last_clean_scrub_stamp":"2024-03-20T13:39:14.753585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:49:05.278331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:39.595471+0000","last_change":"2024-03-20T13:38:39.595471+0000","last_active":"2024-03-20T13:38:39.595471+0000","last_peered":"2024-03-20T13:38:39.595471+0000","last_clean":"2024-03-20T13:38:39.595471+0000","last_became_active":"2024-03-20T13:36:40.846196+0000","last_became_peered":"2024-03-20T13:36:40.846196+0000","last_unstale":"2024-03-20T13:38:39.595471+0000","last_undegraded":"2024-03-20T13:38:39.595471+0000","last_fullsized":"2024-03-20T13:38:39.595471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:39.595226+0000","last_clean_scrub_stamp":"2024-03-20T13:38:39.595226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:34.240122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'68","reported_seq":144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:31.532606+0000","last_change":"2024-03-20T13:38:31.532606+0000","last_active":"2024-03-20T13:38:31.532606+0000","last_peered":"2024-03-20T13:38:31.532606+0000","last_clean":"2024-03-20T13:38:31.532606+0000","last_became_active":"2024-03-20T13:36:42.850975+0000","last_became_peered":"2024-03-20T13:36:42.850975+0000","last_unstale":"2024-03-20T13:38:31.532606+0000","last_undegraded":"2024-03-20T13:38:31.532606+0000","last_fullsized":"2024-03-20T13:38:31.532606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'68","last_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_deep_scrub":"34'68","last_deep_scrub_stamp":"2024-03-20T13:38:31.532334+0000","last_clean_scrub_stamp":"2024-03-20T13:38:31.532334+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:30:24.833392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.295952+0000","last_change":"2024-03-20T13:38:41.295952+0000","last_active":"2024-03-20T13:38:41.295952+0000","last_peered":"2024-03-20T13:38:41.295952+0000","last_clean":"2024-03-20T13:38:41.295952+0000","last_became_active":"2024-03-20T13:36:44.869021+0000","last_became_peered":"2024-03-20T13:36:44.869021+0000","last_unstale":"2024-03-20T13:38:41.295952+0000","last_undegraded":"2024-03-20T13:38:41.295952+0000","last_fullsized":"2024-03-20T13:38:41.295952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:41.295702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:41.295702+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.295702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:31.520002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.559920+0000","last_change":"2024-03-20T13:38:30.559920+0000","last_active":"2024-03-20T13:38:30.559920+0000","last_peered":"2024-03-20T13:38:30.559920+0000","last_clean":"2024-03-20T13:38:30.559920+0000","last_became_active":"2024-03-20T13:36:46.888309+0000","last_became_peered":"2024-03-20T13:36:46.888309+0000","last_unstale":"2024-03-20T13:38:30.559920+0000","last_undegraded":"2024-03-20T13:38:30.559920+0000","last_fullsized":"2024-03-20T13:38:30.559920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:30.559669+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.559669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:18:34.421204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.719618+0000","last_change":"2024-03-20T13:39:00.719680+0000","last_active":"2024-03-20T13:39:00.719618+0000","last_peered":"2024-03-20T13:39:00.719618+0000","last_clean":"2024-03-20T13:39:00.719618+0000","last_became_active":"2024-03-20T13:36:38.827614+0000","last_became_peered":"2024-03-20T13:36:38.827614+0000","last_unstale":"2024-03-20T13:39:00.719618+0000","last_undegraded":"2024-03-20T13:39:00.719618+0000","last_fullsized":"2024-03-20T13:39:00.719618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:00.719427+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:00.719427+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.719427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:35:54.364275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:16.742325+0000","last_change":"2024-03-20T13:39:16.742471+0000","last_active":"2024-03-20T13:39:16.742325+0000","last_peered":"2024-03-20T13:39:16.742325+0000","last_clean":"2024-03-20T13:39:16.742325+0000","last_became_active":"2024-03-20T13:36:36.830276+0000","last_became_peered":"2024-03-20T13:36:36.830276+0000","last_unstale":"2024-03-20T13:39:16.742325+0000","last_undegraded":"2024-03-20T13:39:16.742325+0000","last_fullsized":"2024-03-20T13:39:16.742325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:16.742053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:16.742053+0000","last_clean_scrub_stamp":"2024-03-20T13:39:16.742053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:23:54.596602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:23.386697+0000","last_change":"2024-03-20T13:39:23.386749+0000","last_active":"2024-03-20T13:39:23.386697+0000","last_peered":"2024-03-20T13:39:23.386697+0000","last_clean":"2024-03-20T13:39:23.386697+0000","last_became_active":"2024-03-20T13:36:28.751720+0000","last_became_peered":"2024-03-20T13:36:28.751720+0000","last_unstale":"2024-03-20T13:39:23.386697+0000","last_undegraded":"2024-03-20T13:39:23.386697+0000","last_fullsized":"2024-03-20T13:39:23.386697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:23.386505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:23.386505+0000","last_clean_scrub_stamp":"2024-03-20T13:39:23.386505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:49:23.577267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.396031+0000","last_change":"2024-03-20T13:38:30.396031+0000","last_active":"2024-03-20T13:38:30.396031+0000","last_peered":"2024-03-20T13:38:30.396031+0000","last_clean":"2024-03-20T13:38:30.396031+0000","last_became_active":"2024-03-20T13:36:40.850159+0000","last_became_peered":"2024-03-20T13:36:40.850159+0000","last_unstale":"2024-03-20T13:38:30.396031+0000","last_undegraded":"2024-03-20T13:38:30.396031+0000","last_fullsized":"2024-03-20T13:38:30.396031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.395743+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.395743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:19.841036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.620785+0000","last_change":"2024-03-20T13:38:25.620785+0000","last_active":"2024-03-20T13:38:25.620785+0000","last_peered":"2024-03-20T13:38:25.620785+0000","last_clean":"2024-03-20T13:38:25.620785+0000","last_became_active":"2024-03-20T13:36:42.861245+0000","last_became_peered":"2024-03-20T13:36:42.861245+0000","last_unstale":"2024-03-20T13:38:25.620785+0000","last_undegraded":"2024-03-20T13:38:25.620785+0000","last_fullsized":"2024-03-20T13:38:25.620785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-03-20T13:38:25.620381+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.620381+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:16.685474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'243","reported_seq":331,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.526805+0000","last_change":"2024-03-20T13:38:30.526805+0000","last_active":"2024-03-20T13:38:30.526805+0000","last_peered":"2024-03-20T13:38:30.526805+0000","last_clean":"2024-03-20T13:38:30.526805+0000","last_became_active":"2024-03-20T13:36:44.871718+0000","last_became_peered":"2024-03-20T13:36:44.871718+0000","last_unstale":"2024-03-20T13:38:30.526805+0000","last_undegraded":"2024-03-20T13:38:30.526805+0000","last_fullsized":"2024-03-20T13:38:30.526805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:30.526556+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.526556+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:46.021855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:34.379045+0000","last_change":"2024-03-20T13:39:34.379160+0000","last_active":"2024-03-20T13:39:34.379045+0000","last_peered":"2024-03-20T13:39:34.379045+0000","last_clean":"2024-03-20T13:39:34.379045+0000","last_became_active":"2024-03-20T13:36:46.895131+0000","last_became_peered":"2024-03-20T13:36:46.895131+0000","last_unstale":"2024-03-20T13:39:34.379045+0000","last_undegraded":"2024-03-20T13:39:34.379045+0000","last_fullsized":"2024-03-20T13:39:34.379045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:34.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:34.378828+0000","last_clean_scrub_stamp":"2024-03-20T13:39:34.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:11.368018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:17.407031+0000","last_change":"2024-03-20T13:39:17.407096+0000","last_active":"2024-03-20T13:39:17.407031+0000","last_peered":"2024-03-20T13:39:17.407031+0000","last_clean":"2024-03-20T13:39:17.407031+0000","last_became_active":"2024-03-20T13:36:38.812457+0000","last_became_peered":"2024-03-20T13:36:38.812457+0000","last_unstale":"2024-03-20T13:39:17.407031+0000","last_undegraded":"2024-03-20T13:39:17.407031+0000","last_fullsized":"2024-03-20T13:39:17.407031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:17.406838+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:17.406838+0000","last_clean_scrub_stamp":"2024-03-20T13:39:17.406838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:55:22.629587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.432733+0000","last_change":"2024-03-20T13:39:10.432891+0000","last_active":"2024-03-20T13:39:10.432733+0000","last_peered":"2024-03-20T13:39:10.432733+0000","last_clean":"2024-03-20T13:39:10.432733+0000","last_became_active":"2024-03-20T13:36:36.847236+0000","last_became_peered":"2024-03-20T13:36:36.847236+0000","last_unstale":"2024-03-20T13:39:10.432733+0000","last_undegraded":"2024-03-20T13:39:10.432733+0000","last_fullsized":"2024-03-20T13:39:10.432733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:10.432510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:10.432510+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.432510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:13:39.177692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:13.772995+0000","last_change":"2024-03-20T13:39:13.773047+0000","last_active":"2024-03-20T13:39:13.772995+0000","last_peered":"2024-03-20T13:39:13.772995+0000","last_clean":"2024-03-20T13:39:13.772995+0000","last_became_active":"2024-03-20T13:36:28.748798+0000","last_became_peered":"2024-03-20T13:36:28.748798+0000","last_unstale":"2024-03-20T13:39:13.772995+0000","last_undegraded":"2024-03-20T13:39:13.772995+0000","last_fullsized":"2024-03-20T13:39:13.772995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:13.772806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:13.772806+0000","last_clean_scrub_stamp":"2024-03-20T13:39:13.772806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:40:08.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.425602+0000","last_change":"2024-03-20T13:38:23.425602+0000","last_active":"2024-03-20T13:38:23.425602+0000","last_peered":"2024-03-20T13:38:23.425602+0000","last_clean":"2024-03-20T13:38:23.425602+0000","last_became_active":"2024-03-20T13:36:40.857171+0000","last_became_peered":"2024-03-20T13:36:40.857171+0000","last_unstale":"2024-03-20T13:38:23.425602+0000","last_undegraded":"2024-03-20T13:38:23.425602+0000","last_fullsized":"2024-03-20T13:38:23.425602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.425487+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.425487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:03.433420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.612586+0000","last_change":"2024-03-20T13:38:42.612586+0000","last_active":"2024-03-20T13:38:42.612586+0000","last_peered":"2024-03-20T13:38:42.612586+0000","last_clean":"2024-03-20T13:38:42.612586+0000","last_became_active":"2024-03-20T13:36:42.854605+0000","last_became_peered":"2024-03-20T13:36:42.854605+0000","last_unstale":"2024-03-20T13:38:42.612586+0000","last_undegraded":"2024-03-20T13:38:42.612586+0000","last_fullsized":"2024-03-20T13:38:42.612586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-03-20T13:38:42.612284+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-03-20T13:38:42.612284+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.612284+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:43.020680+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'243","reported_seq":329,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.624509+0000","last_change":"2024-03-20T13:38:33.624509+0000","last_active":"2024-03-20T13:38:33.624509+0000","last_peered":"2024-03-20T13:38:33.624509+0000","last_clean":"2024-03-20T13:38:33.624509+0000","last_became_active":"2024-03-20T13:36:44.893655+0000","last_became_peered":"2024-03-20T13:36:44.893655+0000","last_unstale":"2024-03-20T13:38:33.624509+0000","last_undegraded":"2024-03-20T13:38:33.624509+0000","last_fullsized":"2024-03-20T13:38:33.624509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'243","last_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_deep_scrub":"34'243","last_deep_scrub_stamp":"2024-03-20T13:38:33.624254+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.624254+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:31:42.470838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:25.722508+0000","last_change":"2024-03-20T13:39:25.722570+0000","last_active":"2024-03-20T13:39:25.722508+0000","last_peered":"2024-03-20T13:39:25.722508+0000","last_clean":"2024-03-20T13:39:25.722508+0000","last_became_active":"2024-03-20T13:36:46.891516+0000","last_became_peered":"2024-03-20T13:36:46.891516+0000","last_unstale":"2024-03-20T13:39:25.722508+0000","last_undegraded":"2024-03-20T13:39:25.722508+0000","last_fullsized":"2024-03-20T13:39:25.722508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:39:25.722316+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:39:25.722316+0000","last_clean_scrub_stamp":"2024-03-20T13:39:25.722316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:22.238126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.796755+0000","last_change":"2024-03-20T13:38:47.796817+0000","last_active":"2024-03-20T13:38:47.796755+0000","last_peered":"2024-03-20T13:38:47.796755+0000","last_clean":"2024-03-20T13:38:47.796755+0000","last_became_active":"2024-03-20T13:36:38.825317+0000","last_became_peered":"2024-03-20T13:36:38.825317+0000","last_unstale":"2024-03-20T13:38:47.796755+0000","last_undegraded":"2024-03-20T13:38:47.796755+0000","last_fullsized":"2024-03-20T13:38:47.796755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:47.796569+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:47.796569+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.796569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:10:46.550018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:18.769720+0000","last_change":"2024-03-20T13:39:18.769780+0000","last_active":"2024-03-20T13:39:18.769720+0000","last_peered":"2024-03-20T13:39:18.769720+0000","last_clean":"2024-03-20T13:39:18.769720+0000","last_became_active":"2024-03-20T13:36:36.830252+0000","last_became_peered":"2024-03-20T13:36:36.830252+0000","last_unstale":"2024-03-20T13:39:18.769720+0000","last_undegraded":"2024-03-20T13:39:18.769720+0000","last_fullsized":"2024-03-20T13:39:18.769720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:18.769523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:18.769523+0000","last_clean_scrub_stamp":"2024-03-20T13:39:18.769523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:10.422181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:26.426132+0000","last_change":"2024-03-20T13:39:26.426190+0000","last_active":"2024-03-20T13:39:26.426132+0000","last_peered":"2024-03-20T13:39:26.426132+0000","last_clean":"2024-03-20T13:39:26.426132+0000","last_became_active":"2024-03-20T13:36:28.752019+0000","last_became_peered":"2024-03-20T13:36:28.752019+0000","last_unstale":"2024-03-20T13:39:26.426132+0000","last_undegraded":"2024-03-20T13:39:26.426132+0000","last_fullsized":"2024-03-20T13:39:26.426132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:26.425941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:26.425941+0000","last_clean_scrub_stamp":"2024-03-20T13:39:26.425941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:54:52.683672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:30.640338+0000","last_change":"2024-03-20T13:38:30.640338+0000","last_active":"2024-03-20T13:38:30.640338+0000","last_peered":"2024-03-20T13:38:30.640338+0000","last_clean":"2024-03-20T13:38:30.640338+0000","last_became_active":"2024-03-20T13:37:17.364771+0000","last_became_peered":"2024-03-20T13:37:17.364771+0000","last_unstale":"2024-03-20T13:38:30.640338+0000","last_undegraded":"2024-03-20T13:38:30.640338+0000","last_fullsized":"2024-03-20T13:38:30.640338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:30.640055+0000","last_clean_scrub_stamp":"2024-03-20T13:38:30.640055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:20.085347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":184,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.394015+0000","last_change":"2024-03-20T13:38:33.394015+0000","last_active":"2024-03-20T13:38:33.394015+0000","last_peered":"2024-03-20T13:38:33.394015+0000","last_clean":"2024-03-20T13:38:33.394015+0000","last_became_active":"2024-03-20T13:36:42.841291+0000","last_became_peered":"2024-03-20T13:36:42.841291+0000","last_unstale":"2024-03-20T13:38:33.394015+0000","last_undegraded":"2024-03-20T13:38:33.394015+0000","last_fullsized":"2024-03-20T13:38:33.394015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-03-20T13:38:33.393752+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.393752+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:13.108218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.607288+0000","last_change":"2024-03-20T13:38:35.607288+0000","last_active":"2024-03-20T13:38:35.607288+0000","last_peered":"2024-03-20T13:38:35.607288+0000","last_clean":"2024-03-20T13:38:35.607288+0000","last_became_active":"2024-03-20T13:36:44.893994+0000","last_became_peered":"2024-03-20T13:36:44.893994+0000","last_unstale":"2024-03-20T13:38:35.607288+0000","last_undegraded":"2024-03-20T13:38:35.607288+0000","last_fullsized":"2024-03-20T13:38:35.607288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:35.607032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.607032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:55:24.977582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.511758+0000","last_change":"2024-03-20T13:38:23.511758+0000","last_active":"2024-03-20T13:38:23.511758+0000","last_peered":"2024-03-20T13:38:23.511758+0000","last_clean":"2024-03-20T13:38:23.511758+0000","last_became_active":"2024-03-20T13:36:46.888126+0000","last_became_peered":"2024-03-20T13:36:46.888126+0000","last_unstale":"2024-03-20T13:38:23.511758+0000","last_undegraded":"2024-03-20T13:38:23.511758+0000","last_fullsized":"2024-03-20T13:38:23.511758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:23.511495+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.511495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:10.006144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.608882+0000","last_change":"2024-03-20T13:38:38.608882+0000","last_active":"2024-03-20T13:38:38.608882+0000","last_peered":"2024-03-20T13:38:38.608882+0000","last_clean":"2024-03-20T13:38:38.608882+0000","last_became_active":"2024-03-20T13:36:46.888882+0000","last_became_peered":"2024-03-20T13:36:46.888882+0000","last_unstale":"2024-03-20T13:38:38.608882+0000","last_undegraded":"2024-03-20T13:38:38.608882+0000","last_fullsized":"2024-03-20T13:38:38.608882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.608632+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.608632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:17:09.360540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:45.774095+0000","last_change":"2024-03-20T13:38:45.774095+0000","last_active":"2024-03-20T13:38:45.774095+0000","last_peered":"2024-03-20T13:38:45.774095+0000","last_clean":"2024-03-20T13:38:45.774095+0000","last_became_active":"2024-03-20T13:36:38.826650+0000","last_became_peered":"2024-03-20T13:36:38.826650+0000","last_unstale":"2024-03-20T13:38:45.774095+0000","last_undegraded":"2024-03-20T13:38:45.774095+0000","last_fullsized":"2024-03-20T13:38:45.774095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-03-20T13:38:45.773816+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-03-20T13:38:45.773816+0000","last_clean_scrub_stamp":"2024-03-20T13:38:45.773816+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:39:52.703727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:21.417737+0000","last_change":"2024-03-20T13:39:21.417796+0000","last_active":"2024-03-20T13:39:21.417737+0000","last_peered":"2024-03-20T13:39:21.417737+0000","last_clean":"2024-03-20T13:39:21.417737+0000","last_became_active":"2024-03-20T13:36:36.833081+0000","last_became_peered":"2024-03-20T13:36:36.833081+0000","last_unstale":"2024-03-20T13:39:21.417737+0000","last_undegraded":"2024-03-20T13:39:21.417737+0000","last_fullsized":"2024-03-20T13:39:21.417737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:21.417535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:21.417535+0000","last_clean_scrub_stamp":"2024-03-20T13:39:21.417535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:02.423118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.603602+0000","last_change":"2024-03-20T13:38:44.603602+0000","last_active":"2024-03-20T13:38:44.603602+0000","last_peered":"2024-03-20T13:38:44.603602+0000","last_clean":"2024-03-20T13:38:44.603602+0000","last_became_active":"2024-03-20T13:36:40.844752+0000","last_became_peered":"2024-03-20T13:36:40.844752+0000","last_unstale":"2024-03-20T13:38:44.603602+0000","last_undegraded":"2024-03-20T13:38:44.603602+0000","last_fullsized":"2024-03-20T13:38:44.603602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:44.603360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:44.603360+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.603360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:50:57.154639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.581462+0000","last_change":"2024-03-20T13:38:41.581462+0000","last_active":"2024-03-20T13:38:41.581462+0000","last_peered":"2024-03-20T13:38:41.581462+0000","last_clean":"2024-03-20T13:38:41.581462+0000","last_became_active":"2024-03-20T13:36:42.864772+0000","last_became_peered":"2024-03-20T13:36:42.864772+0000","last_unstale":"2024-03-20T13:38:41.581462+0000","last_undegraded":"2024-03-20T13:38:41.581462+0000","last_fullsized":"2024-03-20T13:38:41.581462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-03-20T13:38:41.580998+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-03-20T13:38:41.580998+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.580998+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:22:22.559251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.610771+0000","last_change":"2024-03-20T13:38:36.610771+0000","last_active":"2024-03-20T13:38:36.610771+0000","last_peered":"2024-03-20T13:38:36.610771+0000","last_clean":"2024-03-20T13:38:36.610771+0000","last_became_active":"2024-03-20T13:36:44.883412+0000","last_became_peered":"2024-03-20T13:36:44.883412+0000","last_unstale":"2024-03-20T13:38:36.610771+0000","last_undegraded":"2024-03-20T13:38:36.610771+0000","last_fullsized":"2024-03-20T13:38:36.610771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:36.610516+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.610516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:03.062657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:30.474296+0000","last_change":"2024-03-20T13:39:30.474418+0000","last_active":"2024-03-20T13:39:30.474296+0000","last_peered":"2024-03-20T13:39:30.474296+0000","last_clean":"2024-03-20T13:39:30.474296+0000","last_became_active":"2024-03-20T13:36:46.882992+0000","last_became_peered":"2024-03-20T13:36:46.882992+0000","last_unstale":"2024-03-20T13:39:30.474296+0000","last_undegraded":"2024-03-20T13:39:30.474296+0000","last_fullsized":"2024-03-20T13:39:30.474296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:30.473999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:30.473999+0000","last_clean_scrub_stamp":"2024-03-20T13:39:30.473999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:28.414202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.633218+0000","last_change":"2024-03-20T13:38:55.633218+0000","last_active":"2024-03-20T13:38:55.633218+0000","last_peered":"2024-03-20T13:38:55.633218+0000","last_clean":"2024-03-20T13:38:55.633218+0000","last_became_active":"2024-03-20T13:36:38.833865+0000","last_became_peered":"2024-03-20T13:36:38.833865+0000","last_unstale":"2024-03-20T13:38:55.633218+0000","last_undegraded":"2024-03-20T13:38:55.633218+0000","last_fullsized":"2024-03-20T13:38:55.633218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:55.632954+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:55.632954+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.632954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:05.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.683297+0000","last_change":"2024-03-20T13:38:58.683297+0000","last_active":"2024-03-20T13:38:58.683297+0000","last_peered":"2024-03-20T13:38:58.683297+0000","last_clean":"2024-03-20T13:38:58.683297+0000","last_became_active":"2024-03-20T13:36:36.811845+0000","last_became_peered":"2024-03-20T13:36:36.811845+0000","last_unstale":"2024-03-20T13:38:58.683297+0000","last_undegraded":"2024-03-20T13:38:58.683297+0000","last_fullsized":"2024-03-20T13:38:58.683297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:58.683054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:58.683054+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.683054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:04:10.237724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.555801+0000","last_change":"2024-03-20T13:38:48.555801+0000","last_active":"2024-03-20T13:38:48.555801+0000","last_peered":"2024-03-20T13:38:48.555801+0000","last_clean":"2024-03-20T13:38:48.555801+0000","last_became_active":"2024-03-20T13:36:40.848791+0000","last_became_peered":"2024-03-20T13:36:40.848791+0000","last_unstale":"2024-03-20T13:38:48.555801+0000","last_undegraded":"2024-03-20T13:38:48.555801+0000","last_fullsized":"2024-03-20T13:38:48.555801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:48.555555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:48.555555+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.555555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:14.196969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.580058+0000","last_change":"2024-03-20T13:38:29.580058+0000","last_active":"2024-03-20T13:38:29.580058+0000","last_peered":"2024-03-20T13:38:29.580058+0000","last_clean":"2024-03-20T13:38:29.580058+0000","last_became_active":"2024-03-20T13:36:42.857261+0000","last_became_peered":"2024-03-20T13:36:42.857261+0000","last_unstale":"2024-03-20T13:38:29.580058+0000","last_undegraded":"2024-03-20T13:38:29.580058+0000","last_fullsized":"2024-03-20T13:38:29.580058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-03-20T13:38:29.579791+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.579791+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:45:56.167406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.591499+0000","last_change":"2024-03-20T13:38:29.591499+0000","last_active":"2024-03-20T13:38:29.591499+0000","last_peered":"2024-03-20T13:38:29.591499+0000","last_clean":"2024-03-20T13:38:29.591499+0000","last_became_active":"2024-03-20T13:36:44.867485+0000","last_became_peered":"2024-03-20T13:36:44.867485+0000","last_unstale":"2024-03-20T13:38:29.591499+0000","last_undegraded":"2024-03-20T13:38:29.591499+0000","last_fullsized":"2024-03-20T13:38:29.591499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.591251+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.591251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:10:46.103619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:23.744290+0000","last_change":"2024-03-20T13:39:23.744355+0000","last_active":"2024-03-20T13:39:23.744290+0000","last_peered":"2024-03-20T13:39:23.744290+0000","last_clean":"2024-03-20T13:39:23.744290+0000","last_became_active":"2024-03-20T13:36:46.887201+0000","last_became_peered":"2024-03-20T13:36:46.887201+0000","last_unstale":"2024-03-20T13:39:23.744290+0000","last_undegraded":"2024-03-20T13:39:23.744290+0000","last_fullsized":"2024-03-20T13:39:23.744290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:23.744095+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:23.744095+0000","last_clean_scrub_stamp":"2024-03-20T13:39:23.744095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:38.320964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.477948+0000","last_change":"2024-03-20T13:38:58.477948+0000","last_active":"2024-03-20T13:38:58.477948+0000","last_peered":"2024-03-20T13:38:58.477948+0000","last_clean":"2024-03-20T13:38:58.477948+0000","last_became_active":"2024-03-20T13:36:38.830259+0000","last_became_peered":"2024-03-20T13:36:38.830259+0000","last_unstale":"2024-03-20T13:38:58.477948+0000","last_undegraded":"2024-03-20T13:38:58.477948+0000","last_fullsized":"2024-03-20T13:38:58.477948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:38:58.477682+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:38:58.477682+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.477682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:53:06.983876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.325197+0000","last_change":"2024-03-20T13:39:11.325258+0000","last_active":"2024-03-20T13:39:11.325197+0000","last_peered":"2024-03-20T13:39:11.325197+0000","last_clean":"2024-03-20T13:39:11.325197+0000","last_became_active":"2024-03-20T13:36:36.830274+0000","last_became_peered":"2024-03-20T13:36:36.830274+0000","last_unstale":"2024-03-20T13:39:11.325197+0000","last_undegraded":"2024-03-20T13:39:11.325197+0000","last_fullsized":"2024-03-20T13:39:11.325197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:11.324991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:11.324991+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.324991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.576347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:26.440960+0000","last_change":"2024-03-20T13:38:26.440960+0000","last_active":"2024-03-20T13:38:26.440960+0000","last_peered":"2024-03-20T13:38:26.440960+0000","last_clean":"2024-03-20T13:38:26.440960+0000","last_became_active":"2024-03-20T13:36:40.855048+0000","last_became_peered":"2024-03-20T13:36:40.855048+0000","last_unstale":"2024-03-20T13:38:26.440960+0000","last_undegraded":"2024-03-20T13:38:26.440960+0000","last_fullsized":"2024-03-20T13:38:26.440960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:26.440701+0000","last_clean_scrub_stamp":"2024-03-20T13:38:26.440701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:34.910452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"34'42","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.605165+0000","last_change":"2024-03-20T13:38:40.605165+0000","last_active":"2024-03-20T13:38:40.605165+0000","last_peered":"2024-03-20T13:38:40.605165+0000","last_clean":"2024-03-20T13:38:40.605165+0000","last_became_active":"2024-03-20T13:36:42.867686+0000","last_became_peered":"2024-03-20T13:36:42.867686+0000","last_unstale":"2024-03-20T13:38:40.605165+0000","last_undegraded":"2024-03-20T13:38:40.605165+0000","last_fullsized":"2024-03-20T13:38:40.605165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'42","last_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_deep_scrub":"34'42","last_deep_scrub_stamp":"2024-03-20T13:38:40.604871+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.604871+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:50:04.270564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:42.630318+0000","last_change":"2024-03-20T13:38:42.630318+0000","last_active":"2024-03-20T13:38:42.630318+0000","last_peered":"2024-03-20T13:38:42.630318+0000","last_clean":"2024-03-20T13:38:42.630318+0000","last_became_active":"2024-03-20T13:36:44.887981+0000","last_became_peered":"2024-03-20T13:36:44.887981+0000","last_unstale":"2024-03-20T13:38:42.630318+0000","last_undegraded":"2024-03-20T13:38:42.630318+0000","last_fullsized":"2024-03-20T13:38:42.630318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:42.630032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:42.630032+0000","last_clean_scrub_stamp":"2024-03-20T13:38:42.630032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:35.899389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:31.452477+0000","last_change":"2024-03-20T13:39:31.452592+0000","last_active":"2024-03-20T13:39:31.452477+0000","last_peered":"2024-03-20T13:39:31.452477+0000","last_clean":"2024-03-20T13:39:31.452477+0000","last_became_active":"2024-03-20T13:36:46.885300+0000","last_became_peered":"2024-03-20T13:36:46.885300+0000","last_unstale":"2024-03-20T13:39:31.452477+0000","last_undegraded":"2024-03-20T13:39:31.452477+0000","last_fullsized":"2024-03-20T13:39:31.452477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:31.452213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:31.452213+0000","last_clean_scrub_stamp":"2024-03-20T13:39:31.452213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:49.405704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.508391+0000","last_change":"2024-03-20T13:38:56.508391+0000","last_active":"2024-03-20T13:38:56.508391+0000","last_peered":"2024-03-20T13:38:56.508391+0000","last_clean":"2024-03-20T13:38:56.508391+0000","last_became_active":"2024-03-20T13:36:38.833831+0000","last_became_peered":"2024-03-20T13:36:38.833831+0000","last_unstale":"2024-03-20T13:38:56.508391+0000","last_undegraded":"2024-03-20T13:38:56.508391+0000","last_fullsized":"2024-03-20T13:38:56.508391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:56.508131+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:56.508131+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.508131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:42.709535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:15.744850+0000","last_change":"2024-03-20T13:39:15.744910+0000","last_active":"2024-03-20T13:39:15.744850+0000","last_peered":"2024-03-20T13:39:15.744850+0000","last_clean":"2024-03-20T13:39:15.744850+0000","last_became_active":"2024-03-20T13:36:36.829160+0000","last_became_peered":"2024-03-20T13:36:36.829160+0000","last_unstale":"2024-03-20T13:39:15.744850+0000","last_undegraded":"2024-03-20T13:39:15.744850+0000","last_fullsized":"2024-03-20T13:39:15.744850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:15.744631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:15.744631+0000","last_clean_scrub_stamp":"2024-03-20T13:39:15.744631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:48:45.057395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:29.618082+0000","last_change":"2024-03-20T13:38:29.618082+0000","last_active":"2024-03-20T13:38:29.618082+0000","last_peered":"2024-03-20T13:38:29.618082+0000","last_clean":"2024-03-20T13:38:29.618082+0000","last_became_active":"2024-03-20T13:36:40.851526+0000","last_became_peered":"2024-03-20T13:36:40.851526+0000","last_unstale":"2024-03-20T13:38:29.618082+0000","last_undegraded":"2024-03-20T13:38:29.618082+0000","last_fullsized":"2024-03-20T13:38:29.618082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:29.617842+0000","last_clean_scrub_stamp":"2024-03-20T13:38:29.617842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:45.496036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.357181+0000","last_change":"2024-03-20T13:38:44.357181+0000","last_active":"2024-03-20T13:38:44.357181+0000","last_peered":"2024-03-20T13:38:44.357181+0000","last_clean":"2024-03-20T13:38:44.357181+0000","last_became_active":"2024-03-20T13:36:42.859637+0000","last_became_peered":"2024-03-20T13:36:42.859637+0000","last_unstale":"2024-03-20T13:38:44.357181+0000","last_undegraded":"2024-03-20T13:38:44.357181+0000","last_fullsized":"2024-03-20T13:38:44.357181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:44.356772+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:44.356772+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.356772+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:34.210460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.530157+0000","last_change":"2024-03-20T13:38:32.530157+0000","last_active":"2024-03-20T13:38:32.530157+0000","last_peered":"2024-03-20T13:38:32.530157+0000","last_clean":"2024-03-20T13:38:32.530157+0000","last_became_active":"2024-03-20T13:36:44.862293+0000","last_became_peered":"2024-03-20T13:36:44.862293+0000","last_unstale":"2024-03-20T13:38:32.530157+0000","last_undegraded":"2024-03-20T13:38:32.530157+0000","last_fullsized":"2024-03-20T13:38:32.530157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.529912+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.529912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:23:06.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:56.323124+0000","last_change":"2024-03-20T13:38:56.323183+0000","last_active":"2024-03-20T13:38:56.323124+0000","last_peered":"2024-03-20T13:38:56.323124+0000","last_clean":"2024-03-20T13:38:56.323124+0000","last_became_active":"2024-03-20T13:36:38.831144+0000","last_became_peered":"2024-03-20T13:36:38.831144+0000","last_unstale":"2024-03-20T13:38:56.323124+0000","last_undegraded":"2024-03-20T13:38:56.323124+0000","last_fullsized":"2024-03-20T13:38:56.323124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:56.322921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:56.322921+0000","last_clean_scrub_stamp":"2024-03-20T13:38:56.322921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:17.280083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:24.464739+0000","last_change":"2024-03-20T13:39:24.464798+0000","last_active":"2024-03-20T13:39:24.464739+0000","last_peered":"2024-03-20T13:39:24.464739+0000","last_clean":"2024-03-20T13:39:24.464739+0000","last_became_active":"2024-03-20T13:36:36.839802+0000","last_became_peered":"2024-03-20T13:36:36.839802+0000","last_unstale":"2024-03-20T13:39:24.464739+0000","last_undegraded":"2024-03-20T13:39:24.464739+0000","last_fullsized":"2024-03-20T13:39:24.464739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:24.464548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:24.464548+0000","last_clean_scrub_stamp":"2024-03-20T13:39:24.464548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:11.466649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.624003+0000","last_change":"2024-03-20T13:38:23.624003+0000","last_active":"2024-03-20T13:38:23.624003+0000","last_peered":"2024-03-20T13:38:23.624003+0000","last_clean":"2024-03-20T13:38:23.624003+0000","last_became_active":"2024-03-20T13:36:40.852935+0000","last_became_peered":"2024-03-20T13:36:40.852935+0000","last_unstale":"2024-03-20T13:38:23.624003+0000","last_undegraded":"2024-03-20T13:38:23.624003+0000","last_fullsized":"2024-03-20T13:38:23.624003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:23.623665+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.623665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:46.378711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"34'59","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.584099+0000","last_change":"2024-03-20T13:38:28.584099+0000","last_active":"2024-03-20T13:38:28.584099+0000","last_peered":"2024-03-20T13:38:28.584099+0000","last_clean":"2024-03-20T13:38:28.584099+0000","last_became_active":"2024-03-20T13:37:17.368138+0000","last_became_peered":"2024-03-20T13:37:17.368138+0000","last_unstale":"2024-03-20T13:38:28.584099+0000","last_undegraded":"2024-03-20T13:38:28.584099+0000","last_fullsized":"2024-03-20T13:38:28.584099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'59","last_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_deep_scrub":"34'59","last_deep_scrub_stamp":"2024-03-20T13:38:28.583677+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.583677+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:50:25.438865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.554904+0000","last_change":"2024-03-20T13:38:28.554904+0000","last_active":"2024-03-20T13:38:28.554904+0000","last_peered":"2024-03-20T13:38:28.554904+0000","last_clean":"2024-03-20T13:38:28.554904+0000","last_became_active":"2024-03-20T13:36:44.873181+0000","last_became_peered":"2024-03-20T13:36:44.873181+0000","last_unstale":"2024-03-20T13:38:28.554904+0000","last_undegraded":"2024-03-20T13:38:28.554904+0000","last_fullsized":"2024-03-20T13:38:28.554904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:28.554662+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.554662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:18.277488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'12","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:32.463574+0000","last_change":"2024-03-20T13:39:32.463711+0000","last_active":"2024-03-20T13:39:32.463574+0000","last_peered":"2024-03-20T13:39:32.463574+0000","last_clean":"2024-03-20T13:39:32.463574+0000","last_became_active":"2024-03-20T13:36:46.891066+0000","last_became_peered":"2024-03-20T13:36:46.891066+0000","last_unstale":"2024-03-20T13:39:32.463574+0000","last_undegraded":"2024-03-20T13:39:32.463574+0000","last_fullsized":"2024-03-20T13:39:32.463574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-03-20T13:39:32.463350+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-03-20T13:39:32.463350+0000","last_clean_scrub_stamp":"2024-03-20T13:39:32.463350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:18.888093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.755964+0000","last_change":"2024-03-20T13:39:08.756024+0000","last_active":"2024-03-20T13:39:08.755964+0000","last_peered":"2024-03-20T13:39:08.755964+0000","last_clean":"2024-03-20T13:39:08.755964+0000","last_became_active":"2024-03-20T13:36:38.833617+0000","last_became_peered":"2024-03-20T13:36:38.833617+0000","last_unstale":"2024-03-20T13:39:08.755964+0000","last_undegraded":"2024-03-20T13:39:08.755964+0000","last_fullsized":"2024-03-20T13:39:08.755964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:08.755785+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:08.755785+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.755785+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:53.949890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:05.727726+0000","last_change":"2024-03-20T13:39:05.727790+0000","last_active":"2024-03-20T13:39:05.727726+0000","last_peered":"2024-03-20T13:39:05.727726+0000","last_clean":"2024-03-20T13:39:05.727726+0000","last_became_active":"2024-03-20T13:36:36.832908+0000","last_became_peered":"2024-03-20T13:36:36.832908+0000","last_unstale":"2024-03-20T13:39:05.727726+0000","last_undegraded":"2024-03-20T13:39:05.727726+0000","last_fullsized":"2024-03-20T13:39:05.727726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:05.727514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:05.727514+0000","last_clean_scrub_stamp":"2024-03-20T13:39:05.727514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:38.042586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:32.382567+0000","last_change":"2024-03-20T13:38:32.382567+0000","last_active":"2024-03-20T13:38:32.382567+0000","last_peered":"2024-03-20T13:38:32.382567+0000","last_clean":"2024-03-20T13:38:32.382567+0000","last_became_active":"2024-03-20T13:36:40.840103+0000","last_became_peered":"2024-03-20T13:36:40.840103+0000","last_unstale":"2024-03-20T13:38:32.382567+0000","last_undegraded":"2024-03-20T13:38:32.382567+0000","last_fullsized":"2024-03-20T13:38:32.382567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:32.382310+0000","last_clean_scrub_stamp":"2024-03-20T13:38:32.382310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:43.990067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.283141+0000","last_change":"2024-03-20T13:38:40.283141+0000","last_active":"2024-03-20T13:38:40.283141+0000","last_peered":"2024-03-20T13:38:40.283141+0000","last_clean":"2024-03-20T13:38:40.283141+0000","last_became_active":"2024-03-20T13:36:42.860065+0000","last_became_peered":"2024-03-20T13:36:42.860065+0000","last_unstale":"2024-03-20T13:38:40.283141+0000","last_undegraded":"2024-03-20T13:38:40.283141+0000","last_fullsized":"2024-03-20T13:38:40.283141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:40.282858+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.282858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:43:36.602180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:34.518505+0000","last_change":"2024-03-20T13:38:34.518505+0000","last_active":"2024-03-20T13:38:34.518505+0000","last_peered":"2024-03-20T13:38:34.518505+0000","last_clean":"2024-03-20T13:38:34.518505+0000","last_became_active":"2024-03-20T13:36:44.879943+0000","last_became_peered":"2024-03-20T13:36:44.879943+0000","last_unstale":"2024-03-20T13:38:34.518505+0000","last_undegraded":"2024-03-20T13:38:34.518505+0000","last_fullsized":"2024-03-20T13:38:34.518505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:34.518208+0000","last_clean_scrub_stamp":"2024-03-20T13:38:34.518208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:09.209953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:37.412982+0000","last_change":"2024-03-20T13:39:37.413046+0000","last_active":"2024-03-20T13:39:37.412982+0000","last_peered":"2024-03-20T13:39:37.412982+0000","last_clean":"2024-03-20T13:39:37.412982+0000","last_became_active":"2024-03-20T13:36:46.888868+0000","last_became_peered":"2024-03-20T13:36:46.888868+0000","last_unstale":"2024-03-20T13:39:37.412982+0000","last_undegraded":"2024-03-20T13:39:37.412982+0000","last_fullsized":"2024-03-20T13:39:37.412982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:37.412794+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:37.412794+0000","last_clean_scrub_stamp":"2024-03-20T13:39:37.412794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:05:11.563413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.514149+0000","last_change":"2024-03-20T13:38:49.514149+0000","last_active":"2024-03-20T13:38:49.514149+0000","last_peered":"2024-03-20T13:38:49.514149+0000","last_clean":"2024-03-20T13:38:49.514149+0000","last_became_active":"2024-03-20T13:36:38.837570+0000","last_became_peered":"2024-03-20T13:36:38.837570+0000","last_unstale":"2024-03-20T13:38:49.514149+0000","last_undegraded":"2024-03-20T13:38:49.514149+0000","last_fullsized":"2024-03-20T13:38:49.514149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:38:49.513894+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:38:49.513894+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.513894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:37:53.473877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.290698+0000","last_change":"2024-03-20T13:39:09.290698+0000","last_active":"2024-03-20T13:39:09.290698+0000","last_peered":"2024-03-20T13:39:09.290698+0000","last_clean":"2024-03-20T13:39:09.290698+0000","last_became_active":"2024-03-20T13:36:36.829351+0000","last_became_peered":"2024-03-20T13:36:36.829351+0000","last_unstale":"2024-03-20T13:39:09.290698+0000","last_undegraded":"2024-03-20T13:39:09.290698+0000","last_fullsized":"2024-03-20T13:39:09.290698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:09.290434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:09.290434+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.290434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:15.762675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:22.419777+0000","last_change":"2024-03-20T13:38:22.419777+0000","last_active":"2024-03-20T13:38:22.419777+0000","last_peered":"2024-03-20T13:38:22.419777+0000","last_clean":"2024-03-20T13:38:22.419777+0000","last_became_active":"2024-03-20T13:36:40.858783+0000","last_became_peered":"2024-03-20T13:36:40.858783+0000","last_unstale":"2024-03-20T13:38:22.419777+0000","last_undegraded":"2024-03-20T13:38:22.419777+0000","last_fullsized":"2024-03-20T13:38:22.419777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:22.419651+0000","last_clean_scrub_stamp":"2024-03-20T13:38:22.419651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:07:45.953043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.566628+0000","last_change":"2024-03-20T13:38:44.566628+0000","last_active":"2024-03-20T13:38:44.566628+0000","last_peered":"2024-03-20T13:38:44.566628+0000","last_clean":"2024-03-20T13:38:44.566628+0000","last_became_active":"2024-03-20T13:36:42.851697+0000","last_became_peered":"2024-03-20T13:36:42.851697+0000","last_unstale":"2024-03-20T13:38:44.566628+0000","last_undegraded":"2024-03-20T13:38:44.566628+0000","last_fullsized":"2024-03-20T13:38:44.566628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-03-20T13:38:44.566362+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-03-20T13:38:44.566362+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.566362+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:01.080651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:38.540382+0000","last_change":"2024-03-20T13:38:38.540382+0000","last_active":"2024-03-20T13:38:38.540382+0000","last_peered":"2024-03-20T13:38:38.540382+0000","last_clean":"2024-03-20T13:38:38.540382+0000","last_became_active":"2024-03-20T13:36:44.879823+0000","last_became_peered":"2024-03-20T13:36:44.879823+0000","last_unstale":"2024-03-20T13:38:38.540382+0000","last_undegraded":"2024-03-20T13:38:38.540382+0000","last_fullsized":"2024-03-20T13:38:38.540382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:38.540096+0000","last_clean_scrub_stamp":"2024-03-20T13:38:38.540096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:29:14.710303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:36.415820+0000","last_change":"2024-03-20T13:39:36.415925+0000","last_active":"2024-03-20T13:39:36.415820+0000","last_peered":"2024-03-20T13:39:36.415820+0000","last_clean":"2024-03-20T13:39:36.415820+0000","last_became_active":"2024-03-20T13:36:46.879790+0000","last_became_peered":"2024-03-20T13:36:46.879790+0000","last_unstale":"2024-03-20T13:39:36.415820+0000","last_undegraded":"2024-03-20T13:39:36.415820+0000","last_fullsized":"2024-03-20T13:39:36.415820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:36.415595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:36.415595+0000","last_clean_scrub_stamp":"2024-03-20T13:39:36.415595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:46:10.573349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.833581+0000","last_change":"2024-03-20T13:38:48.833581+0000","last_active":"2024-03-20T13:38:48.833581+0000","last_peered":"2024-03-20T13:38:48.833581+0000","last_clean":"2024-03-20T13:38:48.833581+0000","last_became_active":"2024-03-20T13:36:38.840570+0000","last_became_peered":"2024-03-20T13:36:38.840570+0000","last_unstale":"2024-03-20T13:38:48.833581+0000","last_undegraded":"2024-03-20T13:38:48.833581+0000","last_fullsized":"2024-03-20T13:38:48.833581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:48.833308+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:48.833308+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.833308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:42.905473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:22.450122+0000","last_change":"2024-03-20T13:39:22.450183+0000","last_active":"2024-03-20T13:39:22.450122+0000","last_peered":"2024-03-20T13:39:22.450122+0000","last_clean":"2024-03-20T13:39:22.450122+0000","last_became_active":"2024-03-20T13:36:36.840646+0000","last_became_peered":"2024-03-20T13:36:36.840646+0000","last_unstale":"2024-03-20T13:39:22.450122+0000","last_undegraded":"2024-03-20T13:39:22.450122+0000","last_fullsized":"2024-03-20T13:39:22.450122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:22.449927+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:22.449927+0000","last_clean_scrub_stamp":"2024-03-20T13:39:22.449927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:40.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.664389+0000","last_change":"2024-03-20T13:38:41.664389+0000","last_active":"2024-03-20T13:38:41.664389+0000","last_peered":"2024-03-20T13:38:41.664389+0000","last_clean":"2024-03-20T13:38:41.664389+0000","last_became_active":"2024-03-20T13:36:40.846151+0000","last_became_peered":"2024-03-20T13:36:40.846151+0000","last_unstale":"2024-03-20T13:38:41.664389+0000","last_undegraded":"2024-03-20T13:38:41.664389+0000","last_fullsized":"2024-03-20T13:38:41.664389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:41.664105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:41.664105+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.664105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:34:12.132470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:25.687890+0000","last_change":"2024-03-20T13:38:25.687890+0000","last_active":"2024-03-20T13:38:25.687890+0000","last_peered":"2024-03-20T13:38:25.687890+0000","last_clean":"2024-03-20T13:38:25.687890+0000","last_became_active":"2024-03-20T13:36:42.845543+0000","last_became_peered":"2024-03-20T13:36:42.845543+0000","last_unstale":"2024-03-20T13:38:25.687890+0000","last_undegraded":"2024-03-20T13:38:25.687890+0000","last_fullsized":"2024-03-20T13:38:25.687890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-03-20T13:38:25.687477+0000","last_clean_scrub_stamp":"2024-03-20T13:38:25.687477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.537657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'244","reported_seq":318,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.369936+0000","last_change":"2024-03-20T13:38:49.369936+0000","last_active":"2024-03-20T13:38:49.369936+0000","last_peered":"2024-03-20T13:38:49.369936+0000","last_clean":"2024-03-20T13:38:49.369936+0000","last_became_active":"2024-03-20T13:36:44.870106+0000","last_became_peered":"2024-03-20T13:36:44.870106+0000","last_unstale":"2024-03-20T13:38:49.369936+0000","last_undegraded":"2024-03-20T13:38:49.369936+0000","last_fullsized":"2024-03-20T13:38:49.369936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'244","last_scrub_stamp":"2024-03-20T13:38:49.369673+0000","last_deep_scrub":"34'244","last_deep_scrub_stamp":"2024-03-20T13:38:49.369673+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.369673+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:42:52.765055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:38.437067+0000","last_change":"2024-03-20T13:39:38.437142+0000","last_active":"2024-03-20T13:39:38.437067+0000","last_peered":"2024-03-20T13:39:38.437067+0000","last_clean":"2024-03-20T13:39:38.437067+0000","last_became_active":"2024-03-20T13:36:46.889777+0000","last_became_peered":"2024-03-20T13:36:46.889777+0000","last_unstale":"2024-03-20T13:39:38.437067+0000","last_undegraded":"2024-03-20T13:39:38.437067+0000","last_fullsized":"2024-03-20T13:39:38.437067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:38.436872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:38.436872+0000","last_clean_scrub_stamp":"2024-03-20T13:39:38.436872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:10:05.487529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:44.746741+0000","last_change":"2024-03-20T13:38:44.746741+0000","last_active":"2024-03-20T13:38:44.746741+0000","last_peered":"2024-03-20T13:38:44.746741+0000","last_clean":"2024-03-20T13:38:44.746741+0000","last_became_active":"2024-03-20T13:36:38.838370+0000","last_became_peered":"2024-03-20T13:36:38.838370+0000","last_unstale":"2024-03-20T13:38:44.746741+0000","last_undegraded":"2024-03-20T13:38:44.746741+0000","last_fullsized":"2024-03-20T13:38:44.746741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:44.746483+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:44.746483+0000","last_clean_scrub_stamp":"2024-03-20T13:38:44.746483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:10:06.855881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.735541+0000","last_change":"2024-03-20T13:38:59.735541+0000","last_active":"2024-03-20T13:38:59.735541+0000","last_peered":"2024-03-20T13:38:59.735541+0000","last_clean":"2024-03-20T13:38:59.735541+0000","last_became_active":"2024-03-20T13:36:36.847209+0000","last_became_peered":"2024-03-20T13:36:36.847209+0000","last_unstale":"2024-03-20T13:38:59.735541+0000","last_undegraded":"2024-03-20T13:38:59.735541+0000","last_fullsized":"2024-03-20T13:38:59.735541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.735288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.735288+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.735288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:00:05.162580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'2","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:36.525470+0000","last_change":"2024-03-20T13:38:36.525470+0000","last_active":"2024-03-20T13:38:36.525470+0000","last_peered":"2024-03-20T13:38:36.525470+0000","last_clean":"2024-03-20T13:38:36.525470+0000","last_became_active":"2024-03-20T13:36:40.848045+0000","last_became_peered":"2024-03-20T13:36:40.848045+0000","last_unstale":"2024-03-20T13:38:36.525470+0000","last_undegraded":"2024-03-20T13:38:36.525470+0000","last_fullsized":"2024-03-20T13:38:36.525470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:36.525211+0000","last_clean_scrub_stamp":"2024-03-20T13:38:36.525211+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:48:52.542790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'43","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.359327+0000","last_change":"2024-03-20T13:38:35.359327+0000","last_active":"2024-03-20T13:38:35.359327+0000","last_peered":"2024-03-20T13:38:35.359327+0000","last_clean":"2024-03-20T13:38:35.359327+0000","last_became_active":"2024-03-20T13:36:42.875935+0000","last_became_peered":"2024-03-20T13:36:42.875935+0000","last_unstale":"2024-03-20T13:38:35.359327+0000","last_undegraded":"2024-03-20T13:38:35.359327+0000","last_fullsized":"2024-03-20T13:38:35.359327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-03-20T13:38:35.359044+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.359044+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:38.277772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.612986+0000","last_change":"2024-03-20T13:38:37.612986+0000","last_active":"2024-03-20T13:38:37.612986+0000","last_peered":"2024-03-20T13:38:37.612986+0000","last_clean":"2024-03-20T13:38:37.612986+0000","last_became_active":"2024-03-20T13:36:44.880001+0000","last_became_peered":"2024-03-20T13:36:44.880001+0000","last_unstale":"2024-03-20T13:38:37.612986+0000","last_undegraded":"2024-03-20T13:38:37.612986+0000","last_fullsized":"2024-03-20T13:38:37.612986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.612746+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.612746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:43.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:34.362757+0000","last_change":"2024-03-20T13:39:34.362814+0000","last_active":"2024-03-20T13:39:34.362757+0000","last_peered":"2024-03-20T13:39:34.362757+0000","last_clean":"2024-03-20T13:39:34.362757+0000","last_became_active":"2024-03-20T13:36:46.879883+0000","last_became_peered":"2024-03-20T13:36:46.879883+0000","last_unstale":"2024-03-20T13:39:34.362757+0000","last_undegraded":"2024-03-20T13:39:34.362757+0000","last_fullsized":"2024-03-20T13:39:34.362757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:34.362587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:34.362587+0000","last_clean_scrub_stamp":"2024-03-20T13:39:34.362587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:11.351777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:04.346364+0000","last_change":"2024-03-20T13:39:04.346364+0000","last_active":"2024-03-20T13:39:04.346364+0000","last_peered":"2024-03-20T13:39:04.346364+0000","last_clean":"2024-03-20T13:39:04.346364+0000","last_became_active":"2024-03-20T13:36:38.826223+0000","last_became_peered":"2024-03-20T13:36:38.826223+0000","last_unstale":"2024-03-20T13:39:04.346364+0000","last_undegraded":"2024-03-20T13:39:04.346364+0000","last_fullsized":"2024-03-20T13:39:04.346364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:04.346110+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:04.346110+0000","last_clean_scrub_stamp":"2024-03-20T13:39:04.346110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:59:39.692731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:13.378455+0000","last_change":"2024-03-20T13:39:13.378513+0000","last_active":"2024-03-20T13:39:13.378455+0000","last_peered":"2024-03-20T13:39:13.378455+0000","last_clean":"2024-03-20T13:39:13.378455+0000","last_became_active":"2024-03-20T13:36:36.832941+0000","last_became_peered":"2024-03-20T13:36:36.832941+0000","last_unstale":"2024-03-20T13:39:13.378455+0000","last_undegraded":"2024-03-20T13:39:13.378455+0000","last_fullsized":"2024-03-20T13:39:13.378455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:13.378252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:13.378252+0000","last_clean_scrub_stamp":"2024-03-20T13:39:13.378252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:29.653038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'5","reported_seq":211,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:28.392546+0000","last_change":"2024-03-20T13:38:28.392546+0000","last_active":"2024-03-20T13:38:28.392546+0000","last_peered":"2024-03-20T13:38:28.392546+0000","last_clean":"2024-03-20T13:38:28.392546+0000","last_became_active":"2024-03-20T13:36:40.851123+0000","last_became_peered":"2024-03-20T13:36:40.851123+0000","last_unstale":"2024-03-20T13:38:28.392546+0000","last_undegraded":"2024-03-20T13:38:28.392546+0000","last_fullsized":"2024-03-20T13:38:28.392546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-03-20T13:38:28.392293+0000","last_clean_scrub_stamp":"2024-03-20T13:38:28.392293+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:18.200294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:33.510699+0000","last_change":"2024-03-20T13:38:33.510699+0000","last_active":"2024-03-20T13:38:33.510699+0000","last_peered":"2024-03-20T13:38:33.510699+0000","last_clean":"2024-03-20T13:38:33.510699+0000","last_became_active":"2024-03-20T13:36:42.862400+0000","last_became_peered":"2024-03-20T13:36:42.862400+0000","last_unstale":"2024-03-20T13:38:33.510699+0000","last_undegraded":"2024-03-20T13:38:33.510699+0000","last_fullsized":"2024-03-20T13:38:33.510699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-03-20T13:38:33.510425+0000","last_clean_scrub_stamp":"2024-03-20T13:38:33.510425+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:36.604731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.298312+0000","last_change":"2024-03-20T13:38:37.298312+0000","last_active":"2024-03-20T13:38:37.298312+0000","last_peered":"2024-03-20T13:38:37.298312+0000","last_clean":"2024-03-20T13:38:37.298312+0000","last_became_active":"2024-03-20T13:36:44.868913+0000","last_became_peered":"2024-03-20T13:36:44.868913+0000","last_unstale":"2024-03-20T13:38:37.298312+0000","last_undegraded":"2024-03-20T13:38:37.298312+0000","last_fullsized":"2024-03-20T13:38:37.298312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.297989+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.297989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:19.272096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:35.425938+0000","last_change":"2024-03-20T13:39:35.425999+0000","last_active":"2024-03-20T13:39:35.425938+0000","last_peered":"2024-03-20T13:39:35.425938+0000","last_clean":"2024-03-20T13:39:35.425938+0000","last_became_active":"2024-03-20T13:36:46.896180+0000","last_became_peered":"2024-03-20T13:36:46.896180+0000","last_unstale":"2024-03-20T13:39:35.425938+0000","last_undegraded":"2024-03-20T13:39:35.425938+0000","last_fullsized":"2024-03-20T13:39:35.425938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:35.425750+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:35.425750+0000","last_clean_scrub_stamp":"2024-03-20T13:39:35.425750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:44:07.108341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.497062+0000","last_change":"2024-03-20T13:39:01.497062+0000","last_active":"2024-03-20T13:39:01.497062+0000","last_peered":"2024-03-20T13:39:01.497062+0000","last_clean":"2024-03-20T13:39:01.497062+0000","last_became_active":"2024-03-20T13:36:38.825720+0000","last_became_peered":"2024-03-20T13:36:38.825720+0000","last_unstale":"2024-03-20T13:39:01.497062+0000","last_undegraded":"2024-03-20T13:39:01.497062+0000","last_fullsized":"2024-03-20T13:39:01.497062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:39:01.496800+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:39:01.496800+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.496800+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:34:29.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:07.452007+0000","last_change":"2024-03-20T13:39:07.452063+0000","last_active":"2024-03-20T13:39:07.452007+0000","last_peered":"2024-03-20T13:39:07.452007+0000","last_clean":"2024-03-20T13:39:07.452007+0000","last_became_active":"2024-03-20T13:36:36.844139+0000","last_became_peered":"2024-03-20T13:36:36.844139+0000","last_unstale":"2024-03-20T13:39:07.452007+0000","last_undegraded":"2024-03-20T13:39:07.452007+0000","last_fullsized":"2024-03-20T13:39:07.452007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:07.451818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:07.451818+0000","last_clean_scrub_stamp":"2024-03-20T13:39:07.451818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:11:49.069638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:37.568554+0000","last_change":"2024-03-20T13:38:37.568554+0000","last_active":"2024-03-20T13:38:37.568554+0000","last_peered":"2024-03-20T13:38:37.568554+0000","last_clean":"2024-03-20T13:38:37.568554+0000","last_became_active":"2024-03-20T13:36:40.850780+0000","last_became_peered":"2024-03-20T13:36:40.850780+0000","last_unstale":"2024-03-20T13:38:37.568554+0000","last_undegraded":"2024-03-20T13:38:37.568554+0000","last_fullsized":"2024-03-20T13:38:37.568554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:37.568192+0000","last_clean_scrub_stamp":"2024-03-20T13:38:37.568192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:02:40.953434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:23.672659+0000","last_change":"2024-03-20T13:38:23.672659+0000","last_active":"2024-03-20T13:38:23.672659+0000","last_peered":"2024-03-20T13:38:23.672659+0000","last_clean":"2024-03-20T13:38:23.672659+0000","last_became_active":"2024-03-20T13:36:42.843634+0000","last_became_peered":"2024-03-20T13:36:42.843634+0000","last_unstale":"2024-03-20T13:38:23.672659+0000","last_undegraded":"2024-03-20T13:38:23.672659+0000","last_fullsized":"2024-03-20T13:38:23.672659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-03-20T13:38:23.672372+0000","last_clean_scrub_stamp":"2024-03-20T13:38:23.672372+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:19.543310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.372209+0000","last_change":"2024-03-20T13:38:57.372209+0000","last_active":"2024-03-20T13:38:57.372209+0000","last_peered":"2024-03-20T13:38:57.372209+0000","last_clean":"2024-03-20T13:38:57.372209+0000","last_became_active":"2024-03-20T13:36:44.870580+0000","last_became_peered":"2024-03-20T13:36:44.870580+0000","last_unstale":"2024-03-20T13:38:57.372209+0000","last_undegraded":"2024-03-20T13:38:57.372209+0000","last_fullsized":"2024-03-20T13:38:57.372209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:57.371958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:57.371958+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.371958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:11:49.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:33.418812+0000","last_change":"2024-03-20T13:39:33.418878+0000","last_active":"2024-03-20T13:39:33.418812+0000","last_peered":"2024-03-20T13:39:33.418812+0000","last_clean":"2024-03-20T13:39:33.418812+0000","last_became_active":"2024-03-20T13:36:46.894902+0000","last_became_peered":"2024-03-20T13:36:46.894902+0000","last_unstale":"2024-03-20T13:39:33.418812+0000","last_undegraded":"2024-03-20T13:39:33.418812+0000","last_fullsized":"2024-03-20T13:39:33.418812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:33.418621+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:33.418621+0000","last_clean_scrub_stamp":"2024-03-20T13:39:33.418621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:38.721719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'18","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:48.374114+0000","last_change":"2024-03-20T13:38:48.374114+0000","last_active":"2024-03-20T13:38:48.374114+0000","last_peered":"2024-03-20T13:38:48.374114+0000","last_clean":"2024-03-20T13:38:48.374114+0000","last_became_active":"2024-03-20T13:36:38.841996+0000","last_became_peered":"2024-03-20T13:36:38.841996+0000","last_unstale":"2024-03-20T13:38:48.374114+0000","last_undegraded":"2024-03-20T13:38:48.374114+0000","last_fullsized":"2024-03-20T13:38:48.374114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-03-20T13:38:48.373835+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-03-20T13:38:48.373835+0000","last_clean_scrub_stamp":"2024-03-20T13:38:48.373835+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:21:02.963289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.787714+0000","last_change":"2024-03-20T13:39:09.787770+0000","last_active":"2024-03-20T13:39:09.787714+0000","last_peered":"2024-03-20T13:39:09.787714+0000","last_clean":"2024-03-20T13:39:09.787714+0000","last_became_active":"2024-03-20T13:36:36.831773+0000","last_became_peered":"2024-03-20T13:36:36.831773+0000","last_unstale":"2024-03-20T13:39:09.787714+0000","last_undegraded":"2024-03-20T13:39:09.787714+0000","last_fullsized":"2024-03-20T13:39:09.787714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:09.787528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:09.787528+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.787528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:47:15.649724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:35.505456+0000","last_change":"2024-03-20T13:38:35.505456+0000","last_active":"2024-03-20T13:38:35.505456+0000","last_peered":"2024-03-20T13:38:35.505456+0000","last_clean":"2024-03-20T13:38:35.505456+0000","last_became_active":"2024-03-20T13:36:40.857371+0000","last_became_peered":"2024-03-20T13:36:40.857371+0000","last_unstale":"2024-03-20T13:38:35.505456+0000","last_undegraded":"2024-03-20T13:38:35.505456+0000","last_fullsized":"2024-03-20T13:38:35.505456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-03-20T13:38:35.505077+0000","last_clean_scrub_stamp":"2024-03-20T13:38:35.505077+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:05:06.593833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:43.336933+0000","last_change":"2024-03-20T13:38:43.336933+0000","last_active":"2024-03-20T13:38:43.336933+0000","last_peered":"2024-03-20T13:38:43.336933+0000","last_clean":"2024-03-20T13:38:43.336933+0000","last_became_active":"2024-03-20T13:36:42.859764+0000","last_became_peered":"2024-03-20T13:36:42.859764+0000","last_unstale":"2024-03-20T13:38:43.336933+0000","last_undegraded":"2024-03-20T13:38:43.336933+0000","last_fullsized":"2024-03-20T13:38:43.336933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-03-20T13:38:43.336633+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-03-20T13:38:43.336633+0000","last_clean_scrub_stamp":"2024-03-20T13:38:43.336633+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:42:40.193080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:27.579425+0000","last_change":"2024-03-20T13:38:27.579425+0000","last_active":"2024-03-20T13:38:27.579425+0000","last_peered":"2024-03-20T13:38:27.579425+0000","last_clean":"2024-03-20T13:38:27.579425+0000","last_became_active":"2024-03-20T13:36:44.874580+0000","last_became_peered":"2024-03-20T13:36:44.874580+0000","last_unstale":"2024-03-20T13:38:27.579425+0000","last_undegraded":"2024-03-20T13:38:27.579425+0000","last_fullsized":"2024-03-20T13:38:27.579425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:27.579191+0000","last_clean_scrub_stamp":"2024-03-20T13:38:27.579191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:23:01.136809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:33.339837+0000","last_change":"2024-03-20T13:39:33.339897+0000","last_active":"2024-03-20T13:39:33.339837+0000","last_peered":"2024-03-20T13:39:33.339837+0000","last_clean":"2024-03-20T13:39:33.339837+0000","last_became_active":"2024-03-20T13:36:46.879590+0000","last_became_peered":"2024-03-20T13:36:46.879590+0000","last_unstale":"2024-03-20T13:39:33.339837+0000","last_undegraded":"2024-03-20T13:39:33.339837+0000","last_fullsized":"2024-03-20T13:39:33.339837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:33.339634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:33.339634+0000","last_clean_scrub_stamp":"2024-03-20T13:39:33.339634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:38.642732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.766679+0000","last_change":"2024-03-20T13:39:10.766737+0000","last_active":"2024-03-20T13:39:10.766679+0000","last_peered":"2024-03-20T13:39:10.766679+0000","last_clean":"2024-03-20T13:39:10.766679+0000","last_became_active":"2024-03-20T13:36:38.833900+0000","last_became_peered":"2024-03-20T13:36:38.833900+0000","last_unstale":"2024-03-20T13:39:10.766679+0000","last_undegraded":"2024-03-20T13:39:10.766679+0000","last_fullsized":"2024-03-20T13:39:10.766679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:10.766478+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:10.766478+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.766478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:50:15.671047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:59.643901+0000","last_change":"2024-03-20T13:38:59.643969+0000","last_active":"2024-03-20T13:38:59.643901+0000","last_peered":"2024-03-20T13:38:59.643901+0000","last_clean":"2024-03-20T13:38:59.643901+0000","last_became_active":"2024-03-20T13:36:36.812436+0000","last_became_peered":"2024-03-20T13:36:36.812436+0000","last_unstale":"2024-03-20T13:38:59.643901+0000","last_undegraded":"2024-03-20T13:38:59.643901+0000","last_fullsized":"2024-03-20T13:38:59.643901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:59.643704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:59.643704+0000","last_clean_scrub_stamp":"2024-03-20T13:38:59.643704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:06.857538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:51.599638+0000","last_change":"2024-03-20T13:38:51.599723+0000","last_active":"2024-03-20T13:38:51.599638+0000","last_peered":"2024-03-20T13:38:51.599638+0000","last_clean":"2024-03-20T13:38:51.599638+0000","last_became_active":"2024-03-20T13:36:38.838256+0000","last_became_peered":"2024-03-20T13:36:38.838256+0000","last_unstale":"2024-03-20T13:38:51.599638+0000","last_undegraded":"2024-03-20T13:38:51.599638+0000","last_fullsized":"2024-03-20T13:38:51.599638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:51.599437+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:51.599437+0000","last_clean_scrub_stamp":"2024-03-20T13:38:51.599437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:00:17.080484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:01.596554+0000","last_change":"2024-03-20T13:39:01.596627+0000","last_active":"2024-03-20T13:39:01.596554+0000","last_peered":"2024-03-20T13:39:01.596554+0000","last_clean":"2024-03-20T13:39:01.596554+0000","last_became_active":"2024-03-20T13:36:36.813180+0000","last_became_peered":"2024-03-20T13:36:36.813180+0000","last_unstale":"2024-03-20T13:39:01.596554+0000","last_undegraded":"2024-03-20T13:39:01.596554+0000","last_fullsized":"2024-03-20T13:39:01.596554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:01.596352+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:01.596352+0000","last_clean_scrub_stamp":"2024-03-20T13:39:01.596352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:25.375658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.344552+0000","last_change":"2024-03-20T13:38:52.344609+0000","last_active":"2024-03-20T13:38:52.344552+0000","last_peered":"2024-03-20T13:38:52.344552+0000","last_clean":"2024-03-20T13:38:52.344552+0000","last_became_active":"2024-03-20T13:36:38.836786+0000","last_became_peered":"2024-03-20T13:36:38.836786+0000","last_unstale":"2024-03-20T13:38:52.344552+0000","last_undegraded":"2024-03-20T13:38:52.344552+0000","last_fullsized":"2024-03-20T13:38:52.344552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:52.344358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:52.344358+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.344358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:21.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:15.411076+0000","last_change":"2024-03-20T13:39:15.411138+0000","last_active":"2024-03-20T13:39:15.411076+0000","last_peered":"2024-03-20T13:39:15.411076+0000","last_clean":"2024-03-20T13:39:15.411076+0000","last_became_active":"2024-03-20T13:36:36.850867+0000","last_became_peered":"2024-03-20T13:36:36.850867+0000","last_unstale":"2024-03-20T13:39:15.411076+0000","last_undegraded":"2024-03-20T13:39:15.411076+0000","last_fullsized":"2024-03-20T13:39:15.411076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:15.410878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:15.410878+0000","last_clean_scrub_stamp":"2024-03-20T13:39:15.410878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:58:22.162158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:47.564094+0000","last_change":"2024-03-20T13:38:47.564094+0000","last_active":"2024-03-20T13:38:47.564094+0000","last_peered":"2024-03-20T13:38:47.564094+0000","last_clean":"2024-03-20T13:38:47.564094+0000","last_became_active":"2024-03-20T13:36:38.838117+0000","last_became_peered":"2024-03-20T13:36:38.838117+0000","last_unstale":"2024-03-20T13:38:47.564094+0000","last_undegraded":"2024-03-20T13:38:47.564094+0000","last_fullsized":"2024-03-20T13:38:47.564094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:47.563835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:47.563835+0000","last_clean_scrub_stamp":"2024-03-20T13:38:47.563835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:59:16.361280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:57.663539+0000","last_change":"2024-03-20T13:38:57.663612+0000","last_active":"2024-03-20T13:38:57.663539+0000","last_peered":"2024-03-20T13:38:57.663539+0000","last_clean":"2024-03-20T13:38:57.663539+0000","last_became_active":"2024-03-20T13:36:36.811593+0000","last_became_peered":"2024-03-20T13:36:36.811593+0000","last_unstale":"2024-03-20T13:38:57.663539+0000","last_undegraded":"2024-03-20T13:38:57.663539+0000","last_fullsized":"2024-03-20T13:38:57.663539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:57.663332+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:57.663332+0000","last_clean_scrub_stamp":"2024-03-20T13:38:57.663332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:32:47.108625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:10.661208+0000","last_change":"2024-03-20T13:39:10.661208+0000","last_active":"2024-03-20T13:39:10.661208+0000","last_peered":"2024-03-20T13:39:10.661208+0000","last_clean":"2024-03-20T13:39:10.661208+0000","last_became_active":"2024-03-20T13:37:17.348420+0000","last_became_peered":"2024-03-20T13:37:17.348420+0000","last_unstale":"2024-03-20T13:39:10.661208+0000","last_undegraded":"2024-03-20T13:39:10.661208+0000","last_fullsized":"2024-03-20T13:39:10.661208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:10.660938+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:10.660938+0000","last_clean_scrub_stamp":"2024-03-20T13:39:10.660938+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:02:00.514626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:20.431918+0000","last_change":"2024-03-20T13:39:20.431986+0000","last_active":"2024-03-20T13:39:20.431918+0000","last_peered":"2024-03-20T13:39:20.431918+0000","last_clean":"2024-03-20T13:39:20.431918+0000","last_became_active":"2024-03-20T13:36:36.844392+0000","last_became_peered":"2024-03-20T13:36:36.844392+0000","last_unstale":"2024-03-20T13:39:20.431918+0000","last_undegraded":"2024-03-20T13:39:20.431918+0000","last_fullsized":"2024-03-20T13:39:20.431918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:20.431704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:20.431704+0000","last_clean_scrub_stamp":"2024-03-20T13:39:20.431704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:50:11.352075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.602517+0000","last_change":"2024-03-20T13:38:52.602578+0000","last_active":"2024-03-20T13:38:52.602517+0000","last_peered":"2024-03-20T13:38:52.602517+0000","last_clean":"2024-03-20T13:38:52.602517+0000","last_became_active":"2024-03-20T13:36:38.836980+0000","last_became_peered":"2024-03-20T13:36:38.836980+0000","last_unstale":"2024-03-20T13:38:52.602517+0000","last_undegraded":"2024-03-20T13:38:52.602517+0000","last_fullsized":"2024-03-20T13:38:52.602517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:52.602307+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.602307+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.602307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:59:45.472743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:17.724032+0000","last_change":"2024-03-20T13:39:17.724171+0000","last_active":"2024-03-20T13:39:17.724032+0000","last_peered":"2024-03-20T13:39:17.724032+0000","last_clean":"2024-03-20T13:39:17.724032+0000","last_became_active":"2024-03-20T13:36:36.830363+0000","last_became_peered":"2024-03-20T13:36:36.830363+0000","last_unstale":"2024-03-20T13:39:17.724032+0000","last_undegraded":"2024-03-20T13:39:17.724032+0000","last_fullsized":"2024-03-20T13:39:17.724032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:17.723757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:17.723757+0000","last_clean_scrub_stamp":"2024-03-20T13:39:17.723757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:00.930961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:52.433351+0000","last_change":"2024-03-20T13:38:52.433522+0000","last_active":"2024-03-20T13:38:52.433351+0000","last_peered":"2024-03-20T13:38:52.433351+0000","last_clean":"2024-03-20T13:38:52.433351+0000","last_became_active":"2024-03-20T13:36:38.835632+0000","last_became_peered":"2024-03-20T13:36:38.835632+0000","last_unstale":"2024-03-20T13:38:52.433351+0000","last_undegraded":"2024-03-20T13:38:52.433351+0000","last_fullsized":"2024-03-20T13:38:52.433351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:52.433131+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:52.433131+0000","last_clean_scrub_stamp":"2024-03-20T13:38:52.433131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:53:53.839074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:53.748399+0000","last_change":"2024-03-20T13:38:53.748455+0000","last_active":"2024-03-20T13:38:53.748399+0000","last_peered":"2024-03-20T13:38:53.748399+0000","last_clean":"2024-03-20T13:38:53.748399+0000","last_became_active":"2024-03-20T13:36:36.817998+0000","last_became_peered":"2024-03-20T13:36:36.817998+0000","last_unstale":"2024-03-20T13:38:53.748399+0000","last_undegraded":"2024-03-20T13:38:53.748399+0000","last_fullsized":"2024-03-20T13:38:53.748399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:53.748204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:53.748204+0000","last_clean_scrub_stamp":"2024-03-20T13:38:53.748204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:12:58.243259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.362506+0000","last_change":"2024-03-20T13:39:00.362567+0000","last_active":"2024-03-20T13:39:00.362506+0000","last_peered":"2024-03-20T13:39:00.362506+0000","last_clean":"2024-03-20T13:39:00.362506+0000","last_became_active":"2024-03-20T13:36:38.829587+0000","last_became_peered":"2024-03-20T13:36:38.829587+0000","last_unstale":"2024-03-20T13:39:00.362506+0000","last_undegraded":"2024-03-20T13:39:00.362506+0000","last_fullsized":"2024-03-20T13:39:00.362506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.362303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.362303+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.362303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:46.447885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:27.406317+0000","last_change":"2024-03-20T13:39:27.406385+0000","last_active":"2024-03-20T13:39:27.406317+0000","last_peered":"2024-03-20T13:39:27.406317+0000","last_clean":"2024-03-20T13:39:27.406317+0000","last_became_active":"2024-03-20T13:36:36.842555+0000","last_became_peered":"2024-03-20T13:36:36.842555+0000","last_unstale":"2024-03-20T13:39:27.406317+0000","last_undegraded":"2024-03-20T13:39:27.406317+0000","last_fullsized":"2024-03-20T13:39:27.406317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:27.406106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:27.406106+0000","last_clean_scrub_stamp":"2024-03-20T13:39:27.406106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:14:00.415117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:49.609193+0000","last_change":"2024-03-20T13:38:49.609193+0000","last_active":"2024-03-20T13:38:49.609193+0000","last_peered":"2024-03-20T13:38:49.609193+0000","last_clean":"2024-03-20T13:38:49.609193+0000","last_became_active":"2024-03-20T13:36:38.838725+0000","last_became_peered":"2024-03-20T13:36:38.838725+0000","last_unstale":"2024-03-20T13:38:49.609193+0000","last_undegraded":"2024-03-20T13:38:49.609193+0000","last_fullsized":"2024-03-20T13:38:49.609193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:38:49.608940+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:38:49.608940+0000","last_clean_scrub_stamp":"2024-03-20T13:38:49.608940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:56:54.242319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:28.431211+0000","last_change":"2024-03-20T13:39:28.431284+0000","last_active":"2024-03-20T13:39:28.431211+0000","last_peered":"2024-03-20T13:39:28.431211+0000","last_clean":"2024-03-20T13:39:28.431211+0000","last_became_active":"2024-03-20T13:36:36.840721+0000","last_became_peered":"2024-03-20T13:36:36.840721+0000","last_unstale":"2024-03-20T13:39:28.431211+0000","last_undegraded":"2024-03-20T13:39:28.431211+0000","last_fullsized":"2024-03-20T13:39:28.431211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:28.430987+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:28.430987+0000","last_clean_scrub_stamp":"2024-03-20T13:39:28.430987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:23:38.842541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:00.476851+0000","last_change":"2024-03-20T13:39:00.476851+0000","last_active":"2024-03-20T13:39:00.476851+0000","last_peered":"2024-03-20T13:39:00.476851+0000","last_clean":"2024-03-20T13:39:00.476851+0000","last_became_active":"2024-03-20T13:36:38.826452+0000","last_became_peered":"2024-03-20T13:36:38.826452+0000","last_unstale":"2024-03-20T13:39:00.476851+0000","last_undegraded":"2024-03-20T13:39:00.476851+0000","last_fullsized":"2024-03-20T13:39:00.476851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:00.476528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:00.476528+0000","last_clean_scrub_stamp":"2024-03-20T13:39:00.476528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:46.562110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.427599+0000","last_change":"2024-03-20T13:39:11.427656+0000","last_active":"2024-03-20T13:39:11.427599+0000","last_peered":"2024-03-20T13:39:11.427599+0000","last_clean":"2024-03-20T13:39:11.427599+0000","last_became_active":"2024-03-20T13:36:36.848479+0000","last_became_peered":"2024-03-20T13:36:36.848479+0000","last_unstale":"2024-03-20T13:39:11.427599+0000","last_undegraded":"2024-03-20T13:39:11.427599+0000","last_fullsized":"2024-03-20T13:39:11.427599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:11.427382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:11.427382+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.427382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.678738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:40.619511+0000","last_change":"2024-03-20T13:38:40.619511+0000","last_active":"2024-03-20T13:38:40.619511+0000","last_peered":"2024-03-20T13:38:40.619511+0000","last_clean":"2024-03-20T13:38:40.619511+0000","last_became_active":"2024-03-20T13:36:38.830283+0000","last_became_peered":"2024-03-20T13:36:38.830283+0000","last_unstale":"2024-03-20T13:38:40.619511+0000","last_undegraded":"2024-03-20T13:38:40.619511+0000","last_fullsized":"2024-03-20T13:38:40.619511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:38:40.619249+0000","last_clean_scrub_stamp":"2024-03-20T13:38:40.619249+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:16:28.069678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:12.372739+0000","last_change":"2024-03-20T13:39:12.372938+0000","last_active":"2024-03-20T13:39:12.372739+0000","last_peered":"2024-03-20T13:39:12.372739+0000","last_clean":"2024-03-20T13:39:12.372739+0000","last_became_active":"2024-03-20T13:36:36.826499+0000","last_became_peered":"2024-03-20T13:36:36.826499+0000","last_unstale":"2024-03-20T13:39:12.372739+0000","last_undegraded":"2024-03-20T13:39:12.372739+0000","last_fullsized":"2024-03-20T13:39:12.372739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:12.372507+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:12.372507+0000","last_clean_scrub_stamp":"2024-03-20T13:39:12.372507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:30:32.363210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:11.633297+0000","last_change":"2024-03-20T13:39:11.633297+0000","last_active":"2024-03-20T13:39:11.633297+0000","last_peered":"2024-03-20T13:39:11.633297+0000","last_clean":"2024-03-20T13:39:11.633297+0000","last_became_active":"2024-03-20T13:37:17.349783+0000","last_became_peered":"2024-03-20T13:37:17.349783+0000","last_unstale":"2024-03-20T13:39:11.633297+0000","last_undegraded":"2024-03-20T13:39:11.633297+0000","last_fullsized":"2024-03-20T13:39:11.633297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:11.633049+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:11.633049+0000","last_clean_scrub_stamp":"2024-03-20T13:39:11.633049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:25:51.655342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:19.765783+0000","last_change":"2024-03-20T13:39:19.765841+0000","last_active":"2024-03-20T13:39:19.765783+0000","last_peered":"2024-03-20T13:39:19.765783+0000","last_clean":"2024-03-20T13:39:19.765783+0000","last_became_active":"2024-03-20T13:36:36.831126+0000","last_became_peered":"2024-03-20T13:36:36.831126+0000","last_unstale":"2024-03-20T13:39:19.765783+0000","last_undegraded":"2024-03-20T13:39:19.765783+0000","last_fullsized":"2024-03-20T13:39:19.765783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:19.765555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:19.765555+0000","last_clean_scrub_stamp":"2024-03-20T13:39:19.765555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:09:03.411339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:02.387483+0000","last_change":"2024-03-20T13:39:02.387551+0000","last_active":"2024-03-20T13:39:02.387483+0000","last_peered":"2024-03-20T13:39:02.387483+0000","last_clean":"2024-03-20T13:39:02.387483+0000","last_became_active":"2024-03-20T13:36:38.828406+0000","last_became_peered":"2024-03-20T13:36:38.828406+0000","last_unstale":"2024-03-20T13:39:02.387483+0000","last_undegraded":"2024-03-20T13:39:02.387483+0000","last_fullsized":"2024-03-20T13:39:02.387483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-03-20T13:39:02.387285+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-03-20T13:39:02.387285+0000","last_clean_scrub_stamp":"2024-03-20T13:39:02.387285+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:34.213252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:26.424010+0000","last_change":"2024-03-20T13:39:26.424085+0000","last_active":"2024-03-20T13:39:26.424010+0000","last_peered":"2024-03-20T13:39:26.424010+0000","last_clean":"2024-03-20T13:39:26.424010+0000","last_became_active":"2024-03-20T13:36:36.842383+0000","last_became_peered":"2024-03-20T13:36:36.842383+0000","last_unstale":"2024-03-20T13:39:26.424010+0000","last_undegraded":"2024-03-20T13:39:26.424010+0000","last_fullsized":"2024-03-20T13:39:26.424010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:26.423798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:26.423798+0000","last_clean_scrub_stamp":"2024-03-20T13:39:26.423798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:06:01.752188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.595470+0000","last_change":"2024-03-20T13:39:08.595470+0000","last_active":"2024-03-20T13:39:08.595470+0000","last_peered":"2024-03-20T13:39:08.595470+0000","last_clean":"2024-03-20T13:39:08.595470+0000","last_became_active":"2024-03-20T13:37:17.353463+0000","last_became_peered":"2024-03-20T13:37:17.353463+0000","last_unstale":"2024-03-20T13:39:08.595470+0000","last_undegraded":"2024-03-20T13:39:08.595470+0000","last_fullsized":"2024-03-20T13:39:08.595470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:08.595078+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:08.595078+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.595078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:22:49.573330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:09.457481+0000","last_change":"2024-03-20T13:39:09.457563+0000","last_active":"2024-03-20T13:39:09.457481+0000","last_peered":"2024-03-20T13:39:09.457481+0000","last_clean":"2024-03-20T13:39:09.457481+0000","last_became_active":"2024-03-20T13:36:36.848317+0000","last_became_peered":"2024-03-20T13:36:36.848317+0000","last_unstale":"2024-03-20T13:39:09.457481+0000","last_undegraded":"2024-03-20T13:39:09.457481+0000","last_fullsized":"2024-03-20T13:39:09.457481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:39:09.457273+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:39:09.457273+0000","last_clean_scrub_stamp":"2024-03-20T13:39:09.457273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:14:25.152600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:50.492407+0000","last_change":"2024-03-20T13:38:50.492407+0000","last_active":"2024-03-20T13:38:50.492407+0000","last_peered":"2024-03-20T13:38:50.492407+0000","last_clean":"2024-03-20T13:38:50.492407+0000","last_became_active":"2024-03-20T13:36:38.835992+0000","last_became_peered":"2024-03-20T13:36:38.835992+0000","last_unstale":"2024-03-20T13:38:50.492407+0000","last_undegraded":"2024-03-20T13:38:50.492407+0000","last_fullsized":"2024-03-20T13:38:50.492407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:38:50.492146+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:38:50.492146+0000","last_clean_scrub_stamp":"2024-03-20T13:38:50.492146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:27:39.693616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:55.681515+0000","last_change":"2024-03-20T13:38:55.681515+0000","last_active":"2024-03-20T13:38:55.681515+0000","last_peered":"2024-03-20T13:38:55.681515+0000","last_clean":"2024-03-20T13:38:55.681515+0000","last_became_active":"2024-03-20T13:36:36.817974+0000","last_became_peered":"2024-03-20T13:36:36.817974+0000","last_unstale":"2024-03-20T13:38:55.681515+0000","last_undegraded":"2024-03-20T13:38:55.681515+0000","last_fullsized":"2024-03-20T13:38:55.681515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:38:55.681247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:38:55.681247+0000","last_clean_scrub_stamp":"2024-03-20T13:38:55.681247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:45.489248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.348642+0000","last_change":"2024-03-20T13:39:03.348706+0000","last_active":"2024-03-20T13:39:03.348642+0000","last_peered":"2024-03-20T13:39:03.348642+0000","last_clean":"2024-03-20T13:39:03.348642+0000","last_became_active":"2024-03-20T13:36:38.825993+0000","last_became_peered":"2024-03-20T13:36:38.825993+0000","last_unstale":"2024-03-20T13:39:03.348642+0000","last_undegraded":"2024-03-20T13:39:03.348642+0000","last_fullsized":"2024-03-20T13:39:03.348642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:39:03.348438+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:39:03.348438+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.348438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:27:05.021930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:16.365744+0000","last_change":"2024-03-20T13:39:16.365814+0000","last_active":"2024-03-20T13:39:16.365744+0000","last_peered":"2024-03-20T13:39:16.365744+0000","last_clean":"2024-03-20T13:39:16.365744+0000","last_became_active":"2024-03-20T13:36:36.842309+0000","last_became_peered":"2024-03-20T13:36:36.842309+0000","last_unstale":"2024-03-20T13:39:16.365744+0000","last_undegraded":"2024-03-20T13:39:16.365744+0000","last_fullsized":"2024-03-20T13:39:16.365744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-03-20T13:39:16.365556+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-03-20T13:39:16.365556+0000","last_clean_scrub_stamp":"2024-03-20T13:39:16.365556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:27.751836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:08.274908+0000","last_change":"2024-03-20T13:39:08.274971+0000","last_active":"2024-03-20T13:39:08.274908+0000","last_peered":"2024-03-20T13:39:08.274908+0000","last_clean":"2024-03-20T13:39:08.274908+0000","last_became_active":"2024-03-20T13:36:36.818569+0000","last_became_peered":"2024-03-20T13:36:36.818569+0000","last_unstale":"2024-03-20T13:39:08.274908+0000","last_undegraded":"2024-03-20T13:39:08.274908+0000","last_fullsized":"2024-03-20T13:39:08.274908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:08.274706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:08.274706+0000","last_clean_scrub_stamp":"2024-03-20T13:39:08.274706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:45.027984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:41.651777+0000","last_change":"2024-03-20T13:38:41.651777+0000","last_active":"2024-03-20T13:38:41.651777+0000","last_peered":"2024-03-20T13:38:41.651777+0000","last_clean":"2024-03-20T13:38:41.651777+0000","last_became_active":"2024-03-20T13:36:38.830166+0000","last_became_peered":"2024-03-20T13:36:38.830166+0000","last_unstale":"2024-03-20T13:38:41.651777+0000","last_undegraded":"2024-03-20T13:38:41.651777+0000","last_fullsized":"2024-03-20T13:38:41.651777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-03-20T13:38:41.651396+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-03-20T13:38:41.651396+0000","last_clean_scrub_stamp":"2024-03-20T13:38:41.651396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:02.659444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:39:03.678149+0000","last_change":"2024-03-20T13:39:03.678326+0000","last_active":"2024-03-20T13:39:03.678149+0000","last_peered":"2024-03-20T13:39:03.678149+0000","last_clean":"2024-03-20T13:39:03.678149+0000","last_became_active":"2024-03-20T13:36:36.833100+0000","last_became_peered":"2024-03-20T13:36:36.833100+0000","last_unstale":"2024-03-20T13:39:03.678149+0000","last_undegraded":"2024-03-20T13:39:03.678149+0000","last_fullsized":"2024-03-20T13:39:03.678149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:39:03.677935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:39:03.677935+0000","last_clean_scrub_stamp":"2024-03-20T13:39:03.677935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:45:21.933138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-20T13:38:58.690058+0000","last_change":"2024-03-20T13:38:58.690058+0000","last_active":"2024-03-20T13:38:58.690058+0000","last_peered":"2024-03-20T13:38:58.690058+0000","last_clean":"2024-03-20T13:38:58.690058+0000","last_became_active":"2024-03-20T13:36:38.827462+0000","last_became_peered":"2024-03-20T13:36:38.827462+0000","last_unstale":"2024-03-20T13:38:58.690058+0000","last_undegraded":"2024-03-20T13:38:58.690058+0000","last_fullsized":"2024-03-20T13:38:58.690058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-03-20T13:38:58.689817+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-03-20T13:38:58.689817+0000","last_clean_scrub_stamp":"2024-03-20T13:38:58.689817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:35.319664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1416,"ondisk_log_size":1416,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":890,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673004,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":425984,"data_stored":153410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.44600000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Wed Mar 20 13:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.5,"5min":0.187,"15min":0.187},"max":{"1min":0.755,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.45500000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Mar 20 13:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.52000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.78800000000000003,"5min":1.04,"15min":1.04},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.48299999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.749,"5min":1.216,"15min":1.216},"last":0.51700000000000002}]}]},{"osd":2,"up_from":10,"seq":42949673005,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":744159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.56899999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78100000000000003,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.56899999999999995,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82799999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed Mar 20 13:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.44800000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.47099999999999997,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76700000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Mar 20 13:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.628},"min":{"1min":0.48199999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.75700000000000001,"5min":1.145,"15min":1.145},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.50900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.75800000000000001,"5min":1,"15min":1},"last":0.73499999999999999}]}]},{"osd":1,"up_from":10,"seq":42949673003,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":744032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.52700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.78900000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65900000000000003}]},{"osd":2,"last update":"Wed Mar 20 13:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58699999999999997,"15min":0.56799999999999995},"min":{"1min":0.46800000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.81599999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.752,"5min":1.411,"15min":1.411},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed Mar 20 13:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79200000000000004,"5min":1.117,"15min":1.117},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.498,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80500000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70499999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":471040,"data_stored":155233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.69499999999999995},"min":{"1min":0.58299999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86699999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63}]},{"osd":2,"last update":"Wed Mar 20 13:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.505,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91700000000000004,"5min":1.161,"15min":1.161},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92400000000000004,"5min":1.052,"15min":1.052},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.59599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.52100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93500000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.95499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:39:45.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-20T13:39:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.694+0000 7ff366eac640 1 Processor -- start 2024-03-20T13:39:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.694+0000 7ff366eac640 1 -- start start 2024-03-20T13:39:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff36012c080 0x7ff36012c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff360094fb0 con 0x7ff360095620 2024-03-20T13:39:45.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600949e0 con 0x7ff36012c080 2024-03-20T13:39:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff364c48640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff36012c080 0x7ff36012c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff35ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff360095620 0x7ff360128620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:36042/0 (socket says 172.21.15.89:36042) 2024-03-20T13:39:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff35ffff640 1 -- 172.21.15.89:0/2830445439 learned_addr learned my addr 172.21.15.89:0/2830445439 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-03-20T13:39:45.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff364c48640 1 -- 172.21.15.89:0/2830445439 >> v1:172.21.15.89:6789/0 conn(0x7ff360095620 legacy=0x7ff360128620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff364c48640 1 -- 172.21.15.89:0/2830445439 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600951e0 con 0x7ff36012c080 2024-03-20T13:39:45.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff35f7fe640 1 -- 172.21.15.89:0/2830445439 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039805850 0 0) 0x7ff360094fb0 con 0x7ff360095620 2024-03-20T13:39:45.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff364c48640 1 --2- 172.21.15.89:0/2830445439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36012c080 0x7ff36012c460 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff350009740 tx=0x7ff35001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f050e41edc21969a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:45.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff35f7fe640 1 -- 172.21.15.89:0/2830445439 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3500ab530 con 0x7ff36012c080 2024-03-20T13:39:45.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff35f7fe640 1 -- 172.21.15.89:0/2830445439 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3500a7050 con 0x7ff36012c080 2024-03-20T13:39:45.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff35f7fe640 1 -- 172.21.15.89:0/2830445439 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3500ab7e0 con 0x7ff36012c080 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- 172.21.15.89:0/2830445439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36012c080 msgr2=0x7ff36012c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 --2- 172.21.15.89:0/2830445439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36012c080 0x7ff36012c460 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff350009740 tx=0x7ff35001c310 comp rx=0 tx=0).stop 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- 172.21.15.89:0/2830445439 shutdown_connections 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 --2- 172.21.15.89:0/2830445439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36012c080 0x7ff36012c460 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- 172.21.15.89:0/2830445439 >> 172.21.15.89:0/2830445439 conn(0x7ff36009a050 msgr2=0x7ff36009a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- 172.21.15.89:0/2830445439 shutdown_connections 2024-03-20T13:39:45.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.698+0000 7ff366eac640 1 -- 172.21.15.89:0/2830445439 wait complete. 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 Processor -- start 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 -- start start 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 0x7ff36006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36006f4f0 con 0x7ff360095620 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff364c48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 0x7ff36006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff364c48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 0x7ff36006c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45452/0 (socket says 172.21.15.89:45452) 2024-03-20T13:39:45.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff364c48640 1 -- 172.21.15.89:0/1982882339 learned_addr learned my addr 172.21.15.89:0/1982882339 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-03-20T13:39:45.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff364c48640 1 -- 172.21.15.89:0/1982882339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350009420 con 0x7ff360095620 2024-03-20T13:39:45.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff364c48640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 0x7ff36006c5d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff350019fa0 tx=0x7ff35001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:45.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3500abc90 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3500abdf0 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff350004150 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36006e0f0 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36006f930 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3500b2050 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36006d2d0 con 0x7ff360095620 2024-03-20T13:39:45.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35d7fa640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff340035a10 0x7ff340037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:39:45.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ff3500e2ab0 con 0x7ff360095620 2024-03-20T13:39:45.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.702+0000 7ff35ffff640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff340035a10 0x7ff340037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:39:45.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.706+0000 7ff35ffff640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff340035a10 0x7ff340037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff348007fd0 tx=0x7ff348007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:39:45.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.706+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff3500b2710 con 0x7ff360095620 2024-03-20T13:39:45.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.866+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff360062860 con 0x7ff360095620 2024-03-20T13:39:45.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.870+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff3500b0020 con 0x7ff360095620 2024-03-20T13:39:45.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.870+0000 7ff35d7fa640 1 -- 172.21.15.89:0/1982882339 <== mon.0 v2:172.21.15.89:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff3500b2710 con 0x7ff360095620 2024-03-20T13:39:45.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.870+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff340035a10 msgr2=0x7ff340037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.870+0000 7ff366eac640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff340035a10 0x7ff340037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff348007fd0 tx=0x7ff348007920 comp rx=0 tx=0).stop 2024-03-20T13:39:45.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.870+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 msgr2=0x7ff36006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:39:45.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 0x7ff36006c5d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff350019fa0 tx=0x7ff35001abb0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 shutdown_connections 2024-03-20T13:39:45.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.123:6824/2420952722,v1:172.21.15.123:6825/2420952722] conn(0x7ff340035a10 0x7ff340037ed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 --2- 172.21.15.89:0/1982882339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff360095620 0x7ff36006c5d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:39:45.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 >> 172.21.15.89:0/1982882339 conn(0x7ff36009a050 msgr2=0x7ff360131020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:39:45.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 shutdown_connections 2024-03-20T13:39:45.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-03-20T13:39:45.874+0000 7ff366eac640 1 -- 172.21.15.89:0/1982882339 wait complete. 2024-03-20T13:39:45.894 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-20T13:39:45.894 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-20T13:39:45.895 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-20T13:39:45.895 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:39:45.975 INFO:tasks.ceph.osd.0:Stopped 2024-03-20T13:39:45.976 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-20T13:39:45.976 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:39:46.067 INFO:tasks.ceph.osd.1:Stopped 2024-03-20T13:39:46.067 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-20T13:39:46.067 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:39:46.144 INFO:tasks.ceph.osd.2:Stopped 2024-03-20T13:39:46.144 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-20T13:39:46.144 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:39:46.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-20T13:39:52.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2024-03-20T13:39:52.246 INFO:tasks.ceph.osd.3:Stopped 2024-03-20T13:39:52.246 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-20T13:39:52.247 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-20T13:39:52.247 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:39:52.277 INFO:tasks.ceph.mgr.x:Stopped 2024-03-20T13:39:52.277 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-20T13:39:52.277 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-20T13:39:52.277 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:39:52.302 INFO:tasks.ceph.mon.a:Stopped 2024-03-20T13:39:52.302 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-20T13:39:52.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-03-20T13:39:52.359 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2024-03-20T13:39:52.360 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-20T13:39:52.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:39:52.562 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-20T13:39:52.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:39:52.687 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-20T13:39:52.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:39:52.846 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-20T13:39:53.004 INFO:tasks.ceph:Archiving mon data... 2024-03-20T13:39:53.005 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/data/mon.a.tgz 2024-03-20T13:39:53.006 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-03-20T13:39:53.011 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.4GA2CXVB2i 2024-03-20T13:39:53.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4GA2CXVB2i 2024-03-20T13:39:53.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.4GA2CXVB2i 2024-03-20T13:39:53.186 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.4GA2CXVB2i is 244KB 2024-03-20T13:39:53.247 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.4GA2CXVB2i 2024-03-20T13:39:53.253 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-20T13:39:53.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-20T13:39:53.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-20T13:39:53.357 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-20T13:39:53.363 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-20T13:39:53.363 INFO:tasks.ceph:Archiving crash dumps... 2024-03-20T13:39:53.365 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/remote/smithi089/crash 2024-03-20T13:39:53.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-20T13:39:53.413 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/remote/smithi123/crash 2024-03-20T13:39:53.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-20T13:39:53.428 INFO:tasks.ceph:Compressing logs... 2024-03-20T13:39:53.428 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-20T13:39:53.462 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-20T13:39:53.478 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23846.log 2024-03-20T13:39:53.478 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23898.log 2024-03-20T13:39:53.478 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23846.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-20T13:39:53.479 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23898.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23846.log.gz 2024-03-20T13:39:53.479 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.23898.log.gz 2024-03-20T13:39:53.479 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23872.log 2024-03-20T13:39:53.481 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23208.log 2024-03-20T13:39:53.481 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.23872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23399.log 2024-03-20T13:39:53.481 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23208.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23872.log.gz 2024-03-20T13:39:53.481 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23093.log 2024-03-20T13:39:53.481 INFO:teuthology.orchestra.run.smithi089.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23208.log.gz 2024-03-20T13:39:53.481 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23295.log 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23399.log.gz 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23297.log 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23598.log 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23093.log.gz 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23295.log.gz 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24054.log 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23297.log.gz 2024-03-20T13:39:53.485 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23794.log 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.24054.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23598.log.gz 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21433.log 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24054.log.gz 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23401.log 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23794.log.gz 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.21433.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23688.log 2024-03-20T13:39:53.486 INFO:teuthology.orchestra.run.smithi089.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.21433.log.gz 2024-03-20T13:39:53.487 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23401.log.gz 2024-03-20T13:39:53.487 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23498.log 2024-03-20T13:39:53.487 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23976.log 2024-03-20T13:39:53.492 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23688.log: /var/log/ceph/ceph-client.admin.23498.log: gzip 86.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.23498.log.gz --verbose 2024-03-20T13:39:53.492 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.23924.log 2024-03-20T13:39:53.492 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23688.log.gz 2024-03-20T13:39:53.492 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24002.log 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23924.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23976.log.gz 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23402.log 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23924.log.gz 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23506.log 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.24002.log: /var/log/ceph/ceph-client.admin.23402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23182.log 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24002.log.gz 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23402.log.gz 2024-03-20T13:39:53.493 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21504.log 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23506.log.gz 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23740.log 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23182.log.gz 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.21504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23298.log 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23740.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.21504.log.gz 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23740.log.gz 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24028.log 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23650.log 2024-03-20T13:39:53.494 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23298.log.gz 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.24028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23820.log 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24028.log.gz 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21546.log 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23650.log: /var/log/ceph/ceph-client.admin.23820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23156.log 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23650.log.gz 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.21546.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23820.log.gz 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24080.log 2024-03-20T13:39:53.495 INFO:teuthology.orchestra.run.smithi089.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.21546.log.gz 2024-03-20T13:39:53.496 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23156.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-20T13:39:53.496 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.24080.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23156.log.gz 2024-03-20T13:39:53.496 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23714.log 2024-03-20T13:39:53.496 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24080.log.gz 2024-03-20T13:39:53.496 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24130.log 2024-03-20T13:39:53.505 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23260.log 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23714.log.gz 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.24130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24106.log 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23260.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20179.log 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24130.log.gz 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23260.log.gz 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.24106.log: -- /var/log/ceph/ceph-client.admin.23234.log 2024-03-20T13:39:53.506 INFO:teuthology.orchestra.run.smithi089.stderr: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.20179.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20179.log.gz 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.24106.log.gz -5 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23624.log 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23234.log.gz 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23505.log 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23768.log 2024-03-20T13:39:53.507 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23624.log.gz 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23296.log 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23494.log 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23505.log.gz 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23768.log.gz 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23131.log 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23296.log.gz 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23390.log 2024-03-20T13:39:53.508 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23494.log.gz 2024-03-20T13:39:53.509 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23950.log 2024-03-20T13:39:53.509 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23131.log: /var/log/ceph/ceph-client.admin.23390.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23131.log.gz 2024-03-20T13:39:53.509 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.23950.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23390.log.gz 2024-03-20T13:39:53.509 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.23950.log.gz 2024-03-20T13:39:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48199.log 2024-03-20T13:39:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70029.log 2024-03-20T13:39:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.48199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28004.log 2024-03-20T13:39:53.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.70029.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.28004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52329.log 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28004.log.gz 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70619.log 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48199.log.gz 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.52329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60589.log 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70029.log.gz 2024-03-20T13:39:53.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.70619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32859.log 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.60589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54689.log 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.32859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43479.log 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52329.log.gz 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.54689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78849.log 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38759.log 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.78849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59999.log 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70619.log.gz 2024-03-20T13:39:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.38759.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32859.log.gz 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45839.log 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78849.log.gz 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.60589.log.gz 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43479.log.gz 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54689.log.gz 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.59999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72389.log 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.45839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55869.log 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47019.log 2024-03-20T13:39:53.528 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3%/var/log/ceph/ceph-client.0.72389.log: -- replaced with /var/log/ceph/ceph-client.0.38759.log.gz 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.55869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36399.log 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.45839.log.gz 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.47019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65899.log 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.36399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56459.log 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.65899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35219.log 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55869.log.gz 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.56459.log: 92.9% 91.7% -- replaced with /var/log/ceph/ceph-client.0.47019.log.gz 2024-03-20T13:39:53.529 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.59999.log.gz 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.72389.log.gz 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36399.log.gz 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34629.log 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.35219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37579.log 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.65899.log.gz 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63539.log 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.34629.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56459.log.gz 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23785.log 2024-03-20T13:39:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.37579.log: /var/log/ceph/ceph-client.0.63539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38169.log 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.35219.log.gz 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.23785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51739.log 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.23785.log.gz 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.38169.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.51739.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58229.log 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.34629.log.gz 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75339.log 2024-03-20T13:39:53.531 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37579.log.gz 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67079.log 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.58229.log: -- replaced with /var/log/ceph/ceph-client.0.38169.log.gz 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.63539.log.gz 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64719.log 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.75339.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.51739.log.gz 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.67079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46429.log 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.64719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79433.log 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.46429.log: 92.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44069.log 2024-03-20T13:39:53.532 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.58229.log.gz 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.75339.log.gz 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.79433.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67079.log.gz 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61179.log 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64719.log.gz 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.44069.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.79433.log.gz 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36989.log 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.61179.log: gzip -5 --verbose -- 92.2% /var/log/ceph/ceph-client.0.74159.log 2024-03-20T13:39:53.533 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.46429.log.gz 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.36989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28028.log 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.74159.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31685.log 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.44069.log.gz 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.28028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67669.log 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28028.log.gz 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73569.log 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36989.log.gz 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.31685.log: /var/log/ceph/ceph-client.0.67669.log: 91.5% 92.8% -- replaced with /var/log/ceph/ceph-client.0.74159.log.gz 2024-03-20T13:39:53.534 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.61179.log.gz 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.31685.log.gz 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52919.log 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67669.log.gz 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.73569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69439.log 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.52919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62359.log 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.69439.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.62359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55279.log 2024-03-20T13:39:53.535 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.73569.log.gz 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34039.log 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52919.log.gz 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65309.log 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.69439.log.gz 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.55279.log: /var/log/ceph/ceph-client.0.34039.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 91.4% 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.62359.log.gz 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.65309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30505.log 2024-03-20T13:39:53.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53509.log 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55279.log.gz 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5%/var/log/ceph/ceph-client.0.30505.log: -- replaced with /var/log/ceph/ceph-client.0.34039.log.gz 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.65309.log.gz 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80020.log 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.53509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31095.log 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30505.log.gz 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.80020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50559.log 2024-03-20T13:39:53.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.31095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28052.log 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.50559.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.53509.log.gz 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72979.log 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.28052.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31095.log.gz 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr: 86.1% 91.6% -- replaced with /var/log/ceph/ceph-client.admin.28052.log.gz -- replaced with /var/log/ceph/ceph-client.0.50559.log.gz 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59409.log 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.72979.log: 93.5% -- replaced with /var/log/ceph/ceph-client.0.80020.log.gz 2024-03-20T13:39:53.538 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44659.log 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.59409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58819.log 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.44659.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.58819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29325.log 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.x.log: 91.3% 91.5% -- replaced with /var/log/ceph/ceph-client.0.44659.log.gz 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.59409.log.gz 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.72979.log.gz 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58819.log.gz 2024-03-20T13:39:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51149.log 2024-03-20T13:39:53.540 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.29325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42889.log 2024-03-20T13:39:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.51149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49969.log 2024-03-20T13:39:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.42889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77681.log 2024-03-20T13:39:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.49969.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.29325.log.gz 2024-03-20T13:39:53.556 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51149.log.gz 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42299.log 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42889.log.gz 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.77681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57639.log 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.49969.log.gz 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.42299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23761.log 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.77681.log.gz 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66489.log 2024-03-20T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.57639.log: /var/log/ceph/ceph-client.admin.23761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54099.log 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.66489.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23761.log.gz 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42299.log.gz 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28076.log 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.54099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49379.log 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.57639.log.gz 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.28076.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66489.log.gz 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28076.log.gz 2024-03-20T13:39:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45249.log 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.49379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61769.log 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54099.log.gz 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.45249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47609.log 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.61769.log: /var/log/ceph/ceph-client.0.47609.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49379.log.gz 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45249.log.gz 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35809.log 2024-03-20T13:39:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41119.log 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.35809.log: 91.6% 90.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.47609.log.gz 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.61769.log.gz 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23809.log 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.41119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39939.log 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5%/var/log/ceph/ceph-client.admin.23809.log: -- replaced with /var/log/ceph/ceph-client.0.35809.log.gz 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68259.log 2024-03-20T13:39:53.560 INFO:teuthology.orchestra.run.smithi123.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.23809.log.gz 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74749.log 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.39939.log: /var/log/ceph/ceph-client.0.68259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41709.log 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41119.log.gz 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.74749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33449.log 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.41709.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68259.log.gz 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39939.log.gz 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68849.log 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.33449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27980.log 2024-03-20T13:39:53.561 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41709.log.gz 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.68849.log: 91.8%gzip -- replaced with /var/log/ceph/ceph-client.0.74749.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.29915.log 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.27980.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.27980.log.gz 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.33449.log.gz 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76513.log 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.29915.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68849.log.gz 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71209.log 2024-03-20T13:39:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.76513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57049.log 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.71209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.28735.log 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8%/var/log/ceph/ceph-client.0.57049.log: -- replaced with /var/log/ceph/ceph-client.0.76513.log.gz 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29915.log.gz 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71799.log 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 91.3% /var/log/ceph/ceph-client.admin.23833.log 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.71209.log.gz 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.28735.log: /var/log/ceph/ceph-client.0.71799.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40529.log 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.57049.log.gz 2024-03-20T13:39:53.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.23833.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.23833.log.gz 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.28735.log.gz 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71799.log.gz 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48789.log 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.40529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78265.log 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.48789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64129.log 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.78265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75929.log 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr: 91.5%/var/log/ceph/ceph-client.0.64129.log: -- replaced with /var/log/ceph/ceph-client.0.40529.log.gz 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78265.log.gz 2024-03-20T13:39:53.564 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39349.log 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48789.log.gz 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.75929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77097.log 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.39349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32269.log 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.75929.log.gz 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.77097.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62949.log 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.0.64129.log.gz 2024-03-20T13:39:53.565 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8%/var/log/ceph/ceph-client.0.32269.log: -- replaced with /var/log/ceph/ceph-client.0.77097.log.gz 2024-03-20T13:39:53.566 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39349.log.gz 2024-03-20T13:39:53.566 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.62949.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.32269.log.gz 2024-03-20T13:39:53.566 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62949.log.gz 2024-03-20T13:39:53.566 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-20T13:39:53.634 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-20T13:39:54.178 INFO:teuthology.orchestra.run.smithi123.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-20T13:39:54.314 INFO:teuthology.orchestra.run.smithi123.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-20T13:39:54.320 INFO:teuthology.orchestra.run.smithi123.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-20T13:39:54.321 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-03-20T13:39:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m0.846s 2024-03-20T13:39:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m2.452s 2024-03-20T13:39:54.322 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m0.163s 2024-03-20T13:39:54.366 INFO:teuthology.orchestra.run.smithi089.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-20T13:39:54.368 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-03-20T13:39:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m0.904s 2024-03-20T13:39:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m1.045s 2024-03-20T13:39:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.071s 2024-03-20T13:39:54.369 INFO:tasks.ceph:Archiving logs... 2024-03-20T13:39:54.369 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/remote/smithi089/log 2024-03-20T13:39:54.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-20T13:39:54.584 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/remote/smithi123/log 2024-03-20T13:39:54.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-20T13:39:54.972 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-20T13:39:54.983 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-20T13:39:54.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-20T13:39:54.989 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-20T13:39:55.055 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-20T13:39:55.063 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-20T13:39:55.064 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:39:55.066 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:39:55.075 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-03-20T13:39:55.076 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-03-20T13:39:55.076 INFO:teuthology.orchestra.run.smithi089.stdout:*hv01.front.sepi 44.4.53.2 2 u 27 64 77 0.122 +1.778 3.026 2024-03-20T13:39:55.076 INFO:teuthology.orchestra.run.smithi089.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 64 77 0.103 +0.438 3.099 2024-03-20T13:39:55.076 INFO:teuthology.orchestra.run.smithi089.stdout:+hv03.front.sepi 74.6.168.72 3 u 22 64 77 0.106 -2.877 3.216 2024-03-20T13:39:55.076 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:39:55.080 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2024-03-20T13:39:55.080 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2024-03-20T13:39:55.080 INFO:teuthology.orchestra.run.smithi123.stdout:*hv01.front.sepi 44.4.53.2 2 u 29 64 77 0.134 +0.243 2.224 2024-03-20T13:39:55.080 INFO:teuthology.orchestra.run.smithi123.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 77 0.127 -1.081 2.199 2024-03-20T13:39:55.081 INFO:teuthology.orchestra.run.smithi123.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 77 0.097 -4.286 1.927 2024-03-20T13:39:55.081 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-20T13:39:55.082 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-20T13:39:55.090 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-20T13:39:55.091 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-20T13:39:55.142 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-20T13:39:55.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-20T13:39:55.209 INFO:teuthology.task.internal:Duration was 779.589481 seconds 2024-03-20T13:39:55.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-20T13:39:55.243 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-20T13:39:55.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-20T13:39:55.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-20T13:39:55.284 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-20T13:39:55.284 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-03-20T13:39:55.284 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-20T13:39:55.329 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-03-20T13:39:55.329 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-20T13:39:55.340 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-20T13:39:55.340 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-20T13:39:55.378 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-20T13:39:55.407 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-20T13:39:55.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-20T13:39:55.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-20T13:39:55.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-20T13:39:55.509 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-20T13:39:55.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-20T13:39:55.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-20T13:39:55.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-20T13:39:55.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:39:55.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:39:55.577 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-03-20T13:39:55.584 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-03-20T13:39:55.671 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:39:55.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:39:55.717 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:39:55.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:39:55.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-20T13:39:55.733 INFO:teuthology.task.internal:Transferring archived files... 2024-03-20T13:39:55.734 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/remote/smithi089 2024-03-20T13:39:55.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-20T13:39:55.782 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305/remote/smithi123 2024-03-20T13:39:55.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-20T13:39:55.804 INFO:teuthology.task.internal:Removing archive directory... 2024-03-20T13:39:55.804 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-20T13:39:55.822 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-20T13:39:55.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-20T13:39:55.860 INFO:teuthology.task.internal:Not uploading archives. 2024-03-20T13:39:55.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-20T13:39:55.884 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-20T13:39:55.884 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-20T13:39:55.887 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-20T13:39:55.891 INFO:teuthology.orchestra.run.smithi089.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 20 13:39 /home/ubuntu/cephtest 2024-03-20T13:39:55.897 INFO:teuthology.orchestra.run.smithi123.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 20 13:39 /home/ubuntu/cephtest 2024-03-20T13:39:55.898 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-20T13:39:55.918 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-20T13:39:55.985 INFO:teuthology.nuke:Checking targets against current locks 2024-03-20T13:39:56.010 DEBUG:teuthology.nuke:shortname: smithi089 2024-03-20T13:39:56.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-20T13:39:56.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:22.413876', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKOSN6JHb/n65YoBGNHUGf8IQTTm58xCM0bYcw6Q83rJH3LwybxnqCEHlnPiL/ZT/Bw8Ix1Go/OTIPeVBhJTz8='} 2024-03-20T13:39:56.040 DEBUG:teuthology.nuke:shortname: smithi123 2024-03-20T13:39:56.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-20T13:39:56.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:22.415020', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQkSkDgw+Ua/Y5BwKIeHuRzQVFHqxkFwqvyQRRnWyQimem8q3XyJugDl8P31woQxNEF+xC+FEgVJk4U13z/mH4='} 2024-03-20T13:39:56.094 INFO:teuthology.orchestra.console.smithi089:Power off 2024-03-20T13:39:56.094 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T13:39:56.121 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2024-03-20T13:39:56.122 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:39:56.140 INFO:teuthology.orchestra.console.smithi123:Power off 2024-03-20T13:39:56.141 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T13:39:56.153 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-03-20T13:39:56.165 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2024-03-20T13:39:56.165 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:39:56.190 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-03-20T13:39:57.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-20T13:40:00.154 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:40:00.191 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:40:00.267 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2024-03-20T13:40:00.303 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-03-20T13:40:04.270 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:40:04.304 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:40:04.383 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2024-03-20T13:40:04.416 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-03-20T13:40:04.485 INFO:teuthology.orchestra.console.smithi089:Power off completed 2024-03-20T13:40:04.518 INFO:teuthology.orchestra.console.smithi123:Power off completed 2024-03-20T13:40:04.623 INFO:teuthology.run:Summary data: description: rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 779.5894811153412 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000005c3b92b8254e3809-0065fae6c4-4227-default4227-default-default' flavor: default owner: scheduled_amaredia@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=480f71887f2147e58ac4763a21b6133a status: fail success: false 2024-03-20T13:40:04.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T13:40:04.700 INFO:teuthology.run:FAIL